Jul 20 16:14:03.514374 ip-10-0-135-221 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.909951    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914417    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914428    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914432    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914435    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914438    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914441    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914450    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 16:14:04.081374 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914452    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 16:14:03.982585 ip-10-0-135-221 systemd[1]: Started Kubernetes Kubelet.
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914455    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914458    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914462    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914466    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914469    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914472    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914474    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914477    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914480    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914489    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914491    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914494    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914497    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914499    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914501    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914504    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914507    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914509    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 16:14:04.082937 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914512    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914515    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914517    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914519    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914522    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914524    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914527    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914529    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914532    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914534    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914537    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914539    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914542    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914545    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914547    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914551    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914555    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914557    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914560    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914562    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 16:14:04.084664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914565    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914567    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914570    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914572    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914575    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914577    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914580    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914582    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914586    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914588    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914592    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914594    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914597    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914600    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914603    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914605    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914608    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914611    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914614    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 16:14:04.085386 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914617    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914620    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914624    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914626    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914630    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914633    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914635    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914638    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914641    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914643    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914646    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914649    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914651    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914654    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914658    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914661    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914664    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914666    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914669    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914671    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 16:14:04.086181 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914674    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914677    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914679    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914682    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914685    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914687    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914690    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914693    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914695    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914697    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914700    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914702    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914705    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.914707    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915371    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915378    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915381    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915384    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915387    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915389    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 16:14:04.086892 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915392    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915395    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915397    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915400    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915402    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915405    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915408    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915411    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915414    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915416    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915418    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915421    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915423    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915426    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915428    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915431    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915434    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915437    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915440    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915442    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 16:14:04.087658 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915445    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915447    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915450    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915452    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915455    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915458    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915462    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915465    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915467    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915470    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915473    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915476    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915478    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915481    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915484    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915487    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915490    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915493    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915495    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915497    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 16:14:04.088404 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915500    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915502    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915504    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915507    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915510    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915514    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915517    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915520    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915523    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915526    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915529    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915532    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915534    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915537    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915540    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915542    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915546    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915549    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915552    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915555    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 16:14:04.089159 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915557    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915559    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915562    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915566    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915570    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915573    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915575    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915578    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915580    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915583    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915586    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915588    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915590    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915593    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915595    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915598    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915600    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915603    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915606    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 16:14:04.089915 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915609    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915611    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915614    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915616    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915618    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915621    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915623    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915627    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915630    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915634    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915636    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915640    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915642    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915645    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915970    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915975    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915978    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915981    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915983    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 16:14:04.090615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915986    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915988    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915991    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915993    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915996    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.915999    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916002    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916004    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916006    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916009    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916012    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916014    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916016    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916019    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916021    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916024    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916026    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916028    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916031    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916033    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 16:14:04.091383 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916036    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916038    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916042    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916045    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916049    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916051    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916053    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916056    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916058    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916060    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916063    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916067    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916071    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916073    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916076    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916079    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916082    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916085    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916087    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 16:14:04.092144 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916090    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916094    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916097    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916100    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916102    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916105    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916107    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916109    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916112    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916114    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916118    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916121    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916144    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916147    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916149    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916153    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916156    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916160    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916162    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 16:14:04.092893 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916165    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916167    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916170    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916173    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916175    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916179    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916181    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916184    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916186    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916188    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916191    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916193    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916196    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916199    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916202    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916204    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916207    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916209    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916212    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 16:14:04.093650 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916215    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916217    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916219    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916221    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916224    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916226    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916229    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916231    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916234    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916238    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916240    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916244    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916246    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916249    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916251    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916254    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916256    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916335    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916342    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916353    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916359    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 16:14:04.094407 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916365    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916370    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916376    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916380    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916384    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916386    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916390    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916393    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916396    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916398    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916401    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916405    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916407    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916410    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916414    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916416    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916419    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916422    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916425    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916429    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916433    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916436    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916441    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916443    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 16:14:04.095175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916446    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916449    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916452    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916455    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916459    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916461    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916464    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916468    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916470    2560 flags.go:64] FLAG: --enable-server="true"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916473    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916477    2560 flags.go:64] FLAG: --event-burst="100"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916480    2560 flags.go:64] FLAG: --event-qps="50"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916483    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916486    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916489    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916492    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916495    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916498    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916500    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916503    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916506    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916508    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916511    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916514    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916523    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 16:14:04.095928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916527    2560 flags.go:64] FLAG: --feature-gates=""
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916531    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916534    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916538    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916541    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916546    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916549    2560 flags.go:64] FLAG: --help="false"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916551    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-135-221.ec2.internal"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916555    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916558    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916560    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916564    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916567    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916570    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916572    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916575    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916578    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916581    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916584    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916586    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916589    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916592    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916595    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916597    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 16:14:04.096683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916600    2560 flags.go:64] FLAG: --lock-file=""
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916603    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916605    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916608    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916613    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916616    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916619    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916621    2560 flags.go:64] FLAG: --logging-format="text"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916624    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916627    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916630    2560 flags.go:64] FLAG: --manifest-url=""
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916634    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916637    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916641    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916645    2560 flags.go:64] FLAG: --max-pods="110"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916648    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916651    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916654    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916657    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916659    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916662    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916665    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916680    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916683    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916686    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 16:14:04.097437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916690    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916692    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916697    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916700    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916703    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916706    2560 flags.go:64] FLAG: --port="10250"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916708    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916711    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e127eb73d2d1ef0"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916714    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916717    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916720    2560 flags.go:64] FLAG: --register-node="true"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916723    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916726    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916729    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916731    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916734    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916738    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916741    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916743    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916747    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916751    2560 flags.go:64] FLAG: --runonce="false"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916754    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916757    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916760    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916763    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 16:14:04.101612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916765    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916768    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916771    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916774    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916776    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916779    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916782    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916785    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916788    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916791    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916793    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916799    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916801    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916804    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916808    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916810    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916813    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916815    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916818    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916821    2560 flags.go:64] FLAG: --v="2"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916824    2560 flags.go:64] FLAG: --version="false"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916828    2560 flags.go:64] FLAG: --vmodule=""
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916831    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.916835    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916940    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 16:14:04.102739 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916944    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916948    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916952    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916955    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916958    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916961    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916963    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916966    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916968    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916971    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916973    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916976    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916978    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916981    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916983    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916986    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916989    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916991    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916994    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 16:14:04.204454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916997    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.916999    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917001    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917004    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917006    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917009    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917011    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917013    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917016    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917018    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917021    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917023    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917026    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917029    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917032    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917036    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917038    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917041    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917044    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917046    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 16:14:04.205201 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917048    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917051    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917053    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917055    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917058    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917060    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917063    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917065    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917067    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917071    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917073    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917076    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917078    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917082    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917085    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917088    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917091    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917093    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917096    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 16:14:04.205956 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917099    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917102    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917104    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917107    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917109    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917112    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917114    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917118    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917122    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917140    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917143    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917145    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917148    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917151    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917153    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917156    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917158    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917161    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917165    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917168    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 16:14:04.206721 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917171    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917174    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917176    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917180    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917182    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917185    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917187    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917189    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917192    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917194    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917197    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917200    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917202    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917206    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917209    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917211    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917214    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917216    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917218    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 16:14:04.207472 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.917222    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.918022    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.924206    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.924587    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.924613    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.924621    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924872    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924880    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924886    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924896    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924900    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924905    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924909    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924913    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 16:14:04.208237 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924920    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924926    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924930    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924935    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924939    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924946    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924952    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924962    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924966    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924971    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924975    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924979    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924984    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924988    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924992    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.924997    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925001    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925005    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925009    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 16:14:04.208995 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925013    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925023    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925053    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925058    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925062    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925066    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925070    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925074    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925078    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925082    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925086    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925091    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925095    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925099    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925109    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925113    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925116    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925121    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925139    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925144    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 16:14:04.209747 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925148    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925152    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925156    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925160    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925164    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925169    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925177    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925182    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925186    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925190    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925194    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925198    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925202    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925207    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925211    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925266    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925270    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925277    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925280    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925283    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 16:14:04.210511 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925401    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925411    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925414    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925417    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925421    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925424    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925427    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925430    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925433    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925435    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925438    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925441    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925443    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925446    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925449    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925451    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925454    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925456    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925459    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 16:14:04.211278 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925463    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925467    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925470    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925473    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925476    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925479    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925482    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925485    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925488    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925492    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925494    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925497    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925503    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.925509    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925650    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 16:14:04.212039 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925656    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925659    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925661    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925665    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925667    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925670    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925672    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925675    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925677    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925679    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925682    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925685    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925687    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925690    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925692    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925695    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925697    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925701    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925704    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 16:14:04.212807 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925707    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925709    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925712    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925714    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925717    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925720    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925723    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925726    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925729    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925732    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925736    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925742    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925745    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925748    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925751    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925754    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925757    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925759    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925762    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 16:14:04.213555 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925765    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925768    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925771    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925774    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925776    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925779    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925782    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925786    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925788    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925791    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925793    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925796    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925798    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925801    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925803    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925805    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925808    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925810    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925813    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925815    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 16:14:04.214321 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925818    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925820    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925822    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925826    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925830    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925832    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925835    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925838    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925840    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925842    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925845    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925847    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925850    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925852    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925855    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925857    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925860    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925862    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925865    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925867    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 16:14:04.215077 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925870    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925873    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925875    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925878    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925880    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925883    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925885    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925887    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925890    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925892    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925895    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925897    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925900    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925902    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925905    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925909    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925912    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925914    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925917    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 16:14:04.215841 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:03.925919    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.925924    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.926023    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.931176    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.932687    2560 server.go:1019] "Starting client certificate rotation"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.932784    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.932812    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.935279    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.937051    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.950757    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.952966    2560 log.go:25] "Validated CRI v1 image API"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.953734    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 16:14:04.216614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.955769    2560 fs.go:135] Filesystem UUIDs: map[75a961aa-97a2-4ea4-9be4-4647c19f5d96:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dcaece64-3d36-403c-b65e-55641806c8a3:/dev/nvme0n1p3]
Jul 20 16:14:04.217377 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.955787    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 16:14:04.217377 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.960942    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.961350    2560 manager.go:216] Machine: {Timestamp:2026-07-20 16:14:03.960251659 +0000 UTC m=+0.321952212 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3197521 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bdcd6b4016e3875a7e524bdbcdf00 SystemUUID:ec2bdcd6-b401-6e38-75a7-e524bdbcdf00 BootID:09c28af1-e49a-4cc6-84e6-5edc57e0697b Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2c:d5:4f:a9:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2c:d5:4f:a9:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:c1:c8:44:68:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.961444    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.961535    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.964728    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.964756    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.965590    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.965598    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.965606    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.966463    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.967565    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.970397    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.970515    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.970548    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.970566    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.970579    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.970587    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.970594    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 16:14:04.218135 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.971047    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.971081    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.974632    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.976205    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.976231    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977302    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977318    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977324    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977329    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977340    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977345    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977354    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977360    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977369    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977376    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977384    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.977389    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.978319    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.978327    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.981463    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rvd9j"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.981748    2560 server.go:1268] "Started kubelet"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.981855    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.981844    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.981909    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.982969    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:03.983037    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:03.983138    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.983775    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:03.987594    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rvd9j"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:03.987721    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:03.988273    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-221.ec2.internal.18c40b8b0077162e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-221.ec2.internal,UID:ip-10-0-135-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-221.ec2.internal,},FirstTimestamp:2026-07-20 16:14:03.981723182 +0000 UTC m=+0.343423735,LastTimestamp:2026-07-20 16:14:03.981723182 +0000 UTC m=+0.343423735,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-221.ec2.internal,}"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.068048    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.074357    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.074359    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.074495    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.075118    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.075150    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.075162    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.075252    2560 factory.go:55] Registering systemd factory
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.075266    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 16:14:04.224279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.075278    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 16:14:04.225820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.075268    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 20 16:14:04.225820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.077641    2560 factory.go:153] Registering CRI-O factory
Jul 20 16:14:04.225820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.077654    2560 factory.go:223] Registration of the crio container factory successfully
Jul 20 16:14:04.225820 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.077702    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 16:14:04.225820 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.077698    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 16:14:04.225820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.077807    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 16:14:04.225820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.077830    2560 factory.go:103] Registering Raw factory
Jul 20 16:14:04.225820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.077845    2560 manager.go:1196] Started watching for new ooms in manager
Jul 20 16:14:04.225820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.078246    2560 manager.go:349] Starting recovery of all containers
Jul 20 16:14:04.359403 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.277311    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:04.359403 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.350543    2560 manager.go:354] Recovery completed
Jul 20 16:14:04.359403 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.357709    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.359565    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.359600    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.359612    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeHasSufficientPID"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.360297    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.360309    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.360313    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.360325    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.360935    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.360956    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 16:14:04.361173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.360974    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeHasSufficientPID"
Jul 20 16:14:04.366325 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.365835    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-221.ec2.internal\" not found" node="ip-10-0-135-221.ec2.internal"
Jul 20 16:14:04.466397 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.378212    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:04.571257 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.479277    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:04.670509 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.579835    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:04.685514 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.680458    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:04.778541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.730266    2560 policy_none.go:49] "None policy: Start"
Jul 20 16:14:04.778541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.730282    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 16:14:04.778541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.730293    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 16:14:04.778541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.731245    2560 policy_none.go:47] "Start"
Jul 20 16:14:04.786325 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.781296    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:04.890869 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.806119    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 16:14:04.890869 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.881581    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:05.000180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.931790    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 16:14:05.000180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.931877    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 16:14:05.000180 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:04.981684    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:05.000180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:04.996631    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 16:14:05.002342 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.001673    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-221.ec2.internal" not found
Jul 20 16:14:05.020357 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.019524    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-221.ec2.internal" not found
Jul 20 16:14:05.115631 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.078084    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 16:09:04 +0000 UTC" deadline="2028-04-19 10:02:01.685356446 +0000 UTC"
Jul 20 16:14:05.115631 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.078105    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15329h47m56.607253432s"
Jul 20 16:14:05.115631 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.081259    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-221.ec2.internal" not found
Jul 20 16:14:05.115631 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.082308    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:05.227675 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.183060    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:05.346745 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.283653    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:05.351471 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.348070    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-221.ec2.internal" not found
Jul 20 16:14:05.351471 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.348086    2560 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-135-221.ec2.internal" not found
Jul 20 16:14:05.449011 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.384291    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:05.449011 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.384544    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-221.ec2.internal" not found
Jul 20 16:14:05.449011 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.400447    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-221.ec2.internal" not found
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.457550    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-221.ec2.internal" not found
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.466789    2560 manager.go:337] "Starting Device Plugin manager"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.466815    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.466824    2560 server.go:87] "Starting device plugin registration server"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.467065    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.467081    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.467186    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.467276    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.467285    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.468225    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.468272    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-221.ec2.internal\" not found"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.567731    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.568467    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.568513    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.568542    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.568556    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeHasSufficientPID"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.568582    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-221.ec2.internal"
Jul 20 16:14:05.639623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.577465    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-221.ec2.internal"
Jul 20 16:14:05.843068 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.843035    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 16:14:05.844281 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.844260    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 16:14:05.844361 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.844308    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 16:14:05.844361 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.844331    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 16:14:05.844452 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.844382    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 16:14:05.846517 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.846500    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 16:14:05.945379 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.945334    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal"]
Jul 20 16:14:05.947359 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.947345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:05.948390 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.948377    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:05.967729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.967715    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:05.971851 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.971829    2560 apiserver.go:52] "Watching apiserver"
Jul 20 16:14:05.971923 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.971911    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:05.979295 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.979279    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 16:14:05.979591 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.979575    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 16:14:05.982131 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.982110    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-ch2bq","openshift-image-registry/node-ca-wnlrc","openshift-multus/multus-4kb4h","openshift-multus/multus-additional-cni-plugins-grvgc","openshift-network-diagnostics/network-check-target-7xmcd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv","openshift-dns/node-resolver-kdfth","openshift-multus/network-metrics-daemon-7jn2r","openshift-network-operator/iptables-alerter-9vjfs","openshift-ovn-kubernetes/ovnkube-node-stvbt","kube-system/global-pull-secret-syncer-bt6fv","kube-system/konnectivity-agent-n6642"]
Jul 20 16:14:05.982807 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.982790    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 16:14:05.983312 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.983298    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:05.985231 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.985182    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:05.985521 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.985492    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 16:14:05.985665 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.985647    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 16:14:05.985823 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.985808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g6wfj\""
Jul 20 16:14:05.986454 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.986440    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:05.987702 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.987685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:05.988779 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.988763    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:05.988860 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.988833    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:05.989874 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.989858    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:05.990828 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.990811    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 16:14:05.990828 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.990821    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 16:14:05.990974 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.990871    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 16:14:05.991044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.991027    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:05.991134 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.991120    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8vx62\""
Jul 20 16:14:05.991939 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.991924    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 16:14:05.992024 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.991958    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 16:14:05.992290 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.992276    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:05.992359 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.992341    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:05.992443 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.992426    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 16:14:05.992892 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.992876    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bckdt\""
Jul 20 16:14:05.993113 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993098    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 16:14:05.993195 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993161    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2dkxn\""
Jul 20 16:14:05.993269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993166    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 16:14:05.993324 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993192    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 16:14:05.993397 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993378    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 16:14:05.993750 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993588    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 16:14:05.993750 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993600    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 16:14:05.993750 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993621    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 16:14:05.993750 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993640    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 16:14:05.993997 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993823    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-48jxw\""
Jul 20 16:14:05.993997 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:05.993997 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.993949    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gcpg5\""
Jul 20 16:14:05.995260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.995243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:05.996269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.996249    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 16:14:05.996475 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.996453    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hbp9x\""
Jul 20 16:14:05.996578 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.996523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:05.996633 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:05.996579    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:05.996633 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.996530    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 16:14:05.997360 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.997338    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8spmc\""
Jul 20 16:14:05.997360 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.997352    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 16:14:05.997725 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.997680    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 16:14:05.997838 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.997820    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 16:14:05.997926 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.997821    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 16:14:05.997926 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.997820    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 16:14:05.998131 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.997955    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 16:14:05.998249 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.998148    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"]
Jul 20 16:14:05.998249 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.998191    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal"]
Jul 20 16:14:05.998322 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.998286    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:05.998416 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:05.998393    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 16:14:06.000523 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.000508    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 16:14:06.000611 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.000572    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 16:14:06.000649 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.000643    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pgxsl\""
Jul 20 16:14:06.056905 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.056871    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4568ea81625bffae5468887c260fd4b0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal\" (UID: \"4568ea81625bffae5468887c260fd4b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.056905 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.056900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4568ea81625bffae5468887c260fd4b0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal\" (UID: \"4568ea81625bffae5468887c260fd4b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.057020 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.056918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0bc8024318ae1efb05d8dcf7cc6a8e0e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-221.ec2.internal\" (UID: \"0bc8024318ae1efb05d8dcf7cc6a8e0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.075835 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.075816    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 16:14:06.076489 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.076474    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 16:14:06.088847 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.088826    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 16:14:06.113170 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.113154    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2pcmq"
Jul 20 16:14:06.119746 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.119729    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2pcmq"
Jul 20 16:14:06.157194 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-etc-selinux\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.157266 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4568ea81625bffae5468887c260fd4b0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal\" (UID: \"4568ea81625bffae5468887c260fd4b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.157266 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-host\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.157266 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.157420 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4568ea81625bffae5468887c260fd4b0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal\" (UID: \"4568ea81625bffae5468887c260fd4b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.157420 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-run-ovn\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.157420 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-socket-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.157545 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-modprobe-d\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.157545 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157450    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.157545 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbkd\" (UniqueName: \"kubernetes.io/projected/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-kube-api-access-5pbkd\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.157545 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-run-openvswitch\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.157545 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-multus-conf-dir\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4066ff24-14d6-48f0-9ad7-475139d26a2b-tmp-dir\") pod \"node-resolver-kdfth\" (UID: \"4066ff24-14d6-48f0-9ad7-475139d26a2b\") " pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-cni-bin\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-kubernetes\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-system-cni-dir\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xhd\" (UniqueName: \"kubernetes.io/projected/e69cbc0e-45fb-4808-9627-379bb8cbf70c-kube-api-access-x6xhd\") pod \"iptables-alerter-9vjfs\" (UID: \"e69cbc0e-45fb-4808-9627-379bb8cbf70c\") " pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64760793-780a-46dd-83ac-76ca56fe3bfa-dbus\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/920b13dc-1b99-43d9-88ea-04439a42386e-agent-certs\") pod \"konnectivity-agent-n6642\" (UID: \"920b13dc-1b99-43d9-88ea-04439a42386e\") " pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-systemd\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:06.157733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-node-log\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-cni-netd\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmplh\" (UniqueName: \"kubernetes.io/projected/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-kube-api-access-jmplh\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-run-netns\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-var-lib-openvswitch\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-system-cni-dir\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-run-multus-certs\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4568ea81625bffae5468887c260fd4b0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal\" (UID: \"4568ea81625bffae5468887c260fd4b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-os-release\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afacfe63-56db-459b-8afd-b319a4718193-serviceca\") pod \"node-ca-wnlrc\" (UID: \"afacfe63-56db-459b-8afd-b319a4718193\") " pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-os-release\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4568ea81625bffae5468887c260fd4b0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal\" (UID: \"4568ea81625bffae5468887c260fd4b0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.157953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-var-lib-kubelet\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/920b13dc-1b99-43d9-88ea-04439a42386e-konnectivity-ca\") pod \"konnectivity-agent-n6642\" (UID: \"920b13dc-1b99-43d9-88ea-04439a42386e\") " pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:06.158044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-run-systemd\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4fc6\" (UniqueName: \"kubernetes.io/projected/ba8ce783-c4ed-4b18-9e65-256b74db9bae-kube-api-access-p4fc6\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-cnibin\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-var-lib-cni-bin\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158121    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fdz9\" (UniqueName: \"kubernetes.io/projected/4066ff24-14d6-48f0-9ad7-475139d26a2b-kube-api-access-8fdz9\") pod \"node-resolver-kdfth\" (UID: \"4066ff24-14d6-48f0-9ad7-475139d26a2b\") " pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-var-lib-kubelet\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-log-socket\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba8ce783-c4ed-4b18-9e65-256b74db9bae-ovnkube-config\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlshj\" (UniqueName: \"kubernetes.io/projected/ad2c1187-2e62-4948-b833-1928f46e625d-kube-api-access-nlshj\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4066ff24-14d6-48f0-9ad7-475139d26a2b-hosts-file\") pod \"node-resolver-kdfth\" (UID: \"4066ff24-14d6-48f0-9ad7-475139d26a2b\") " pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-sysctl-d\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-tuned\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-etc-kubernetes\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba8ce783-c4ed-4b18-9e65-256b74db9bae-env-overrides\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-sysconfig\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.158577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-run\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-tmp\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-slash\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158497    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-run-ovn-kubernetes\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158512    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0bc8024318ae1efb05d8dcf7cc6a8e0e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-221.ec2.internal\" (UID: \"0bc8024318ae1efb05d8dcf7cc6a8e0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64760793-780a-46dd-83ac-76ca56fe3bfa-kubelet-config\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e69cbc0e-45fb-4808-9627-379bb8cbf70c-iptables-alerter-script\") pod \"iptables-alerter-9vjfs\" (UID: \"e69cbc0e-45fb-4808-9627-379bb8cbf70c\") " pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-kubelet\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0bc8024318ae1efb05d8dcf7cc6a8e0e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-221.ec2.internal\" (UID: \"0bc8024318ae1efb05d8dcf7cc6a8e0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad2c1187-2e62-4948-b833-1928f46e625d-cni-binary-copy\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-sys-fs\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbgrv\" (UniqueName: \"kubernetes.io/projected/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-kube-api-access-cbgrv\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-cnibin\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-multus-cni-dir\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.159245 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-multus-socket-dir-parent\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-hostroot\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-sys\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-lib-modules\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-cni-binary-copy\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e69cbc0e-45fb-4808-9627-379bb8cbf70c-host-slash\") pod \"iptables-alerter-9vjfs\" (UID: \"e69cbc0e-45fb-4808-9627-379bb8cbf70c\") " pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba8ce783-c4ed-4b18-9e65-256b74db9bae-ovn-node-metrics-cert\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afacfe63-56db-459b-8afd-b319a4718193-host\") pod \"node-ca-wnlrc\" (UID: \"afacfe63-56db-459b-8afd-b319a4718193\") " pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndlwm\" (UniqueName: \"kubernetes.io/projected/afacfe63-56db-459b-8afd-b319a4718193-kube-api-access-ndlwm\") pod \"node-ca-wnlrc\" (UID: \"afacfe63-56db-459b-8afd-b319a4718193\") " pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-run-k8s-cni-cncf-io\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.158982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-systemd-units\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.159003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-etc-openvswitch\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.159018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba8ce783-c4ed-4b18-9e65-256b74db9bae-ovnkube-script-lib\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.159032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-run-netns\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.159045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-var-lib-cni-multus\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.159062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-device-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.159706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.159083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf72k\" (UniqueName: \"kubernetes.io/projected/ce46b833-1aed-4186-bb15-288b1909fe5a-kube-api-access-xf72k\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.160218 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.159097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-sysctl-conf\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.160218 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.159111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad2c1187-2e62-4948-b833-1928f46e625d-multus-daemon-config\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.160218 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.159126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-registration-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.261990 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.261935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-multus-cni-dir\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.261990 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.261964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-multus-socket-dir-parent\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.261990 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.261980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-hostroot\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.261994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-sys\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-lib-modules\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-multus-cni-dir\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-cni-binary-copy\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-multus-socket-dir-parent\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-hostroot\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-sys\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-lib-modules\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e69cbc0e-45fb-4808-9627-379bb8cbf70c-host-slash\") pod \"iptables-alerter-9vjfs\" (UID: \"e69cbc0e-45fb-4808-9627-379bb8cbf70c\") " pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba8ce783-c4ed-4b18-9e65-256b74db9bae-ovn-node-metrics-cert\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.262172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afacfe63-56db-459b-8afd-b319a4718193-host\") pod \"node-ca-wnlrc\" (UID: \"afacfe63-56db-459b-8afd-b319a4718193\") " pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndlwm\" (UniqueName: \"kubernetes.io/projected/afacfe63-56db-459b-8afd-b319a4718193-kube-api-access-ndlwm\") pod \"node-ca-wnlrc\" (UID: \"afacfe63-56db-459b-8afd-b319a4718193\") " pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e69cbc0e-45fb-4808-9627-379bb8cbf70c-host-slash\") pod \"iptables-alerter-9vjfs\" (UID: \"e69cbc0e-45fb-4808-9627-379bb8cbf70c\") " pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-run-k8s-cni-cncf-io\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262242    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-systemd-units\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afacfe63-56db-459b-8afd-b319a4718193-host\") pod \"node-ca-wnlrc\" (UID: \"afacfe63-56db-459b-8afd-b319a4718193\") " pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-systemd-units\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-run-k8s-cni-cncf-io\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-etc-openvswitch\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba8ce783-c4ed-4b18-9e65-256b74db9bae-ovnkube-script-lib\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-etc-openvswitch\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-run-netns\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-var-lib-cni-multus\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262443    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-run-netns\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-device-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf72k\" (UniqueName: \"kubernetes.io/projected/ce46b833-1aed-4186-bb15-288b1909fe5a-kube-api-access-xf72k\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-var-lib-cni-multus\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-sysctl-conf\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.262690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad2c1187-2e62-4948-b833-1928f46e625d-multus-daemon-config\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-registration-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-device-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-cni-binary-copy\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-registration-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-etc-selinux\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-host\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-sysctl-conf\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-run-ovn\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-socket-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-host\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-modprobe-d\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-etc-selinux\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262780    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262813    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-run-ovn\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.263546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-modprobe-d\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbkd\" (UniqueName: \"kubernetes.io/projected/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-kube-api-access-5pbkd\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-run-openvswitch\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-multus-conf-dir\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4066ff24-14d6-48f0-9ad7-475139d26a2b-tmp-dir\") pod \"node-resolver-kdfth\" (UID: \"4066ff24-14d6-48f0-9ad7-475139d26a2b\") " pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-cni-bin\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.262993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-kubernetes\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-system-cni-dir\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xhd\" (UniqueName: \"kubernetes.io/projected/e69cbc0e-45fb-4808-9627-379bb8cbf70c-kube-api-access-x6xhd\") pod \"iptables-alerter-9vjfs\" (UID: \"e69cbc0e-45fb-4808-9627-379bb8cbf70c\") " pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64760793-780a-46dd-83ac-76ca56fe3bfa-dbus\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/920b13dc-1b99-43d9-88ea-04439a42386e-agent-certs\") pod \"konnectivity-agent-n6642\" (UID: \"920b13dc-1b99-43d9-88ea-04439a42386e\") " pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba8ce783-c4ed-4b18-9e65-256b74db9bae-ovnkube-script-lib\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-systemd\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-node-log\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263197    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad2c1187-2e62-4948-b833-1928f46e625d-multus-daemon-config\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.264368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-node-log\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-multus-conf-dir\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64760793-780a-46dd-83ac-76ca56fe3bfa-dbus\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-run-openvswitch\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-system-cni-dir\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-systemd\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-cni-bin\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-cni-netd\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-kubernetes\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-socket-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4066ff24-14d6-48f0-9ad7-475139d26a2b-tmp-dir\") pod \"node-resolver-kdfth\" (UID: \"4066ff24-14d6-48f0-9ad7-475139d26a2b\") " pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-cni-netd\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmplh\" (UniqueName: \"kubernetes.io/projected/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-kube-api-access-jmplh\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-run-netns\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-var-lib-openvswitch\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-run-netns\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.265175 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-system-cni-dir\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-run-multus-certs\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-var-lib-openvswitch\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-system-cni-dir\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-os-release\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263716    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-run-multus-certs\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afacfe63-56db-459b-8afd-b319a4718193-serviceca\") pod \"node-ca-wnlrc\" (UID: \"afacfe63-56db-459b-8afd-b319a4718193\") " pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-os-release\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-var-lib-kubelet\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-os-release\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/920b13dc-1b99-43d9-88ea-04439a42386e-konnectivity-ca\") pod \"konnectivity-agent-n6642\" (UID: \"920b13dc-1b99-43d9-88ea-04439a42386e\") " pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-run-systemd\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263834    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-os-release\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.263785    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4fc6\" (UniqueName: \"kubernetes.io/projected/ba8ce783-c4ed-4b18-9e65-256b74db9bae-kube-api-access-p4fc6\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-cnibin\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266021 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.263914    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret podName:64760793-780a-46dd-83ac-76ca56fe3bfa nodeName:}" failed. No retries permitted until 2026-07-20 16:14:06.763894229 +0000 UTC m=+3.125594802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret") pod "global-pull-secret-syncer-bt6fv" (UID: "64760793-780a-46dd-83ac-76ca56fe3bfa") : object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-var-lib-cni-bin\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-cnibin\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263954    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fdz9\" (UniqueName: \"kubernetes.io/projected/4066ff24-14d6-48f0-9ad7-475139d26a2b-kube-api-access-8fdz9\") pod \"node-resolver-kdfth\" (UID: \"4066ff24-14d6-48f0-9ad7-475139d26a2b\") " pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.263981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-var-lib-kubelet\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-log-socket\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afacfe63-56db-459b-8afd-b319a4718193-serviceca\") pod \"node-ca-wnlrc\" (UID: \"afacfe63-56db-459b-8afd-b319a4718193\") " pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba8ce783-c4ed-4b18-9e65-256b74db9bae-ovnkube-config\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlshj\" (UniqueName: \"kubernetes.io/projected/ad2c1187-2e62-4948-b833-1928f46e625d-kube-api-access-nlshj\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4066ff24-14d6-48f0-9ad7-475139d26a2b-hosts-file\") pod \"node-resolver-kdfth\" (UID: \"4066ff24-14d6-48f0-9ad7-475139d26a2b\") " pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-var-lib-cni-bin\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-sysctl-d\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-var-lib-kubelet\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264252    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/920b13dc-1b99-43d9-88ea-04439a42386e-konnectivity-ca\") pod \"konnectivity-agent-n6642\" (UID: \"920b13dc-1b99-43d9-88ea-04439a42386e\") " pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-host-var-lib-kubelet\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264330    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-sysctl-d\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4066ff24-14d6-48f0-9ad7-475139d26a2b-hosts-file\") pod \"node-resolver-kdfth\" (UID: \"4066ff24-14d6-48f0-9ad7-475139d26a2b\") " pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.266954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-run-systemd\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264386    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-log-socket\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-tuned\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-etc-kubernetes\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba8ce783-c4ed-4b18-9e65-256b74db9bae-env-overrides\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad2c1187-2e62-4948-b833-1928f46e625d-etc-kubernetes\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-sysconfig\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-run\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-tmp\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-slash\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-run-ovn-kubernetes\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba8ce783-c4ed-4b18-9e65-256b74db9bae-ovnkube-config\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64760793-780a-46dd-83ac-76ca56fe3bfa-kubelet-config\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e69cbc0e-45fb-4808-9627-379bb8cbf70c-iptables-alerter-script\") pod \"iptables-alerter-9vjfs\" (UID: \"e69cbc0e-45fb-4808-9627-379bb8cbf70c\") " pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-run\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-kubelet\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.267608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-run-ovn-kubernetes\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264822    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264875    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-sysconfig\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-slash\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba8ce783-c4ed-4b18-9e65-256b74db9bae-env-overrides\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-kubelet\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad2c1187-2e62-4948-b833-1928f46e625d-cni-binary-copy\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.264957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-sys-fs\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.265013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64760793-780a-46dd-83ac-76ca56fe3bfa-kubelet-config\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.265008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce46b833-1aed-4186-bb15-288b1909fe5a-sys-fs\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.265038    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.265070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbgrv\" (UniqueName: \"kubernetes.io/projected/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-kube-api-access-cbgrv\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.265107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-cnibin\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.265163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-cnibin\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.265611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e69cbc0e-45fb-4808-9627-379bb8cbf70c-iptables-alerter-script\") pod \"iptables-alerter-9vjfs\" (UID: \"e69cbc0e-45fb-4808-9627-379bb8cbf70c\") " pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.265618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad2c1187-2e62-4948-b833-1928f46e625d-cni-binary-copy\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.268154 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.265677    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs podName:2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf nodeName:}" failed. No retries permitted until 2026-07-20 16:14:06.765112951 +0000 UTC m=+3.126813498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs") pod "network-metrics-daemon-7jn2r" (UID: "2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:06.268669 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.265718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.268669 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.265792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8ce783-c4ed-4b18-9e65-256b74db9bae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.268669 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.266761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba8ce783-c4ed-4b18-9e65-256b74db9bae-ovn-node-metrics-cert\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.268669 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.266952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/920b13dc-1b99-43d9-88ea-04439a42386e-agent-certs\") pod \"konnectivity-agent-n6642\" (UID: \"920b13dc-1b99-43d9-88ea-04439a42386e\") " pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:06.268669 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.267044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-etc-tuned\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.268669 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.267362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-tmp\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.276242 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.276221    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 16:14:06.276242 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.276246    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 16:14:06.276392 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.276260    2560 projected.go:196] Error preparing data for projected volume kube-api-access-58nlg for pod openshift-network-diagnostics/network-check-target-7xmcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:06.276392 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.276321    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg podName:96cbf732-9ff3-411f-9aa1-4032e45087d8 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:06.776301693 +0000 UTC m=+3.138002258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-58nlg" (UniqueName: "kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg") pod "network-check-target-7xmcd" (UID: "96cbf732-9ff3-411f-9aa1-4032e45087d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:06.277292 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.277247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndlwm\" (UniqueName: \"kubernetes.io/projected/afacfe63-56db-459b-8afd-b319a4718193-kube-api-access-ndlwm\") pod \"node-ca-wnlrc\" (UID: \"afacfe63-56db-459b-8afd-b319a4718193\") " pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.277292 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.277259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf72k\" (UniqueName: \"kubernetes.io/projected/ce46b833-1aed-4186-bb15-288b1909fe5a-kube-api-access-xf72k\") pod \"aws-ebs-csi-driver-node-9flzv\" (UID: \"ce46b833-1aed-4186-bb15-288b1909fe5a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.277505 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.277296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbkd\" (UniqueName: \"kubernetes.io/projected/53f3a4b7-e7b5-436b-bff2-ca53925f7c22-kube-api-access-5pbkd\") pod \"multus-additional-cni-plugins-grvgc\" (UID: \"53f3a4b7-e7b5-436b-bff2-ca53925f7c22\") " pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.279189 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.279165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlshj\" (UniqueName: \"kubernetes.io/projected/ad2c1187-2e62-4948-b833-1928f46e625d-kube-api-access-nlshj\") pod \"multus-4kb4h\" (UID: \"ad2c1187-2e62-4948-b833-1928f46e625d\") " pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.279285 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.279165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4fc6\" (UniqueName: \"kubernetes.io/projected/ba8ce783-c4ed-4b18-9e65-256b74db9bae-kube-api-access-p4fc6\") pod \"ovnkube-node-stvbt\" (UID: \"ba8ce783-c4ed-4b18-9e65-256b74db9bae\") " pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.279544 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.279525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fdz9\" (UniqueName: \"kubernetes.io/projected/4066ff24-14d6-48f0-9ad7-475139d26a2b-kube-api-access-8fdz9\") pod \"node-resolver-kdfth\" (UID: \"4066ff24-14d6-48f0-9ad7-475139d26a2b\") " pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.279655 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.279638    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xhd\" (UniqueName: \"kubernetes.io/projected/e69cbc0e-45fb-4808-9627-379bb8cbf70c-kube-api-access-x6xhd\") pod \"iptables-alerter-9vjfs\" (UID: \"e69cbc0e-45fb-4808-9627-379bb8cbf70c\") " pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.279854 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.279836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbgrv\" (UniqueName: \"kubernetes.io/projected/4c7c11ee-8978-42ef-9f4f-0203371b5cfe-kube-api-access-cbgrv\") pod \"tuned-ch2bq\" (UID: \"4c7c11ee-8978-42ef-9f4f-0203371b5cfe\") " pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.280024 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.280009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmplh\" (UniqueName: \"kubernetes.io/projected/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-kube-api-access-jmplh\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:06.283993 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.283978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.286093 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.286076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal"
Jul 20 16:14:06.314573 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.314377    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ch2bq"
Jul 20 16:14:06.330244 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.330221    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wnlrc"
Jul 20 16:14:06.348201 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.348183    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4kb4h"
Jul 20 16:14:06.353783 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.353760    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grvgc"
Jul 20 16:14:06.383275 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.383254    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv"
Jul 20 16:14:06.396659 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.396638    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kdfth"
Jul 20 16:14:06.403737 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.403722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9vjfs"
Jul 20 16:14:06.428314 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.428295    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:06.433122 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.433107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:06.772832 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.772810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:06.772941 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.772854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:06.773014 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.772949    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:06.773014 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.773001    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret podName:64760793-780a-46dd-83ac-76ca56fe3bfa nodeName:}" failed. No retries permitted until 2026-07-20 16:14:07.772987229 +0000 UTC m=+4.134687773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret") pod "global-pull-secret-syncer-bt6fv" (UID: "64760793-780a-46dd-83ac-76ca56fe3bfa") : object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:06.773134 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.773041    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:06.773134 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.773115    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs podName:2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf nodeName:}" failed. No retries permitted until 2026-07-20 16:14:07.77309793 +0000 UTC m=+4.134798476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs") pod "network-metrics-daemon-7jn2r" (UID: "2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:06.873196 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.873168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:06.873415 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.873344    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 16:14:06.873415 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.873361    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 16:14:06.873415 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.873371    2560 projected.go:196] Error preparing data for projected volume kube-api-access-58nlg for pod openshift-network-diagnostics/network-check-target-7xmcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:06.873519 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:06.873424    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg podName:96cbf732-9ff3-411f-9aa1-4032e45087d8 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:07.873409749 +0000 UTC m=+4.235110292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-58nlg" (UniqueName: "kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg") pod "network-check-target-7xmcd" (UID: "96cbf732-9ff3-411f-9aa1-4032e45087d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:06.955053 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:06.955017    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafacfe63_56db_459b_8afd_b319a4718193.slice/crio-499bf024ff4d25894f676515752702fe4138b6f6b82212794f7493ef4aa034b5 WatchSource:0}: Error finding container 499bf024ff4d25894f676515752702fe4138b6f6b82212794f7493ef4aa034b5: Status 404 returned error can't find the container with id 499bf024ff4d25894f676515752702fe4138b6f6b82212794f7493ef4aa034b5
Jul 20 16:14:06.955615 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:06.955588    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc8024318ae1efb05d8dcf7cc6a8e0e.slice/crio-833aa682e0c72c87be879e7b76d8c9a54614283c5dc790fe05e46467a3e7a2f6 WatchSource:0}: Error finding container 833aa682e0c72c87be879e7b76d8c9a54614283c5dc790fe05e46467a3e7a2f6: Status 404 returned error can't find the container with id 833aa682e0c72c87be879e7b76d8c9a54614283c5dc790fe05e46467a3e7a2f6
Jul 20 16:14:06.956381 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:06.956357    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69cbc0e_45fb_4808_9627_379bb8cbf70c.slice/crio-5e2751cf4fa605d82621261f697031d2670d9096a993021a40efe2a0b6fc71be WatchSource:0}: Error finding container 5e2751cf4fa605d82621261f697031d2670d9096a993021a40efe2a0b6fc71be: Status 404 returned error can't find the container with id 5e2751cf4fa605d82621261f697031d2670d9096a993021a40efe2a0b6fc71be
Jul 20 16:14:06.957156 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:06.957137    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2c1187_2e62_4948_b833_1928f46e625d.slice/crio-2ea1f879c23dcc5e50c7658586c223e88bd6f44d06f6114ad4c16080ce73747b WatchSource:0}: Error finding container 2ea1f879c23dcc5e50c7658586c223e88bd6f44d06f6114ad4c16080ce73747b: Status 404 returned error can't find the container with id 2ea1f879c23dcc5e50c7658586c223e88bd6f44d06f6114ad4c16080ce73747b
Jul 20 16:14:06.963037 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:06.963024    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 16:14:06.994173 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:06.994097    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920b13dc_1b99_43d9_88ea_04439a42386e.slice/crio-fb0ae927d920a61bc48a5e5345d8f9b0c8b3b11e27d420e82e564d7b434e3999 WatchSource:0}: Error finding container fb0ae927d920a61bc48a5e5345d8f9b0c8b3b11e27d420e82e564d7b434e3999: Status 404 returned error can't find the container with id fb0ae927d920a61bc48a5e5345d8f9b0c8b3b11e27d420e82e564d7b434e3999
Jul 20 16:14:06.994359 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:06.994337    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7c11ee_8978_42ef_9f4f_0203371b5cfe.slice/crio-2421f18c80ae750e0eadde8aefa9bdafedb8b5734ea99fc18fcffd2dbc13346b WatchSource:0}: Error finding container 2421f18c80ae750e0eadde8aefa9bdafedb8b5734ea99fc18fcffd2dbc13346b: Status 404 returned error can't find the container with id 2421f18c80ae750e0eadde8aefa9bdafedb8b5734ea99fc18fcffd2dbc13346b
Jul 20 16:14:07.020512 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:07.020492    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4066ff24_14d6_48f0_9ad7_475139d26a2b.slice/crio-28b436b5e22eb19b0bb59382c3685e70bf61286a25015c4dd5301edf6e2f1058 WatchSource:0}: Error finding container 28b436b5e22eb19b0bb59382c3685e70bf61286a25015c4dd5301edf6e2f1058: Status 404 returned error can't find the container with id 28b436b5e22eb19b0bb59382c3685e70bf61286a25015c4dd5301edf6e2f1058
Jul 20 16:14:07.049313 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:07.049294    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f3a4b7_e7b5_436b_bff2_ca53925f7c22.slice/crio-72d8c04fd920efd19623c3b45ba77bc495c57bd4d8e971e6312106966429b81c WatchSource:0}: Error finding container 72d8c04fd920efd19623c3b45ba77bc495c57bd4d8e971e6312106966429b81c: Status 404 returned error can't find the container with id 72d8c04fd920efd19623c3b45ba77bc495c57bd4d8e971e6312106966429b81c
Jul 20 16:14:07.059532 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:07.059512    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4568ea81625bffae5468887c260fd4b0.slice/crio-2c7533060e28434f213564774c927a6eebb267bf43cbb51a6d03c283c408491e WatchSource:0}: Error finding container 2c7533060e28434f213564774c927a6eebb267bf43cbb51a6d03c283c408491e: Status 404 returned error can't find the container with id 2c7533060e28434f213564774c927a6eebb267bf43cbb51a6d03c283c408491e
Jul 20 16:14:07.121983 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.121936    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:09:06 +0000 UTC" deadline="2028-01-31 10:33:31.802812473 +0000 UTC"
Jul 20 16:14:07.121983 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.121977    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13434h19m24.680838156s"
Jul 20 16:14:07.336764 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:07.336746    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce46b833_1aed_4186_bb15_288b1909fe5a.slice/crio-62ab6ad996f76125882767ebe6234321b97aea9d418280abe0e72761b199617a WatchSource:0}: Error finding container 62ab6ad996f76125882767ebe6234321b97aea9d418280abe0e72761b199617a: Status 404 returned error can't find the container with id 62ab6ad996f76125882767ebe6234321b97aea9d418280abe0e72761b199617a
Jul 20 16:14:07.601358 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:07.601325    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8ce783_c4ed_4b18_9e65_256b74db9bae.slice/crio-69a3fac3402460af0b2a2cde2b0091ae7f8ae3395c3ac1630d5aa56930048849 WatchSource:0}: Error finding container 69a3fac3402460af0b2a2cde2b0091ae7f8ae3395c3ac1630d5aa56930048849: Status 404 returned error can't find the container with id 69a3fac3402460af0b2a2cde2b0091ae7f8ae3395c3ac1630d5aa56930048849
Jul 20 16:14:07.779097 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.779059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:07.779346 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.779121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:07.779346 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.779248    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:07.779346 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.779289    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:07.779346 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.779322    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret podName:64760793-780a-46dd-83ac-76ca56fe3bfa nodeName:}" failed. No retries permitted until 2026-07-20 16:14:09.77929992 +0000 UTC m=+6.141000465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret") pod "global-pull-secret-syncer-bt6fv" (UID: "64760793-780a-46dd-83ac-76ca56fe3bfa") : object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:07.779346 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.779344    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs podName:2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf nodeName:}" failed. No retries permitted until 2026-07-20 16:14:09.77932863 +0000 UTC m=+6.141029189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs") pod "network-metrics-daemon-7jn2r" (UID: "2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:07.847889 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.845504    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:07.847889 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.845624    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:07.847889 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.845637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:07.847889 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.845741    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:07.847889 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.845801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:07.847889 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.845883    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:07.853255 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.853159    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ch2bq" event={"ID":"4c7c11ee-8978-42ef-9f4f-0203371b5cfe","Type":"ContainerStarted","Data":"2421f18c80ae750e0eadde8aefa9bdafedb8b5734ea99fc18fcffd2dbc13346b"}
Jul 20 16:14:07.854976 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.854952    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n6642" event={"ID":"920b13dc-1b99-43d9-88ea-04439a42386e","Type":"ContainerStarted","Data":"fb0ae927d920a61bc48a5e5345d8f9b0c8b3b11e27d420e82e564d7b434e3999"}
Jul 20 16:14:07.858112 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.858087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9vjfs" event={"ID":"e69cbc0e-45fb-4808-9627-379bb8cbf70c","Type":"ContainerStarted","Data":"5e2751cf4fa605d82621261f697031d2670d9096a993021a40efe2a0b6fc71be"}
Jul 20 16:14:07.862339 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.862316    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 16:14:07.863399 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.863371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" event={"ID":"ba8ce783-c4ed-4b18-9e65-256b74db9bae","Type":"ContainerStarted","Data":"69a3fac3402460af0b2a2cde2b0091ae7f8ae3395c3ac1630d5aa56930048849"}
Jul 20 16:14:07.866508 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.866487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv" event={"ID":"ce46b833-1aed-4186-bb15-288b1909fe5a","Type":"ContainerStarted","Data":"62ab6ad996f76125882767ebe6234321b97aea9d418280abe0e72761b199617a"}
Jul 20 16:14:07.868357 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.868334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal" event={"ID":"4568ea81625bffae5468887c260fd4b0","Type":"ContainerStarted","Data":"2c7533060e28434f213564774c927a6eebb267bf43cbb51a6d03c283c408491e"}
Jul 20 16:14:07.872617 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.872590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvgc" event={"ID":"53f3a4b7-e7b5-436b-bff2-ca53925f7c22","Type":"ContainerStarted","Data":"72d8c04fd920efd19623c3b45ba77bc495c57bd4d8e971e6312106966429b81c"}
Jul 20 16:14:07.876127 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.876045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4kb4h" event={"ID":"ad2c1187-2e62-4948-b833-1928f46e625d","Type":"ContainerStarted","Data":"2ea1f879c23dcc5e50c7658586c223e88bd6f44d06f6114ad4c16080ce73747b"}
Jul 20 16:14:07.881073 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.880497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:07.881073 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.880693    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 16:14:07.881073 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.880714    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 16:14:07.881073 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.880728    2560 projected.go:196] Error preparing data for projected volume kube-api-access-58nlg for pod openshift-network-diagnostics/network-check-target-7xmcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:07.881073 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:07.880780    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg podName:96cbf732-9ff3-411f-9aa1-4032e45087d8 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:09.88076078 +0000 UTC m=+6.242461323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-58nlg" (UniqueName: "kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg") pod "network-check-target-7xmcd" (UID: "96cbf732-9ff3-411f-9aa1-4032e45087d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:07.883261 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.883168    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal" event={"ID":"0bc8024318ae1efb05d8dcf7cc6a8e0e","Type":"ContainerStarted","Data":"833aa682e0c72c87be879e7b76d8c9a54614283c5dc790fe05e46467a3e7a2f6"}
Jul 20 16:14:07.886601 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.886484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wnlrc" event={"ID":"afacfe63-56db-459b-8afd-b319a4718193","Type":"ContainerStarted","Data":"499bf024ff4d25894f676515752702fe4138b6f6b82212794f7493ef4aa034b5"}
Jul 20 16:14:07.889708 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:07.889673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kdfth" event={"ID":"4066ff24-14d6-48f0-9ad7-475139d26a2b","Type":"ContainerStarted","Data":"28b436b5e22eb19b0bb59382c3685e70bf61286a25015c4dd5301edf6e2f1058"}
Jul 20 16:14:08.122695 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:08.122612    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:09:06 +0000 UTC" deadline="2028-03-31 02:24:42.347937744 +0000 UTC"
Jul 20 16:14:08.122695 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:08.122650    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14866h10m34.225290987s"
Jul 20 16:14:09.796275 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:09.796237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:09.796873 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:09.796331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:09.796873 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.796456    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:09.796873 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.796520    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret podName:64760793-780a-46dd-83ac-76ca56fe3bfa nodeName:}" failed. No retries permitted until 2026-07-20 16:14:13.796501036 +0000 UTC m=+10.158201581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret") pod "global-pull-secret-syncer-bt6fv" (UID: "64760793-780a-46dd-83ac-76ca56fe3bfa") : object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:09.796873 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.796588    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:09.796873 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.796622    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs podName:2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf nodeName:}" failed. No retries permitted until 2026-07-20 16:14:13.796609547 +0000 UTC m=+10.158310105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs") pod "network-metrics-daemon-7jn2r" (UID: "2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:09.847616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:09.846943    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:09.847616 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.847063    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:09.847616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:09.847280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:09.847616 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.847380    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:09.847616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:09.847434    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:09.847616 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.847519    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:09.897394 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:09.897358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:09.897560 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.897513    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 16:14:09.897560 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.897535    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 16:14:09.897560 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.897547    2560 projected.go:196] Error preparing data for projected volume kube-api-access-58nlg for pod openshift-network-diagnostics/network-check-target-7xmcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:09.897726 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:09.897600    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg podName:96cbf732-9ff3-411f-9aa1-4032e45087d8 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:13.8975814 +0000 UTC m=+10.259281967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-58nlg" (UniqueName: "kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg") pod "network-check-target-7xmcd" (UID: "96cbf732-9ff3-411f-9aa1-4032e45087d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:11.850127 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:11.849331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:11.850127 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:11.849330    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:11.850127 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:11.849473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:11.850127 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:11.849469    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:11.850127 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:11.849609    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:11.850127 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:11.849718    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:13.823482 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:13.822890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:13.823482 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:13.822947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:13.823482 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.823068    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:13.823482 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.823103    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:13.823482 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.823128    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs podName:2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf nodeName:}" failed. No retries permitted until 2026-07-20 16:14:21.823108844 +0000 UTC m=+18.184809389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs") pod "network-metrics-daemon-7jn2r" (UID: "2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:13.823482 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.823168    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret podName:64760793-780a-46dd-83ac-76ca56fe3bfa nodeName:}" failed. No retries permitted until 2026-07-20 16:14:21.823148674 +0000 UTC m=+18.184849217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret") pod "global-pull-secret-syncer-bt6fv" (UID: "64760793-780a-46dd-83ac-76ca56fe3bfa") : object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:13.845009 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:13.844981    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:13.845156 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.845107    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:13.845302 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:13.845280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:13.845427 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.845404    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:13.845522 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:13.845494    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:13.845645 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.845599    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:13.924286 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:13.924171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:13.924460 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.924322    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 16:14:13.924460 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.924349    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 16:14:13.924460 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.924362    2560 projected.go:196] Error preparing data for projected volume kube-api-access-58nlg for pod openshift-network-diagnostics/network-check-target-7xmcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:13.924460 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:13.924425    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg podName:96cbf732-9ff3-411f-9aa1-4032e45087d8 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:21.924405103 +0000 UTC m=+18.286105669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-58nlg" (UniqueName: "kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg") pod "network-check-target-7xmcd" (UID: "96cbf732-9ff3-411f-9aa1-4032e45087d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:15.846995 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:15.846490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:15.846995 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:15.846610    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:15.846995 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:15.846795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:15.846995 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:15.846898    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:15.847616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:15.847035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:15.847616 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:15.847109    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:17.844633 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:17.844565    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:17.845237 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:17.844713    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:17.845237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:17.844565    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:17.845237 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:17.844838    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:17.845237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:17.844890    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:17.845237 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:17.844964    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:19.845607 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:19.845573    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:19.846023 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:19.845581    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:19.846023 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:19.845687    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:19.846023 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:19.845801    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:19.846023 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:19.845870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:19.846023 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:19.845982    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:21.844700 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:21.844656    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:21.845117 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:21.844661    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:21.845117 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.844788    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:21.845117 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.844906    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:21.845117 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:21.844931    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:21.845117 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.845016    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:21.887538 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:21.887514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:21.887673 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:21.887598    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:21.887673 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.887653    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:21.887765 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.887698    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:21.887765 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.887710    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs podName:2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf nodeName:}" failed. No retries permitted until 2026-07-20 16:14:37.887690495 +0000 UTC m=+34.249391036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs") pod "network-metrics-daemon-7jn2r" (UID: "2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:21.887765 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.887744    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret podName:64760793-780a-46dd-83ac-76ca56fe3bfa nodeName:}" failed. No retries permitted until 2026-07-20 16:14:37.887728757 +0000 UTC m=+34.249429312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret") pod "global-pull-secret-syncer-bt6fv" (UID: "64760793-780a-46dd-83ac-76ca56fe3bfa") : object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:21.988743 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:21.988710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:21.988895 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.988877    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 16:14:21.988950 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.988903    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 16:14:21.988950 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.988918    2560 projected.go:196] Error preparing data for projected volume kube-api-access-58nlg for pod openshift-network-diagnostics/network-check-target-7xmcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:21.989033 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:21.988962    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg podName:96cbf732-9ff3-411f-9aa1-4032e45087d8 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:37.988948241 +0000 UTC m=+34.350648786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-58nlg" (UniqueName: "kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg") pod "network-check-target-7xmcd" (UID: "96cbf732-9ff3-411f-9aa1-4032e45087d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:23.844706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:23.844673    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:23.845176 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:23.844713    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:23.845176 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:23.844686    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:23.845176 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:23.844793    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:23.845176 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:23.844896    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:23.845176 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:23.844983    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:25.846055 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:25.846022    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:25.846486 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:25.846158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:25.846486 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:25.846265    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:25.846486 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:25.846151    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:25.846486 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:25.846342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:25.846486 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:25.846441    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:26.954968 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:26.954588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4kb4h" event={"ID":"ad2c1187-2e62-4948-b833-1928f46e625d","Type":"ContainerStarted","Data":"097970b8cad880005358cf2f360cee5a1be7f27976e59c3a9274938c9e4e63cc"}
Jul 20 16:14:26.963736 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:26.963338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal" event={"ID":"0bc8024318ae1efb05d8dcf7cc6a8e0e","Type":"ContainerStarted","Data":"ab6b1694ebac051181dfadefc4bf87aba10810342c184e100200e9455c8f53c4"}
Jul 20 16:14:26.966202 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:26.966106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ch2bq" event={"ID":"4c7c11ee-8978-42ef-9f4f-0203371b5cfe","Type":"ContainerStarted","Data":"b17a8c5323ecc60fdb71e9570d1541e7ee3ca1b33ea06c4ecd5f1fb2d0e41c6e"}
Jul 20 16:14:26.970465 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:26.970424    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4kb4h" podStartSLOduration=1.091605121 podStartE2EDuration="20.970409988s" totalImagesPullingTime="19.878804867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:26.969784745 +0000 UTC m=+23.331485317" watchObservedRunningTime="2026-07-20 16:14:26.970409988 +0000 UTC m=+23.332110552"
Jul 20 16:14:26.982701 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:26.982664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" event={"ID":"ba8ce783-c4ed-4b18-9e65-256b74db9bae","Type":"ContainerStarted","Data":"0296e04dc17ca44928dbe2816409cebae426ccff3381ae1e349765ec6bc50676"}
Jul 20 16:14:26.985651 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:26.985614    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ch2bq" podStartSLOduration=1.283811165 podStartE2EDuration="20.985599276s" totalImagesPullingTime="19.701788111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:26.985456993 +0000 UTC m=+23.347157556" watchObservedRunningTime="2026-07-20 16:14:26.985599276 +0000 UTC m=+23.347299838"
Jul 20 16:14:26.999849 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:26.999799    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-221.ec2.internal" podStartSLOduration=20.999759714 podStartE2EDuration="20.999759714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:26.999603289 +0000 UTC m=+23.361303850" watchObservedRunningTime="2026-07-20 16:14:26.999759714 +0000 UTC m=+23.361460277"
Jul 20 16:14:27.844993 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.844840    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:27.845149 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.844840    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:27.845218 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.844907    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:27.845218 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:27.845204    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:27.845308 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:27.845275    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:27.845308 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:27.845101    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:27.986080 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.986048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n6642" event={"ID":"920b13dc-1b99-43d9-88ea-04439a42386e","Type":"ContainerStarted","Data":"28a52bb15a71f8c9ab39e703f7a51c50ae2a2ea348a2ac056e655d39438d4738"}
Jul 20 16:14:27.988872 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.988847    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" event={"ID":"ba8ce783-c4ed-4b18-9e65-256b74db9bae","Type":"ContainerStarted","Data":"b762e456cee9af2b716d9c0fecd664bec86f1eb55a44fcd44219342342ada761"}
Jul 20 16:14:27.989007 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.988923    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" event={"ID":"ba8ce783-c4ed-4b18-9e65-256b74db9bae","Type":"ContainerStarted","Data":"56b5c2e22a5930bddcc1645da9b9399fe18fe64087d44a1c72aafd3352d1cb27"}
Jul 20 16:14:27.989007 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.988971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" event={"ID":"ba8ce783-c4ed-4b18-9e65-256b74db9bae","Type":"ContainerStarted","Data":"d29a63d61f09adbde820e03d7cf91c89c39e5748a01647749eb67edf4aa00511"}
Jul 20 16:14:27.989164 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.989021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" event={"ID":"ba8ce783-c4ed-4b18-9e65-256b74db9bae","Type":"ContainerStarted","Data":"66011fd36923045c70a9b454eec8b7ba874eb231075050c8b072fcfaa3967410"}
Jul 20 16:14:27.989164 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.989065    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" event={"ID":"ba8ce783-c4ed-4b18-9e65-256b74db9bae","Type":"ContainerStarted","Data":"77e9b6e2b834b3cf2cc5bf7558b9aa2703a11c92596b2516be2d168faaa3253b"}
Jul 20 16:14:27.990338 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.990312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv" event={"ID":"ce46b833-1aed-4186-bb15-288b1909fe5a","Type":"ContainerStarted","Data":"cdfed6596b7a2bf73b3a0ce0eb7e2aa0ebdea4317d385658b1193d6c46ca7c91"}
Jul 20 16:14:27.991575 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.991554    2560 generic.go:356] "Generic (PLEG): container finished" podID="4568ea81625bffae5468887c260fd4b0" containerID="f2753499b3ca74cfb7701a07f384e6e43b0f0291ad535cc4fa52526b9938b0d7" exitCode=0
Jul 20 16:14:27.991677 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.991619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal" event={"ID":"4568ea81625bffae5468887c260fd4b0","Type":"ContainerDied","Data":"f2753499b3ca74cfb7701a07f384e6e43b0f0291ad535cc4fa52526b9938b0d7"}
Jul 20 16:14:27.993033 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.993014    2560 generic.go:356] "Generic (PLEG): container finished" podID="53f3a4b7-e7b5-436b-bff2-ca53925f7c22" containerID="6188928ac3a64382c947abb081f7c23bdccb2d2e3cf422d8f00b19b3ecb567d1" exitCode=0
Jul 20 16:14:27.993112 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.993076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvgc" event={"ID":"53f3a4b7-e7b5-436b-bff2-ca53925f7c22","Type":"ContainerDied","Data":"6188928ac3a64382c947abb081f7c23bdccb2d2e3cf422d8f00b19b3ecb567d1"}
Jul 20 16:14:27.994412 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.994390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wnlrc" event={"ID":"afacfe63-56db-459b-8afd-b319a4718193","Type":"ContainerStarted","Data":"d1a56ce8940bebcb69c7b0c61c636b78bd70d4de1696f1d1edd53501f9e6845a"}
Jul 20 16:14:27.995673 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.995637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kdfth" event={"ID":"4066ff24-14d6-48f0-9ad7-475139d26a2b","Type":"ContainerStarted","Data":"f2198af5b07f3e2409e105f6744eb391359d55a8f94ba0cbda205711f8832b8d"}
Jul 20 16:14:27.999212 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:27.999142    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n6642" podStartSLOduration=2.298026675 podStartE2EDuration="21.999111592s" totalImagesPullingTime="19.701084917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:27.998731526 +0000 UTC m=+24.360432088" watchObservedRunningTime="2026-07-20 16:14:27.999111592 +0000 UTC m=+24.360812154"
Jul 20 16:14:28.028448 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:28.028415    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kdfth" podStartSLOduration=2.35317253 podStartE2EDuration="22.02840416s" totalImagesPullingTime="19.67523163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:28.02825876 +0000 UTC m=+24.389959322" watchObservedRunningTime="2026-07-20 16:14:28.02840416 +0000 UTC m=+24.390104722"
Jul 20 16:14:28.617243 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:28.617093    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 16:14:29.000002 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:28.999937    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv" event={"ID":"ce46b833-1aed-4186-bb15-288b1909fe5a","Type":"ContainerStarted","Data":"b327ab4d08a74bcb207ec6c0b7cf33a65038a0544010b9f5e0d46a6903f4a50d"}
Jul 20 16:14:29.001830 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.001804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal" event={"ID":"4568ea81625bffae5468887c260fd4b0","Type":"ContainerStarted","Data":"5ec96baf1f8de6c5a19c65b177e6eb180ec3f7460e0491a37442327636303dd7"}
Jul 20 16:14:29.002993 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.002974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9vjfs" event={"ID":"e69cbc0e-45fb-4808-9627-379bb8cbf70c","Type":"ContainerStarted","Data":"7acb1a3b3deaf4f236b45aaab84169ac3251364b9cc53685d6be267d49428d76"}
Jul 20 16:14:29.015138 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.015093    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-221.ec2.internal" podStartSLOduration=23.015081893 podStartE2EDuration="23.015081893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:29.015079061 +0000 UTC m=+25.376779623" watchObservedRunningTime="2026-07-20 16:14:29.015081893 +0000 UTC m=+25.376782454"
Jul 20 16:14:29.015313 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.015287    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wnlrc" podStartSLOduration=3.283509097 podStartE2EDuration="23.015282182s" totalImagesPullingTime="19.731773085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:28.053571308 +0000 UTC m=+24.415271870" watchObservedRunningTime="2026-07-20 16:14:29.015282182 +0000 UTC m=+25.376982743"
Jul 20 16:14:29.027041 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.027009    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9vjfs" podStartSLOduration=3.293894763 podStartE2EDuration="23.027002072s" totalImagesPullingTime="19.733107309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:29.026852283 +0000 UTC m=+25.388552844" watchObservedRunningTime="2026-07-20 16:14:29.027002072 +0000 UTC m=+25.388702658"
Jul 20 16:14:29.480185 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.480021    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T16:14:28.617239733Z","UUID":"ebf6b9e4-62e8-4653-83cc-ed7d9567bbd9","Handler":null,"Name":"","Endpoint":""}
Jul 20 16:14:29.481779 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.481746    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 16:14:29.481906 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.481801    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 16:14:29.844954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.844896    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:29.845074 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.844905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:29.845074 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:29.845004    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:29.845218 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:29.844905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:29.845218 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:29.845064    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:29.845218 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:29.845192    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:30.007805 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:30.007773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" event={"ID":"ba8ce783-c4ed-4b18-9e65-256b74db9bae","Type":"ContainerStarted","Data":"3a5b4ab0a7a99ef1011b137c82da08f2c40d221903a2767554634214061c6d69"}
Jul 20 16:14:30.009654 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:30.009635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv" event={"ID":"ce46b833-1aed-4186-bb15-288b1909fe5a","Type":"ContainerStarted","Data":"5f3f1fdf49551ee52cfdef59ce1e3a31aacc1faf65182cae5ddac85952ba56e0"}
Jul 20 16:14:30.033209 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:30.033164    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9flzv" podStartSLOduration=10.16291523 podStartE2EDuration="24.033149068s" totalImagesPullingTime="13.870233838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:30.032606191 +0000 UTC m=+26.394306752" watchObservedRunningTime="2026-07-20 16:14:30.033149068 +0000 UTC m=+26.394849629"
Jul 20 16:14:31.592875 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:31.592839    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:31.845148 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:31.845064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:31.845148 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:31.845080    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:31.845344 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:31.845202    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:31.845344 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:31.845251    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:31.845344 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:31.845284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:31.845505 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:31.845391    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:31.864007 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:31.863981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:31.864499 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:31.864484    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:32.013718 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:32.013689    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n6642"
Jul 20 16:14:33.018781 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:33.018588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" event={"ID":"ba8ce783-c4ed-4b18-9e65-256b74db9bae","Type":"ContainerStarted","Data":"91157f49237ab6c283df3c6861a6746f47a560bded659397ce400b5c9fe7a5c2"}
Jul 20 16:14:33.044526 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:33.044489    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt" podStartSLOduration=7.907511521 podStartE2EDuration="27.044474707s" totalImagesPullingTime="19.136963186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:33.042868618 +0000 UTC m=+29.404569204" watchObservedRunningTime="2026-07-20 16:14:33.044474707 +0000 UTC m=+29.406175269"
Jul 20 16:14:33.567133 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:33.567111    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kdfth_4066ff24-14d6-48f0-9ad7-475139d26a2b/dns-node-resolver/0.log"
Jul 20 16:14:33.845475 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:33.845427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:33.845577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:33.845428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:33.845577 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:33.845513    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:33.845647 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:33.845583    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:33.845647 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:33.845625    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:33.845706 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:33.845682    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:34.023369 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.023334    2560 generic.go:356] "Generic (PLEG): container finished" podID="53f3a4b7-e7b5-436b-bff2-ca53925f7c22" containerID="2bb48ad8e489b9f7aec2042b0c7f1bbedc1418cf0ed279e490e055eb2bc6ee09" exitCode=0
Jul 20 16:14:34.023998 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.023386    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvgc" event={"ID":"53f3a4b7-e7b5-436b-bff2-ca53925f7c22","Type":"ContainerDied","Data":"2bb48ad8e489b9f7aec2042b0c7f1bbedc1418cf0ed279e490e055eb2bc6ee09"}
Jul 20 16:14:34.024070 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.024028    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:34.024466 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.024093    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:34.024466 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.024156    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:34.050144 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.047361    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:34.050144 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.049529    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:14:34.549161 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.549114    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wnlrc_afacfe63-56db-459b-8afd-b319a4718193/node-ca/0.log"
Jul 20 16:14:34.962830 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.962659    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7xmcd"]
Jul 20 16:14:34.962964 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.962930    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:34.963060 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:34.963038    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:34.963442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.963424    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7jn2r"]
Jul 20 16:14:34.963541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.963517    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:34.963637 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:34.963620    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:34.964039 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.964018    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bt6fv"]
Jul 20 16:14:34.964119 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:34.964097    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:34.964211 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:34.964196    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:35.027120 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:35.027091    2560 generic.go:356] "Generic (PLEG): container finished" podID="53f3a4b7-e7b5-436b-bff2-ca53925f7c22" containerID="e1107ea40058194555d895d9a1dd2f795d73371d41f64056a8c246b1edeb6b05" exitCode=0
Jul 20 16:14:35.027682 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:35.027157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvgc" event={"ID":"53f3a4b7-e7b5-436b-bff2-ca53925f7c22","Type":"ContainerDied","Data":"e1107ea40058194555d895d9a1dd2f795d73371d41f64056a8c246b1edeb6b05"}
Jul 20 16:14:36.031769 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:36.031741    2560 generic.go:356] "Generic (PLEG): container finished" podID="53f3a4b7-e7b5-436b-bff2-ca53925f7c22" containerID="a8e4d2e0d417ebc56ac664e0a8d496f335432c2a19988c14f9bd34121b85906b" exitCode=0
Jul 20 16:14:36.032123 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:36.031807    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvgc" event={"ID":"53f3a4b7-e7b5-436b-bff2-ca53925f7c22","Type":"ContainerDied","Data":"a8e4d2e0d417ebc56ac664e0a8d496f335432c2a19988c14f9bd34121b85906b"}
Jul 20 16:14:36.845397 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:36.845288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:36.845397 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:36.845320    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:36.845397 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:36.845319    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:36.845647 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:36.845399    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:36.845647 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:36.845502    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:36.845647 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:36.845597    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:37.917137 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:37.917092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:37.917506 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:37.917174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:37.917506 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:37.917228    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:37.917506 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:37.917255    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:37.917506 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:37.917284    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs podName:2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf nodeName:}" failed. No retries permitted until 2026-07-20 16:15:09.917268372 +0000 UTC m=+66.278968912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs") pod "network-metrics-daemon-7jn2r" (UID: "2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 16:14:37.917506 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:37.917297    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret podName:64760793-780a-46dd-83ac-76ca56fe3bfa nodeName:}" failed. No retries permitted until 2026-07-20 16:15:09.917290907 +0000 UTC m=+66.278991447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret") pod "global-pull-secret-syncer-bt6fv" (UID: "64760793-780a-46dd-83ac-76ca56fe3bfa") : object "kube-system"/"original-pull-secret" not registered
Jul 20 16:14:38.018018 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:38.017989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:38.018172 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:38.018154    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 16:14:38.018227 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:38.018175    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 16:14:38.018227 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:38.018185    2560 projected.go:196] Error preparing data for projected volume kube-api-access-58nlg for pod openshift-network-diagnostics/network-check-target-7xmcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:38.018304 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:38.018230    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg podName:96cbf732-9ff3-411f-9aa1-4032e45087d8 nodeName:}" failed. No retries permitted until 2026-07-20 16:15:10.018213027 +0000 UTC m=+66.379913568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-58nlg" (UniqueName: "kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg") pod "network-check-target-7xmcd" (UID: "96cbf732-9ff3-411f-9aa1-4032e45087d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 16:14:38.845284 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:38.845247    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:38.845430 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:38.845332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:38.845430 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:38.845336    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:38.845430 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:38.845418    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:38.845532 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:38.845429    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:38.845532 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:38.845493    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:40.844894 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:40.844860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:40.845439 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:40.844970    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:40.845439 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:40.844980    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:40.845439 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:40.845003    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:40.845439 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:40.845104    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:40.845439 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:40.845215    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:42.046336 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:42.046308    2560 generic.go:356] "Generic (PLEG): container finished" podID="53f3a4b7-e7b5-436b-bff2-ca53925f7c22" containerID="5dd4e0ff12286f1c0fe7d94dc8cc0aeee5fb503d57ee9061608f3d41198b13b0" exitCode=0
Jul 20 16:14:42.046620 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:42.046365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvgc" event={"ID":"53f3a4b7-e7b5-436b-bff2-ca53925f7c22","Type":"ContainerDied","Data":"5dd4e0ff12286f1c0fe7d94dc8cc0aeee5fb503d57ee9061608f3d41198b13b0"}
Jul 20 16:14:42.845357 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:42.845332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:42.845499 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:42.845332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:42.845499 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:42.845428    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:42.845499 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:42.845336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:42.845595 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:42.845495    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:42.845595 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:42.845548    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:43.050717 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:43.050691    2560 generic.go:356] "Generic (PLEG): container finished" podID="53f3a4b7-e7b5-436b-bff2-ca53925f7c22" containerID="4d0c96903f598ed5c71e5109ebf264e32fa2c6ef4ceb6ba97780cc1d9c2c5f16" exitCode=0
Jul 20 16:14:43.051019 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:43.050727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvgc" event={"ID":"53f3a4b7-e7b5-436b-bff2-ca53925f7c22","Type":"ContainerDied","Data":"4d0c96903f598ed5c71e5109ebf264e32fa2c6ef4ceb6ba97780cc1d9c2c5f16"}
Jul 20 16:14:44.055292 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:44.055121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grvgc" event={"ID":"53f3a4b7-e7b5-436b-bff2-ca53925f7c22","Type":"ContainerStarted","Data":"7771981e04d7d0dac7f32c57c0b6dbf2a7e880bb4956349f0d893c22f7cc3cb1"}
Jul 20 16:14:44.077063 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:44.077016    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-grvgc" podStartSLOduration=6.554515306 podStartE2EDuration="38.076997076s" totalImagesPullingTime="31.52248177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:44.076773187 +0000 UTC m=+40.438473749" watchObservedRunningTime="2026-07-20 16:14:44.076997076 +0000 UTC m=+40.438697638"
Jul 20 16:14:44.844963 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:44.844929    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:44.844963 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:44.844951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:44.845155 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:44.845024    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:44.845155 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:44.845061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:44.845227 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:44.845151    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:44.845227 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:44.845200    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:46.845249 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:46.845219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:46.845249 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:46.845238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:46.845712 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:46.845292    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:46.845712 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:46.845297    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:46.845712 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:46.845359    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:46.845712 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:46.845434    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:48.844828 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:48.844805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:48.845180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:48.844803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:48.845180 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:48.844891    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:48.845180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:48.844812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:48.845180 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:48.845026    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:48.845180 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:48.844960    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:50.845234 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:50.845211    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:50.845661 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:50.845298    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:50.845661 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:50.845309    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:50.845661 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:50.845322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:50.845661 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:50.845377    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:50.845661 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:50.845431    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:52.845512 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:52.845485    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:52.845512 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:52.845516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:52.845869 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:52.845598    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xmcd" podUID="96cbf732-9ff3-411f-9aa1-4032e45087d8"
Jul 20 16:14:52.845869 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:52.845641    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jn2r" podUID="2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf"
Jul 20 16:14:52.845869 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:52.845655    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:52.845869 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:14:52.845730    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bt6fv" podUID="64760793-780a-46dd-83ac-76ca56fe3bfa"
Jul 20 16:14:54.467599 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.467577    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-221.ec2.internal" event="NodeReady"
Jul 20 16:14:54.467860 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.467665    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 16:14:54.500747 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.500724    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6967845579-2twff"]
Jul 20 16:14:54.508907 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.508890    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.511470 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.511451    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 16:14:54.511565 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.511486    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5btcg\""
Jul 20 16:14:54.511565 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.511492    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 16:14:54.511565 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.511496    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 16:14:54.513430 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.513412    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6hhmn"]
Jul 20 16:14:54.517591 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.517572    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 16:14:54.526258 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.526238    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qwbb7"]
Jul 20 16:14:54.526473 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.526456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.528575 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.528560    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6tgrd\""
Jul 20 16:14:54.529032 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.529013    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 16:14:54.529143 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.529088    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 16:14:54.534818 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.534802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6967845579-2twff"]
Jul 20 16:14:54.534890 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.534826    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hhmn"]
Jul 20 16:14:54.534890 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.534886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwbb7"
Jul 20 16:14:54.537408 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.537369    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 16:14:54.537505 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.537466    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 16:14:54.537632 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.537613    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 16:14:54.537795 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.537778    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sqlzb\""
Jul 20 16:14:54.538386 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.538365    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwbb7"]
Jul 20 16:14:54.616782 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.616763    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kvcwr"]
Jul 20 16:14:54.629068 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.629050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.631074 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.631055    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kvcwr"]
Jul 20 16:14:54.632033 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.632001    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 16:14:54.632507 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.632489    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 16:14:54.632887 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.632519    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzr47\""
Jul 20 16:14:54.633178 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.632579    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 16:14:54.633510 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.633494    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 16:14:54.642343 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d5eec58-f764-477e-b445-3b8e0693cae6-config-volume\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.642435 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af44366f-43a8-4878-9e0f-533fc77bbfc0-installation-pull-secrets\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.642435 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d5eec58-f764-477e-b445-3b8e0693cae6-metrics-tls\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.642435 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngqqk\" (UniqueName: \"kubernetes.io/projected/618e95bc-7a2b-44ee-9bd1-be8d45503d90-kube-api-access-ngqqk\") pod \"ingress-canary-qwbb7\" (UID: \"618e95bc-7a2b-44ee-9bd1-be8d45503d90\") " pod="openshift-ingress-canary/ingress-canary-qwbb7"
Jul 20 16:14:54.642435 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm8dl\" (UniqueName: \"kubernetes.io/projected/2d5eec58-f764-477e-b445-3b8e0693cae6-kube-api-access-dm8dl\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.642554 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af44366f-43a8-4878-9e0f-533fc77bbfc0-registry-certificates\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.642554 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af44366f-43a8-4878-9e0f-533fc77bbfc0-bound-sa-token\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.642554 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d5eec58-f764-477e-b445-3b8e0693cae6-tmp-dir\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.642648 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af44366f-43a8-4878-9e0f-533fc77bbfc0-image-registry-private-configuration\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.642648 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618e95bc-7a2b-44ee-9bd1-be8d45503d90-cert\") pod \"ingress-canary-qwbb7\" (UID: \"618e95bc-7a2b-44ee-9bd1-be8d45503d90\") " pod="openshift-ingress-canary/ingress-canary-qwbb7"
Jul 20 16:14:54.642648 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af44366f-43a8-4878-9e0f-533fc77bbfc0-registry-tls\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.642648 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af44366f-43a8-4878-9e0f-533fc77bbfc0-trusted-ca\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.642777 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af44366f-43a8-4878-9e0f-533fc77bbfc0-ca-trust-extracted\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.642777 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.642672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clcfq\" (UniqueName: \"kubernetes.io/projected/af44366f-43a8-4878-9e0f-533fc77bbfc0-kube-api-access-clcfq\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.743567 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af44366f-43a8-4878-9e0f-533fc77bbfc0-registry-certificates\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.743656 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af44366f-43a8-4878-9e0f-533fc77bbfc0-bound-sa-token\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.743656 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d5eec58-f764-477e-b445-3b8e0693cae6-tmp-dir\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.743656 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62da6629-81ac-4d72-a682-e07236578bcb-data-volume\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.743820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af44366f-43a8-4878-9e0f-533fc77bbfc0-image-registry-private-configuration\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.743856 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62da6629-81ac-4d72-a682-e07236578bcb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.743899 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62da6629-81ac-4d72-a682-e07236578bcb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.743899 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kjrk\" (UniqueName: \"kubernetes.io/projected/62da6629-81ac-4d72-a682-e07236578bcb-kube-api-access-8kjrk\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.743976 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618e95bc-7a2b-44ee-9bd1-be8d45503d90-cert\") pod \"ingress-canary-qwbb7\" (UID: \"618e95bc-7a2b-44ee-9bd1-be8d45503d90\") " pod="openshift-ingress-canary/ingress-canary-qwbb7"
Jul 20 16:14:54.744028 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.743975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af44366f-43a8-4878-9e0f-533fc77bbfc0-registry-tls\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.744028 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af44366f-43a8-4878-9e0f-533fc77bbfc0-trusted-ca\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.744028 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d5eec58-f764-477e-b445-3b8e0693cae6-tmp-dir\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.744233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af44366f-43a8-4878-9e0f-533fc77bbfc0-ca-trust-extracted\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.744233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clcfq\" (UniqueName: \"kubernetes.io/projected/af44366f-43a8-4878-9e0f-533fc77bbfc0-kube-api-access-clcfq\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.744233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d5eec58-f764-477e-b445-3b8e0693cae6-config-volume\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.744233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af44366f-43a8-4878-9e0f-533fc77bbfc0-installation-pull-secrets\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.744233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62da6629-81ac-4d72-a682-e07236578bcb-crio-socket\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.744233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d5eec58-f764-477e-b445-3b8e0693cae6-metrics-tls\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.744233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngqqk\" (UniqueName: \"kubernetes.io/projected/618e95bc-7a2b-44ee-9bd1-be8d45503d90-kube-api-access-ngqqk\") pod \"ingress-canary-qwbb7\" (UID: \"618e95bc-7a2b-44ee-9bd1-be8d45503d90\") " pod="openshift-ingress-canary/ingress-canary-qwbb7"
Jul 20 16:14:54.744555 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm8dl\" (UniqueName: \"kubernetes.io/projected/2d5eec58-f764-477e-b445-3b8e0693cae6-kube-api-access-dm8dl\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.744555 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af44366f-43a8-4878-9e0f-533fc77bbfc0-registry-certificates\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.744743 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af44366f-43a8-4878-9e0f-533fc77bbfc0-ca-trust-extracted\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.744846 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d5eec58-f764-477e-b445-3b8e0693cae6-config-volume\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.744902 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.744884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af44366f-43a8-4878-9e0f-533fc77bbfc0-trusted-ca\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.747943 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.747922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d5eec58-f764-477e-b445-3b8e0693cae6-metrics-tls\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.748033 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.747967    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af44366f-43a8-4878-9e0f-533fc77bbfc0-registry-tls\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.748033 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.748001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af44366f-43a8-4878-9e0f-533fc77bbfc0-image-registry-private-configuration\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.748110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.748039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af44366f-43a8-4878-9e0f-533fc77bbfc0-installation-pull-secrets\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.748110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.748077    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618e95bc-7a2b-44ee-9bd1-be8d45503d90-cert\") pod \"ingress-canary-qwbb7\" (UID: \"618e95bc-7a2b-44ee-9bd1-be8d45503d90\") " pod="openshift-ingress-canary/ingress-canary-qwbb7"
Jul 20 16:14:54.750879 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.750861    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af44366f-43a8-4878-9e0f-533fc77bbfc0-bound-sa-token\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.751309 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.751285    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clcfq\" (UniqueName: \"kubernetes.io/projected/af44366f-43a8-4878-9e0f-533fc77bbfc0-kube-api-access-clcfq\") pod \"image-registry-6967845579-2twff\" (UID: \"af44366f-43a8-4878-9e0f-533fc77bbfc0\") " pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.751447 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.751431    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm8dl\" (UniqueName: \"kubernetes.io/projected/2d5eec58-f764-477e-b445-3b8e0693cae6-kube-api-access-dm8dl\") pod \"dns-default-6hhmn\" (UID: \"2d5eec58-f764-477e-b445-3b8e0693cae6\") " pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.752566 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.752550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngqqk\" (UniqueName: \"kubernetes.io/projected/618e95bc-7a2b-44ee-9bd1-be8d45503d90-kube-api-access-ngqqk\") pod \"ingress-canary-qwbb7\" (UID: \"618e95bc-7a2b-44ee-9bd1-be8d45503d90\") " pod="openshift-ingress-canary/ingress-canary-qwbb7"
Jul 20 16:14:54.818434 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.818389    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:54.834523 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.834500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:14:54.843355 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.843339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwbb7"
Jul 20 16:14:54.844565 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.844543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:14:54.844661 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.844543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62da6629-81ac-4d72-a682-e07236578bcb-crio-socket\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.844661 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.844651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62da6629-81ac-4d72-a682-e07236578bcb-crio-socket\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.844746 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.844664    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:14:54.844746 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.844696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62da6629-81ac-4d72-a682-e07236578bcb-data-volume\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.844746 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.844725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62da6629-81ac-4d72-a682-e07236578bcb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.844841 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.844750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62da6629-81ac-4d72-a682-e07236578bcb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.844841 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.844772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kjrk\" (UniqueName: \"kubernetes.io/projected/62da6629-81ac-4d72-a682-e07236578bcb-kube-api-access-8kjrk\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.844841 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.844654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:14:54.845415 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.845398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62da6629-81ac-4d72-a682-e07236578bcb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.847000 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.846981    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 16:14:54.847160 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.847145    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 16:14:54.847542 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.847308    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 16:14:54.847745 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.847730    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fbfhg\""
Jul 20 16:14:54.847945 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.847925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sngxb\""
Jul 20 16:14:54.848015 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.847943    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 16:14:54.849141 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.849103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62da6629-81ac-4d72-a682-e07236578bcb-data-volume\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.850728 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.850703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62da6629-81ac-4d72-a682-e07236578bcb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.853010 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.852987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kjrk\" (UniqueName: \"kubernetes.io/projected/62da6629-81ac-4d72-a682-e07236578bcb-kube-api-access-8kjrk\") pod \"insights-runtime-extractor-kvcwr\" (UID: \"62da6629-81ac-4d72-a682-e07236578bcb\") " pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:54.940064 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:54.939790    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kvcwr"
Jul 20 16:14:55.029078 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:55.028570    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hhmn"]
Jul 20 16:14:55.033717 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:55.033691    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5eec58_f764_477e_b445_3b8e0693cae6.slice/crio-365872ca406caca185307aedbe0122e7a188b1efe7bd595daef41a18e5604577 WatchSource:0}: Error finding container 365872ca406caca185307aedbe0122e7a188b1efe7bd595daef41a18e5604577: Status 404 returned error can't find the container with id 365872ca406caca185307aedbe0122e7a188b1efe7bd595daef41a18e5604577
Jul 20 16:14:55.077452 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:55.077397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hhmn" event={"ID":"2d5eec58-f764-477e-b445-3b8e0693cae6","Type":"ContainerStarted","Data":"365872ca406caca185307aedbe0122e7a188b1efe7bd595daef41a18e5604577"}
Jul 20 16:14:55.097609 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:55.097587    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kvcwr"]
Jul 20 16:14:55.100529 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:55.100505    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62da6629_81ac_4d72_a682_e07236578bcb.slice/crio-194b03b3a2fcab3b2a848ae5b349c8c52deeea6b5d95e414c0745dc4116a3292 WatchSource:0}: Error finding container 194b03b3a2fcab3b2a848ae5b349c8c52deeea6b5d95e414c0745dc4116a3292: Status 404 returned error can't find the container with id 194b03b3a2fcab3b2a848ae5b349c8c52deeea6b5d95e414c0745dc4116a3292
Jul 20 16:14:55.240454 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:55.240429    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwbb7"]
Jul 20 16:14:55.242974 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:55.242951    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618e95bc_7a2b_44ee_9bd1_be8d45503d90.slice/crio-03d45f4a7040f7100f7f477f3eff1fb9fcd06364bde44712edcb724f5c099131 WatchSource:0}: Error finding container 03d45f4a7040f7100f7f477f3eff1fb9fcd06364bde44712edcb724f5c099131: Status 404 returned error can't find the container with id 03d45f4a7040f7100f7f477f3eff1fb9fcd06364bde44712edcb724f5c099131
Jul 20 16:14:55.246533 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:55.246510    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6967845579-2twff"]
Jul 20 16:14:55.249057 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:55.249031    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf44366f_43a8_4878_9e0f_533fc77bbfc0.slice/crio-4460159a6d7b530508c50d8f7040049055b80cc756dbe7618dea4aeaa2d3513b WatchSource:0}: Error finding container 4460159a6d7b530508c50d8f7040049055b80cc756dbe7618dea4aeaa2d3513b: Status 404 returned error can't find the container with id 4460159a6d7b530508c50d8f7040049055b80cc756dbe7618dea4aeaa2d3513b
Jul 20 16:14:56.083055 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.082979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kvcwr" event={"ID":"62da6629-81ac-4d72-a682-e07236578bcb","Type":"ContainerStarted","Data":"194b03b3a2fcab3b2a848ae5b349c8c52deeea6b5d95e414c0745dc4116a3292"}
Jul 20 16:14:56.084902 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.084820    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwbb7" event={"ID":"618e95bc-7a2b-44ee-9bd1-be8d45503d90","Type":"ContainerStarted","Data":"03d45f4a7040f7100f7f477f3eff1fb9fcd06364bde44712edcb724f5c099131"}
Jul 20 16:14:56.089375 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.088628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6967845579-2twff" event={"ID":"af44366f-43a8-4878-9e0f-533fc77bbfc0","Type":"ContainerStarted","Data":"59dacf13048f37498fade18d256e7a2ac8f046a30685e62c7bf85f779c755ed0"}
Jul 20 16:14:56.089375 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.088667    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6967845579-2twff" event={"ID":"af44366f-43a8-4878-9e0f-533fc77bbfc0","Type":"ContainerStarted","Data":"4460159a6d7b530508c50d8f7040049055b80cc756dbe7618dea4aeaa2d3513b"}
Jul 20 16:14:56.089375 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.089334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:14:56.111591 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.111401    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6967845579-2twff" podStartSLOduration=3.111384721 podStartE2EDuration="3.111384721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:56.110509362 +0000 UTC m=+52.472209915" watchObservedRunningTime="2026-07-20 16:14:56.111384721 +0000 UTC m=+52.473085284"
Jul 20 16:14:56.630683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.630644    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-njlxk"]
Jul 20 16:14:56.643067 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.642908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-njlxk"
Jul 20 16:14:56.643316 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.643264    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-njlxk"]
Jul 20 16:14:56.645847 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.645823    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 16:14:56.646719 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.646059    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 16:14:56.646719 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.646284    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sn7zd\""
Jul 20 16:14:56.763994 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.763961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfww5\" (UniqueName: \"kubernetes.io/projected/d7f9d3d5-5936-468d-ae8d-3b1c751f7e15-kube-api-access-vfww5\") pod \"downloads-5bc67dcd46-njlxk\" (UID: \"d7f9d3d5-5936-468d-ae8d-3b1c751f7e15\") " pod="openshift-console/downloads-5bc67dcd46-njlxk"
Jul 20 16:14:56.864850 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.864748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfww5\" (UniqueName: \"kubernetes.io/projected/d7f9d3d5-5936-468d-ae8d-3b1c751f7e15-kube-api-access-vfww5\") pod \"downloads-5bc67dcd46-njlxk\" (UID: \"d7f9d3d5-5936-468d-ae8d-3b1c751f7e15\") " pod="openshift-console/downloads-5bc67dcd46-njlxk"
Jul 20 16:14:56.877516 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.877461    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfww5\" (UniqueName: \"kubernetes.io/projected/d7f9d3d5-5936-468d-ae8d-3b1c751f7e15-kube-api-access-vfww5\") pod \"downloads-5bc67dcd46-njlxk\" (UID: \"d7f9d3d5-5936-468d-ae8d-3b1c751f7e15\") " pod="openshift-console/downloads-5bc67dcd46-njlxk"
Jul 20 16:14:56.957497 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:56.957151    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-njlxk"
Jul 20 16:14:57.174099 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:57.174071    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-njlxk"]
Jul 20 16:14:57.330103 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:14:57.330073    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f9d3d5_5936_468d_ae8d_3b1c751f7e15.slice/crio-84a87ebd81b8466bcd0627d388ba611ca4167f1fe890bced89eae8319001c92d WatchSource:0}: Error finding container 84a87ebd81b8466bcd0627d388ba611ca4167f1fe890bced89eae8319001c92d: Status 404 returned error can't find the container with id 84a87ebd81b8466bcd0627d388ba611ca4167f1fe890bced89eae8319001c92d
Jul 20 16:14:58.096433 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:14:58.096390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-njlxk" event={"ID":"d7f9d3d5-5936-468d-ae8d-3b1c751f7e15","Type":"ContainerStarted","Data":"84a87ebd81b8466bcd0627d388ba611ca4167f1fe890bced89eae8319001c92d"}
Jul 20 16:15:01.105098 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:01.105057    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kvcwr" event={"ID":"62da6629-81ac-4d72-a682-e07236578bcb","Type":"ContainerStarted","Data":"eea2bd1987be998f445a37c6cb4c12761fbb3a6e59f257e768f6f83aebc90300"}
Jul 20 16:15:01.106944 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:01.106906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hhmn" event={"ID":"2d5eec58-f764-477e-b445-3b8e0693cae6","Type":"ContainerStarted","Data":"61311988bd9156592f2bb5df523fba1af5d32a563854c087df9244ee5557ea1d"}
Jul 20 16:15:01.107094 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:01.106957    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hhmn" event={"ID":"2d5eec58-f764-477e-b445-3b8e0693cae6","Type":"ContainerStarted","Data":"2f9b6e9311f5595699aa3910cf3104a4d069a280cd76a5ed16f1b2f19689ba83"}
Jul 20 16:15:01.107094 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:01.106988    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:15:01.108599 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:01.108577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwbb7" event={"ID":"618e95bc-7a2b-44ee-9bd1-be8d45503d90","Type":"ContainerStarted","Data":"1c5186dea89d645c1069ab483c7c20449e42cf36bfe4bbc47265c99ca9e72137"}
Jul 20 16:15:01.124118 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:01.124067    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6hhmn" podStartSLOduration=4.798187773 podStartE2EDuration="7.124052306s" totalImagesPullingTime="2.325864533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:01.122478879 +0000 UTC m=+57.484179467" watchObservedRunningTime="2026-07-20 16:15:01.124052306 +0000 UTC m=+57.485752867"
Jul 20 16:15:01.138219 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:01.138169    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qwbb7" podStartSLOduration=1.71012184 podStartE2EDuration="7.138153198s" totalImagesPullingTime="5.428031358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:01.137213762 +0000 UTC m=+57.498914324" watchObservedRunningTime="2026-07-20 16:15:01.138153198 +0000 UTC m=+57.499853755"
Jul 20 16:15:06.045256 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:06.045221    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-stvbt"
Jul 20 16:15:06.125460 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:06.125424    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kvcwr" event={"ID":"62da6629-81ac-4d72-a682-e07236578bcb","Type":"ContainerStarted","Data":"b05fde775189339de8db40aec49c8285fd9a19fc1fd4de0d9e6b7ec512338637"}
Jul 20 16:15:09.968171 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:09.968115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:15:09.968635 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:09.968201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:15:09.970596 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:09.970573    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 16:15:09.970738 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:09.970665    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 16:15:09.980846 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:09.980823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf-metrics-certs\") pod \"network-metrics-daemon-7jn2r\" (UID: \"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf\") " pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:15:09.981037 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:09.981012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64760793-780a-46dd-83ac-76ca56fe3bfa-original-pull-secret\") pod \"global-pull-secret-syncer-bt6fv\" (UID: \"64760793-780a-46dd-83ac-76ca56fe3bfa\") " pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:15:10.068826 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.068800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:15:10.071287 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.071263    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 16:15:10.081094 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.081074    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 16:15:10.092148 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.092115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58nlg\" (UniqueName: \"kubernetes.io/projected/96cbf732-9ff3-411f-9aa1-4032e45087d8-kube-api-access-58nlg\") pod \"network-check-target-7xmcd\" (UID: \"96cbf732-9ff3-411f-9aa1-4032e45087d8\") " pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:15:10.140780 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.140753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kvcwr" event={"ID":"62da6629-81ac-4d72-a682-e07236578bcb","Type":"ContainerStarted","Data":"730234a2772caa39fe3cc9a8bca74ecc41f7d05244eb173a31a7df7202c52418"}
Jul 20 16:15:10.157204 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.156650    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kvcwr" podStartSLOduration=2.255026236 podStartE2EDuration="16.15663424s" totalImagesPullingTime="13.901608004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:10.156391719 +0000 UTC m=+66.518092283" watchObservedRunningTime="2026-07-20 16:15:10.15663424 +0000 UTC m=+66.518334785"
Jul 20 16:15:10.168393 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.168372    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fbfhg\""
Jul 20 16:15:10.174960 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.174938    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sngxb\""
Jul 20 16:15:10.176578 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.176562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jn2r"
Jul 20 16:15:10.178251 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.178233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bt6fv"
Jul 20 16:15:10.183859 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.183840    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:15:10.323904 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.323857    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7jn2r"]
Jul 20 16:15:10.550223 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.550197    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7xmcd"]
Jul 20 16:15:10.553338 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:10.553306    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bt6fv"]
Jul 20 16:15:11.114637 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:11.114610    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6hhmn"
Jul 20 16:15:11.146066 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:11.146037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7jn2r" event={"ID":"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf","Type":"ContainerStarted","Data":"9f00b378c4e35b8b70baab3a13716414867dac33d1c96c4d8adf23b9a854f11a"}
Jul 20 16:15:14.591757 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.591721    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"]
Jul 20 16:15:14.594633 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.594606    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.597284 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.597254    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 16:15:14.597284 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.597267    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 16:15:14.598060 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.598035    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 16:15:14.598233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.598209    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jswwd\""
Jul 20 16:15:14.598335 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.598254    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 16:15:14.598500 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.598484    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 16:15:14.609949 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.609930    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"]
Jul 20 16:15:14.701708 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.701679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9m5\" (UniqueName: \"kubernetes.io/projected/2536c51c-bc5c-403d-8a50-5c69ff7723fc-kube-api-access-nk9m5\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.701852 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.701741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2536c51c-bc5c-403d-8a50-5c69ff7723fc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.701852 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.701770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2536c51c-bc5c-403d-8a50-5c69ff7723fc-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.701852 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.701819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2536c51c-bc5c-403d-8a50-5c69ff7723fc-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.802433 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.802402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9m5\" (UniqueName: \"kubernetes.io/projected/2536c51c-bc5c-403d-8a50-5c69ff7723fc-kube-api-access-nk9m5\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.802594 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.802471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2536c51c-bc5c-403d-8a50-5c69ff7723fc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.802594 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.802503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2536c51c-bc5c-403d-8a50-5c69ff7723fc-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.802594 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.802530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2536c51c-bc5c-403d-8a50-5c69ff7723fc-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.803314 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.803290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2536c51c-bc5c-403d-8a50-5c69ff7723fc-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.805098 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.805049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2536c51c-bc5c-403d-8a50-5c69ff7723fc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.805215 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.805105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2536c51c-bc5c-403d-8a50-5c69ff7723fc-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.810411 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.810371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9m5\" (UniqueName: \"kubernetes.io/projected/2536c51c-bc5c-403d-8a50-5c69ff7723fc-kube-api-access-nk9m5\") pod \"prometheus-operator-5945b5cfd-hc6kn\" (UID: \"2536c51c-bc5c-403d-8a50-5c69ff7723fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:14.823526 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.823503    2560 patch_prober.go:28] interesting pod/image-registry-6967845579-2twff container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 16:15:14.823637 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.823558    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6967845579-2twff" podUID="af44366f-43a8-4878-9e0f-533fc77bbfc0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 16:15:14.905583 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:14.905528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"
Jul 20 16:15:17.120532 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:15:17.120497    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64760793_780a_46dd_83ac_76ca56fe3bfa.slice/crio-255d28445d925b15b070dfa8830d7f7f89777334d3c03ec44c71cd1b2a8bcd38 WatchSource:0}: Error finding container 255d28445d925b15b070dfa8830d7f7f89777334d3c03ec44c71cd1b2a8bcd38: Status 404 returned error can't find the container with id 255d28445d925b15b070dfa8830d7f7f89777334d3c03ec44c71cd1b2a8bcd38
Jul 20 16:15:17.121317 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:15:17.121291    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96cbf732_9ff3_411f_9aa1_4032e45087d8.slice/crio-334a06a6e7ac5c497a1c511078c12b85d2181c83c5ec9b51304a9ed09847116f WatchSource:0}: Error finding container 334a06a6e7ac5c497a1c511078c12b85d2181c83c5ec9b51304a9ed09847116f: Status 404 returned error can't find the container with id 334a06a6e7ac5c497a1c511078c12b85d2181c83c5ec9b51304a9ed09847116f
Jul 20 16:15:17.171950 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:17.171917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7xmcd" event={"ID":"96cbf732-9ff3-411f-9aa1-4032e45087d8","Type":"ContainerStarted","Data":"334a06a6e7ac5c497a1c511078c12b85d2181c83c5ec9b51304a9ed09847116f"}
Jul 20 16:15:17.173250 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:17.173215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bt6fv" event={"ID":"64760793-780a-46dd-83ac-76ca56fe3bfa","Type":"ContainerStarted","Data":"255d28445d925b15b070dfa8830d7f7f89777334d3c03ec44c71cd1b2a8bcd38"}
Jul 20 16:15:17.234939 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:17.234839    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn"]
Jul 20 16:15:17.352363 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:15:17.352337    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2536c51c_bc5c_403d_8a50_5c69ff7723fc.slice/crio-2cc4c46e8b90685fb4a7c9c25d9631b628412880ecc59dc46ff9559b013d0ed6 WatchSource:0}: Error finding container 2cc4c46e8b90685fb4a7c9c25d9631b628412880ecc59dc46ff9559b013d0ed6: Status 404 returned error can't find the container with id 2cc4c46e8b90685fb4a7c9c25d9631b628412880ecc59dc46ff9559b013d0ed6
Jul 20 16:15:18.102480 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:18.102447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6967845579-2twff"
Jul 20 16:15:18.182004 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:18.181794    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn" event={"ID":"2536c51c-bc5c-403d-8a50-5c69ff7723fc","Type":"ContainerStarted","Data":"2cc4c46e8b90685fb4a7c9c25d9631b628412880ecc59dc46ff9559b013d0ed6"}
Jul 20 16:15:18.186260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:18.183768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-njlxk" event={"ID":"d7f9d3d5-5936-468d-ae8d-3b1c751f7e15","Type":"ContainerStarted","Data":"b70ec4d6990d6f755b397139e7075b387d7bc20fba56bf0c3f0ef316d52c7b41"}
Jul 20 16:15:18.186260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:18.186009    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-njlxk"
Jul 20 16:15:18.189188 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:18.189143    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-njlxk"
Jul 20 16:15:18.205880 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:18.205418    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-njlxk" podStartSLOduration=2.145526978 podStartE2EDuration="22.205400276s" totalImagesPullingTime="20.059873298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:18.204830845 +0000 UTC m=+74.566531406" watchObservedRunningTime="2026-07-20 16:15:18.205400276 +0000 UTC m=+74.567100839"
Jul 20 16:15:19.192445 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:19.192333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7jn2r" event={"ID":"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf","Type":"ContainerStarted","Data":"e137efb72d1b4ed7edf60991e32538d84a62eb6d8f099ad79741e20de4aa954d"}
Jul 20 16:15:19.192445 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:19.192397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7jn2r" event={"ID":"2f96ef8d-8ec9-4268-8c57-8e97da5cb3bf","Type":"ContainerStarted","Data":"fc29b4c6902d1e939b26755b7897559e5a9b6dfb5e36ca32cbafa6ec1073b900"}
Jul 20 16:15:19.232354 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:19.231666    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7jn2r" podStartSLOduration=65.429440569 podStartE2EDuration="1m13.231641921s" totalImagesPullingTime="7.802201352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:19.230224184 +0000 UTC m=+75.591924739" watchObservedRunningTime="2026-07-20 16:15:19.231641921 +0000 UTC m=+75.593342483"
Jul 20 16:15:21.205825 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:21.203995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn" event={"ID":"2536c51c-bc5c-403d-8a50-5c69ff7723fc","Type":"ContainerStarted","Data":"cb940d6ad554571da236c619244733550a4200daf6532e72d3da94d59e9b0fdc"}
Jul 20 16:15:21.206402 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:21.205980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn" event={"ID":"2536c51c-bc5c-403d-8a50-5c69ff7723fc","Type":"ContainerStarted","Data":"5845ef65b7530c313e502493da04ee5cf19f9736c6772b50b891eb2bdbe6b26d"}
Jul 20 16:15:21.225180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:21.224483    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hc6kn" podStartSLOduration=4.497174619 podStartE2EDuration="7.224463891s" totalImagesPullingTime="2.727289272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:21.223668991 +0000 UTC m=+77.585369548" watchObservedRunningTime="2026-07-20 16:15:21.224463891 +0000 UTC m=+77.586164455"
Jul 20 16:15:22.956103 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:22.956055    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2zph2"]
Jul 20 16:15:23.004160 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.002692    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ptdbn"]
Jul 20 16:15:23.004160 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.003936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.006849 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.006826    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 16:15:23.007067 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.007041    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qqqt9\""
Jul 20 16:15:23.007823 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.007300    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 16:15:23.007926 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.007840    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 16:15:23.028032 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.027449    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2zph2"]
Jul 20 16:15:23.028032 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.027581    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.030398 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.030261    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 16:15:23.030398 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.030283    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 16:15:23.030561 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.030401    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 16:15:23.031260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.031061    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t4pfw\""
Jul 20 16:15:23.066162 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6eb85424-778d-4bb2-b1f7-a3ca634791e5-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6eb85424-778d-4bb2-b1f7-a3ca634791e5-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-tls\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-wtmp\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9867a617-889d-4616-936c-68635a1d91e3-sys\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066329    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn5t8\" (UniqueName: \"kubernetes.io/projected/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-api-access-sn5t8\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9867a617-889d-4616-936c-68635a1d91e3-root\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.066459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz86d\" (UniqueName: \"kubernetes.io/projected/9867a617-889d-4616-936c-68635a1d91e3-kube-api-access-cz86d\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.066930 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.066930 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-textfile\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.066930 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9867a617-889d-4616-936c-68635a1d91e3-metrics-client-ca\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.066930 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.066554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.167829 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.167794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.168007 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.167840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9867a617-889d-4616-936c-68635a1d91e3-sys\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.168007 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.167870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn5t8\" (UniqueName: \"kubernetes.io/projected/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-api-access-sn5t8\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.168007 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.167900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.168007 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.167939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9867a617-889d-4616-936c-68635a1d91e3-root\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.168007 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.167960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz86d\" (UniqueName: \"kubernetes.io/projected/9867a617-889d-4616-936c-68635a1d91e3-kube-api-access-cz86d\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.168007 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.167989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.168341 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-textfile\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.168341 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9867a617-889d-4616-936c-68635a1d91e3-metrics-client-ca\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.168341 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.168341 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168101    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6eb85424-778d-4bb2-b1f7-a3ca634791e5-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.168341 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6eb85424-778d-4bb2-b1f7-a3ca634791e5-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.168341 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.168341 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-tls\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.168341 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-wtmp\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.168763 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-wtmp\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168851    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-textfile\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.168943    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9867a617-889d-4616-936c-68635a1d91e3-sys\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.169729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.169937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.170018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9867a617-889d-4616-936c-68635a1d91e3-root\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.170252    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9867a617-889d-4616-936c-68635a1d91e3-metrics-client-ca\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:15:23.170343    2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:15:23.170411    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-tls podName:6eb85424-778d-4bb2-b1f7-a3ca634791e5 nodeName:}" failed. No retries permitted until 2026-07-20 16:15:23.670391955 +0000 UTC m=+80.032092496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-2zph2" (UID: "6eb85424-778d-4bb2-b1f7-a3ca634791e5") : secret "kube-state-metrics-tls" not found
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:15:23.170685    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 16:15:23.170790 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:15:23.170738    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-tls podName:9867a617-889d-4616-936c-68635a1d91e3 nodeName:}" failed. No retries permitted until 2026-07-20 16:15:23.670721673 +0000 UTC m=+80.032422228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-tls") pod "node-exporter-ptdbn" (UID: "9867a617-889d-4616-936c-68635a1d91e3") : secret "node-exporter-tls" not found
Jul 20 16:15:23.171383 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.170803    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6eb85424-778d-4bb2-b1f7-a3ca634791e5-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.171555 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.171481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6eb85424-778d-4bb2-b1f7-a3ca634791e5-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.173000 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.172974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.173372 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.173349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.179344 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.179302    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz86d\" (UniqueName: \"kubernetes.io/projected/9867a617-889d-4616-936c-68635a1d91e3-kube-api-access-cz86d\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.181382 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.181340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn5t8\" (UniqueName: \"kubernetes.io/projected/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-api-access-sn5t8\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.673265 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.673230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.673452 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.673310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-tls\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.675861 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.675836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9867a617-889d-4616-936c-68635a1d91e3-node-exporter-tls\") pod \"node-exporter-ptdbn\" (UID: \"9867a617-889d-4616-936c-68635a1d91e3\") " pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:23.675996 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.675974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eb85424-778d-4bb2-b1f7-a3ca634791e5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2zph2\" (UID: \"6eb85424-778d-4bb2-b1f7-a3ca634791e5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.916230 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.916196    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2"
Jul 20 16:15:23.939557 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:23.939521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ptdbn"
Jul 20 16:15:24.007047 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:15:24.007014    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9867a617_889d_4616_936c_68635a1d91e3.slice/crio-d0c3cd2d65644e96ad9493e66fd0ba87912fd992bf421564a7a7bc83371afaaf WatchSource:0}: Error finding container d0c3cd2d65644e96ad9493e66fd0ba87912fd992bf421564a7a7bc83371afaaf: Status 404 returned error can't find the container with id d0c3cd2d65644e96ad9493e66fd0ba87912fd992bf421564a7a7bc83371afaaf
Jul 20 16:15:24.174988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:24.173309    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2zph2"]
Jul 20 16:15:24.177717 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:15:24.177675    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb85424_778d_4bb2_b1f7_a3ca634791e5.slice/crio-0679aea6abaab254613f781dac975be6ae122262b045bc24eaec1fcffdb83dd1 WatchSource:0}: Error finding container 0679aea6abaab254613f781dac975be6ae122262b045bc24eaec1fcffdb83dd1: Status 404 returned error can't find the container with id 0679aea6abaab254613f781dac975be6ae122262b045bc24eaec1fcffdb83dd1
Jul 20 16:15:24.231306 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:24.231269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7xmcd" event={"ID":"96cbf732-9ff3-411f-9aa1-4032e45087d8","Type":"ContainerStarted","Data":"f3a67e99ef67a9da612c91073eab2fc9db0babbbba70b87f0203d966566ff612"}
Jul 20 16:15:24.231486 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:24.231465    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:15:24.232973 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:24.232945    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2" event={"ID":"6eb85424-778d-4bb2-b1f7-a3ca634791e5","Type":"ContainerStarted","Data":"0679aea6abaab254613f781dac975be6ae122262b045bc24eaec1fcffdb83dd1"}
Jul 20 16:15:24.236842 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:24.236813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bt6fv" event={"ID":"64760793-780a-46dd-83ac-76ca56fe3bfa","Type":"ContainerStarted","Data":"6313ffd31f8541e1822512a88c00c09ca312fc5427a0ba5a52bbd5c0d2d10a83"}
Jul 20 16:15:24.238064 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:24.238037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptdbn" event={"ID":"9867a617-889d-4616-936c-68635a1d91e3","Type":"ContainerStarted","Data":"d0c3cd2d65644e96ad9493e66fd0ba87912fd992bf421564a7a7bc83371afaaf"}
Jul 20 16:15:24.267667 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:24.267584    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7xmcd" podStartSLOduration=71.393220405 podStartE2EDuration="1m18.267564375s" totalImagesPullingTime="6.87434397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:24.24850483 +0000 UTC m=+80.610205392" watchObservedRunningTime="2026-07-20 16:15:24.267564375 +0000 UTC m=+80.629264938"
Jul 20 16:15:24.268233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:24.268183    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bt6fv" podStartSLOduration=71.379500783 podStartE2EDuration="1m18.268170178s" totalImagesPullingTime="6.888669395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:24.267385044 +0000 UTC m=+80.629085608" watchObservedRunningTime="2026-07-20 16:15:24.268170178 +0000 UTC m=+80.629870742"
Jul 20 16:15:26.249579 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:26.249440    2560 generic.go:356] "Generic (PLEG): container finished" podID="9867a617-889d-4616-936c-68635a1d91e3" containerID="3cc0f1d725552798d4a98cdb75d1939584f1a2aeb9f41469938498cc6564b5f1" exitCode=0
Jul 20 16:15:26.249579 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:26.249550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptdbn" event={"ID":"9867a617-889d-4616-936c-68635a1d91e3","Type":"ContainerDied","Data":"3cc0f1d725552798d4a98cdb75d1939584f1a2aeb9f41469938498cc6564b5f1"}
Jul 20 16:15:27.255523 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.255491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2" event={"ID":"6eb85424-778d-4bb2-b1f7-a3ca634791e5","Type":"ContainerStarted","Data":"31e86981f967c99b10ab7d96f76b98c9b13355880524e5ac52ef5723ad6da841"}
Jul 20 16:15:27.257849 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.257821    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptdbn" event={"ID":"9867a617-889d-4616-936c-68635a1d91e3","Type":"ContainerStarted","Data":"9100446a53eb29eed952836dde0e0b95a05f5d473f7db8dd95c5edde87fa4059"}
Jul 20 16:15:27.257972 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.257875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptdbn" event={"ID":"9867a617-889d-4616-936c-68635a1d91e3","Type":"ContainerStarted","Data":"95fbf767272e516a7126dc327c11c583d547dc992081580191434f99b62e888c"}
Jul 20 16:15:27.286038 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.285978    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ptdbn" podStartSLOduration=3.65196743 podStartE2EDuration="5.285961695s" totalImagesPullingTime="1.531474966s" totalInitContainerRuntime="102.519299ms" isStatefulPod=true podCreationTimestamp="2026-07-20 16:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:27.28379246 +0000 UTC m=+83.645493056" watchObservedRunningTime="2026-07-20 16:15:27.285961695 +0000 UTC m=+83.647662239"
Jul 20 16:15:27.339154 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.339108    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"]
Jul 20 16:15:27.357938 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.357908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"]
Jul 20 16:15:27.358081 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.358062    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.360606 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.360582    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 20 16:15:27.361545 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.361383    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 16:15:27.362357 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.362324    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6lqt9\""
Jul 20 16:15:27.362727 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.362557    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 20 16:15:27.362727 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.362710    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1tqvvagelv2li\""
Jul 20 16:15:27.362853 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.362842    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 20 16:15:27.402821 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.402797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-secret-metrics-server-client-certs\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.402925 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.402832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-audit-log\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.402925 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.402855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-secret-metrics-server-tls\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.402925 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.402871    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-client-ca-bundle\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.403042 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.402956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccz2v\" (UniqueName: \"kubernetes.io/projected/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-kube-api-access-ccz2v\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.403042 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.402989    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-metrics-server-audit-profiles\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.403042 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.403013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.503783 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.503738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccz2v\" (UniqueName: \"kubernetes.io/projected/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-kube-api-access-ccz2v\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.503783 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.503784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-metrics-server-audit-profiles\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.504015 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.503808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.504015 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.503840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-secret-metrics-server-client-certs\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.504015 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.503949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-audit-log\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.504015 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.504006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-secret-metrics-server-tls\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.504236 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.504027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-client-ca-bundle\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.504452 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.504400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-audit-log\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.504688 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.504659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.504961 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.504938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-metrics-server-audit-profiles\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.506537 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.506513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-client-ca-bundle\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.506635 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.506559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-secret-metrics-server-tls\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.506774 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.506759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-secret-metrics-server-client-certs\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.511090 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.511069    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccz2v\" (UniqueName: \"kubernetes.io/projected/f3254732-c7c8-4e3d-896b-59d8fc14cb2c-kube-api-access-ccz2v\") pod \"metrics-server-67fdd5d8d5-wrj7v\" (UID: \"f3254732-c7c8-4e3d-896b-59d8fc14cb2c\") " pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.670905 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.670817    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:27.714541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.714508    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"]
Jul 20 16:15:27.731996 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.731966    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"]
Jul 20 16:15:27.732206 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.732087    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:27.734100 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.734080    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 16:15:27.734100 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.734098    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gwkpp\""
Jul 20 16:15:27.806563 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.806536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt2qz\" (UniqueName: \"kubernetes.io/projected/f32ada3e-3a44-4a27-8086-52691a66f497-kube-api-access-qt2qz\") pod \"monitoring-plugin-7b7b7bc8bf-5gpvj\" (UID: \"f32ada3e-3a44-4a27-8086-52691a66f497\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:27.806731 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.806601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f32ada3e-3a44-4a27-8086-52691a66f497-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5gpvj\" (UID: \"f32ada3e-3a44-4a27-8086-52691a66f497\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:27.860055 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.859933    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"]
Jul 20 16:15:27.862408 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:15:27.862377    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3254732_c7c8_4e3d_896b_59d8fc14cb2c.slice/crio-960a0845e7525a2dc3eb8ce09eee2d06ba0a276cce73af04e5fbe274410678d3 WatchSource:0}: Error finding container 960a0845e7525a2dc3eb8ce09eee2d06ba0a276cce73af04e5fbe274410678d3: Status 404 returned error can't find the container with id 960a0845e7525a2dc3eb8ce09eee2d06ba0a276cce73af04e5fbe274410678d3
Jul 20 16:15:27.907781 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.907749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f32ada3e-3a44-4a27-8086-52691a66f497-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5gpvj\" (UID: \"f32ada3e-3a44-4a27-8086-52691a66f497\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:27.907965 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.907804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt2qz\" (UniqueName: \"kubernetes.io/projected/f32ada3e-3a44-4a27-8086-52691a66f497-kube-api-access-qt2qz\") pod \"monitoring-plugin-7b7b7bc8bf-5gpvj\" (UID: \"f32ada3e-3a44-4a27-8086-52691a66f497\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:27.907965 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:15:27.907895    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 20 16:15:27.908046 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:15:27.907969    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f32ada3e-3a44-4a27-8086-52691a66f497-monitoring-plugin-cert podName:f32ada3e-3a44-4a27-8086-52691a66f497 nodeName:}" failed. No retries permitted until 2026-07-20 16:15:28.40795012 +0000 UTC m=+84.769650664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f32ada3e-3a44-4a27-8086-52691a66f497-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-5gpvj" (UID: "f32ada3e-3a44-4a27-8086-52691a66f497") : secret "monitoring-plugin-cert" not found
Jul 20 16:15:27.921644 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:27.921574    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt2qz\" (UniqueName: \"kubernetes.io/projected/f32ada3e-3a44-4a27-8086-52691a66f497-kube-api-access-qt2qz\") pod \"monitoring-plugin-7b7b7bc8bf-5gpvj\" (UID: \"f32ada3e-3a44-4a27-8086-52691a66f497\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:28.263860 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:28.263783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2" event={"ID":"6eb85424-778d-4bb2-b1f7-a3ca634791e5","Type":"ContainerStarted","Data":"e4bd662aadeb3366fc7a996c72822592c9733309f7616a292adc32a19ec1d580"}
Jul 20 16:15:28.263860 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:28.263841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2" event={"ID":"6eb85424-778d-4bb2-b1f7-a3ca634791e5","Type":"ContainerStarted","Data":"389c7b9e992470f45a558abcdf62a7b4a8c52e05e512df5f937566f36abefb87"}
Jul 20 16:15:28.264953 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:28.264928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v" event={"ID":"f3254732-c7c8-4e3d-896b-59d8fc14cb2c","Type":"ContainerStarted","Data":"960a0845e7525a2dc3eb8ce09eee2d06ba0a276cce73af04e5fbe274410678d3"}
Jul 20 16:15:28.280046 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:28.280000    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-2zph2" podStartSLOduration=3.318424521 podStartE2EDuration="6.279980587s" totalImagesPullingTime="2.961556066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:28.279563107 +0000 UTC m=+84.641263671" watchObservedRunningTime="2026-07-20 16:15:28.279980587 +0000 UTC m=+84.641681151"
Jul 20 16:15:28.412141 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:28.412102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f32ada3e-3a44-4a27-8086-52691a66f497-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5gpvj\" (UID: \"f32ada3e-3a44-4a27-8086-52691a66f497\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:28.414486 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:28.414452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f32ada3e-3a44-4a27-8086-52691a66f497-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5gpvj\" (UID: \"f32ada3e-3a44-4a27-8086-52691a66f497\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:28.641418 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:28.641383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:28.791987 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:28.791952    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"]
Jul 20 16:15:28.796859 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:15:28.796828    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32ada3e_3a44_4a27_8086_52691a66f497.slice/crio-cbf49e6b0dcad24cacd94d647549697049fc967b402499f3c9ecaa4c537fb323 WatchSource:0}: Error finding container cbf49e6b0dcad24cacd94d647549697049fc967b402499f3c9ecaa4c537fb323: Status 404 returned error can't find the container with id cbf49e6b0dcad24cacd94d647549697049fc967b402499f3c9ecaa4c537fb323
Jul 20 16:15:29.272309 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:29.272270    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj" event={"ID":"f32ada3e-3a44-4a27-8086-52691a66f497","Type":"ContainerStarted","Data":"cbf49e6b0dcad24cacd94d647549697049fc967b402499f3c9ecaa4c537fb323"}
Jul 20 16:15:30.280749 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:30.280677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v" event={"ID":"f3254732-c7c8-4e3d-896b-59d8fc14cb2c","Type":"ContainerStarted","Data":"870b5ac1160848abb9f8099007165003671612762a5fdc8c5e5bba374ad1ca2a"}
Jul 20 16:15:30.300555 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:30.300496    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v" podStartSLOduration=1.002587478 podStartE2EDuration="3.300477967s" totalImagesPullingTime="2.297890489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:30.29871865 +0000 UTC m=+86.660419215" watchObservedRunningTime="2026-07-20 16:15:30.300477967 +0000 UTC m=+86.662178575"
Jul 20 16:15:32.289202 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:32.289165    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj" event={"ID":"f32ada3e-3a44-4a27-8086-52691a66f497","Type":"ContainerStarted","Data":"478865c3f3c43f0b708cb8ffbba50fada2599eecf0757dd569c5a2599091329d"}
Jul 20 16:15:32.289632 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:32.289389    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:32.293983 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:32.293959    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj"
Jul 20 16:15:32.305690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:32.305640    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5gpvj" podStartSLOduration=2.5355380370000002 podStartE2EDuration="5.30562521s" totalImagesPullingTime="2.770087173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:32.304699209 +0000 UTC m=+88.666399773" watchObservedRunningTime="2026-07-20 16:15:32.30562521 +0000 UTC m=+88.667325794"
Jul 20 16:15:47.671206 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:47.671173    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:47.671603 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:47.671232    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:15:55.243836 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:15:55.243808    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7xmcd"
Jul 20 16:16:07.676520 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:07.676490    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:16:07.680623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:07.680602    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67fdd5d8d5-wrj7v"
Jul 20 16:16:47.203901 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.203861    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8775b8679-c9ptp"]
Jul 20 16:16:47.206910 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.206887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.209578 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.209555    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 16:16:47.209745 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.209647    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 16:16:47.209826 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.209650    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2gppb\""
Jul 20 16:16:47.209826 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.209780    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 16:16:47.209939 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.209840    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 16:16:47.210055 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.210038    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 16:16:47.215122 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.214960    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 16:16:47.224994 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.224967    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8775b8679-c9ptp"]
Jul 20 16:16:47.298927 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.298888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.299110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.298950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-serving-certs-ca-bundle\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.299110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.298985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-federate-client-tls\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.299110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.299045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.299110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.299075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prgls\" (UniqueName: \"kubernetes.io/projected/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-kube-api-access-prgls\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.299110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.299105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-secret-telemeter-client\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.299330 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.299137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-telemeter-client-tls\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.299330 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.299167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-metrics-client-ca\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.400422 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.400372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.400422 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.400428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prgls\" (UniqueName: \"kubernetes.io/projected/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-kube-api-access-prgls\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.400693 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.400465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-secret-telemeter-client\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.400693 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.400485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-telemeter-client-tls\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.400693 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.400513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-metrics-client-ca\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.400693 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.400550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.400693 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.400677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-serving-certs-ca-bundle\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.400942 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.400727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-federate-client-tls\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.401417 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.401392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-metrics-client-ca\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.401569 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.401538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-serving-certs-ca-bundle\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.401752 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.401732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.403280 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.403257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-federate-client-tls\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.403368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.403322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-secret-telemeter-client\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.403368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.403326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.403460 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.403445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-telemeter-client-tls\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.408524 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.408501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prgls\" (UniqueName: \"kubernetes.io/projected/1f6cd08d-b6f3-4b77-ac87-15f8ed907785-kube-api-access-prgls\") pod \"telemeter-client-8775b8679-c9ptp\" (UID: \"1f6cd08d-b6f3-4b77-ac87-15f8ed907785\") " pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.518594 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.518495    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp"
Jul 20 16:16:47.645833 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:47.645790    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8775b8679-c9ptp"]
Jul 20 16:16:47.648801 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:16:47.648774    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6cd08d_b6f3_4b77_ac87_15f8ed907785.slice/crio-0e8fc6ced77e305b3003070c922269efdc07496c404de26a9576ed5b284c97f7 WatchSource:0}: Error finding container 0e8fc6ced77e305b3003070c922269efdc07496c404de26a9576ed5b284c97f7: Status 404 returned error can't find the container with id 0e8fc6ced77e305b3003070c922269efdc07496c404de26a9576ed5b284c97f7
Jul 20 16:16:48.549006 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:48.548973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp" event={"ID":"1f6cd08d-b6f3-4b77-ac87-15f8ed907785","Type":"ContainerStarted","Data":"0e8fc6ced77e305b3003070c922269efdc07496c404de26a9576ed5b284c97f7"}
Jul 20 16:16:51.561906 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:51.561872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp" event={"ID":"1f6cd08d-b6f3-4b77-ac87-15f8ed907785","Type":"ContainerStarted","Data":"677d7df37c0edf394ecee71c2450dc2162b7e0b82b6236738b7885ff41578e70"}
Jul 20 16:16:52.567719 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:52.567684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp" event={"ID":"1f6cd08d-b6f3-4b77-ac87-15f8ed907785","Type":"ContainerStarted","Data":"68304e5141defd99794fc88e89c0188665099148cc5e816b408c8b7faf7dddeb"}
Jul 20 16:16:52.568107 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:52.567739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp" event={"ID":"1f6cd08d-b6f3-4b77-ac87-15f8ed907785","Type":"ContainerStarted","Data":"b0c684081710531d42922a0a62b15e29cefa748b0a610aa2ecc129b85ba22621"}
Jul 20 16:16:52.589093 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:16:52.589028    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8775b8679-c9ptp" podStartSLOduration=0.934351081 podStartE2EDuration="5.589007128s" totalImagesPullingTime="4.654656047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:16:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:16:52.588494584 +0000 UTC m=+168.950195147" watchObservedRunningTime="2026-07-20 16:16:52.589007128 +0000 UTC m=+168.950707696"
Jul 20 16:18:38.455452 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.455365    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"]
Jul 20 16:18:38.458641 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.458625    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.460962 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.460938    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 16:18:38.461088 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.461033    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wbc96\""
Jul 20 16:18:38.461764 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.461746    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 16:18:38.465929 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.465908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"]
Jul 20 16:18:38.509856 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.509817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkqmb\" (UniqueName: \"kubernetes.io/projected/422283f8-6d5d-4b46-8e49-f720f03b8a3c-kube-api-access-gkqmb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.510039 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.509902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.510039 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.509944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.611277 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.611241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkqmb\" (UniqueName: \"kubernetes.io/projected/422283f8-6d5d-4b46-8e49-f720f03b8a3c-kube-api-access-gkqmb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.611442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.611321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.611442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.611355    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.611675 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.611653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.611734 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.611696    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.619448 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.619424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkqmb\" (UniqueName: \"kubernetes.io/projected/422283f8-6d5d-4b46-8e49-f720f03b8a3c-kube-api-access-gkqmb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.768733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.768638    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:18:38.896202 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.896122    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"]
Jul 20 16:18:38.898452 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:18:38.898427    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422283f8_6d5d_4b46_8e49_f720f03b8a3c.slice/crio-ff8279803a8e2841f6bad6fcf04b183380d762796ef54b428c2345b5c8890995 WatchSource:0}: Error finding container ff8279803a8e2841f6bad6fcf04b183380d762796ef54b428c2345b5c8890995: Status 404 returned error can't find the container with id ff8279803a8e2841f6bad6fcf04b183380d762796ef54b428c2345b5c8890995
Jul 20 16:18:38.935147 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:38.935093    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5" event={"ID":"422283f8-6d5d-4b46-8e49-f720f03b8a3c","Type":"ContainerStarted","Data":"ff8279803a8e2841f6bad6fcf04b183380d762796ef54b428c2345b5c8890995"}
Jul 20 16:18:46.969260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:46.969174    2560 generic.go:356] "Generic (PLEG): container finished" podID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerID="351d8f63d4ae2a865de24d55c6bbb1ed20f09bd9c843ecc9f965aa539f69bc43" exitCode=0
Jul 20 16:18:46.969260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:46.969219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5" event={"ID":"422283f8-6d5d-4b46-8e49-f720f03b8a3c","Type":"ContainerDied","Data":"351d8f63d4ae2a865de24d55c6bbb1ed20f09bd9c843ecc9f965aa539f69bc43"}
Jul 20 16:18:49.983726 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:49.983690    2560 generic.go:356] "Generic (PLEG): container finished" podID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerID="023e59cd161dd082b572df8f02e3fd6afa82d73ade8b6209c1babd2c9d9b381c" exitCode=0
Jul 20 16:18:49.984114 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:49.983747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5" event={"ID":"422283f8-6d5d-4b46-8e49-f720f03b8a3c","Type":"ContainerDied","Data":"023e59cd161dd082b572df8f02e3fd6afa82d73ade8b6209c1babd2c9d9b381c"}
Jul 20 16:18:59.020839 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:59.020805    2560 generic.go:356] "Generic (PLEG): container finished" podID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerID="c43c7351978ba5f2c95b3b651a8a1da3098bfe116608cc8a1901a163efa0e6d6" exitCode=0
Jul 20 16:18:59.021302 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:18:59.020869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5" event={"ID":"422283f8-6d5d-4b46-8e49-f720f03b8a3c","Type":"ContainerDied","Data":"c43c7351978ba5f2c95b3b651a8a1da3098bfe116608cc8a1901a163efa0e6d6"}
Jul 20 16:19:00.146515 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.146492    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:19:00.291357 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.291323    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-util\") pod \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") "
Jul 20 16:19:00.291525 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.291364    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkqmb\" (UniqueName: \"kubernetes.io/projected/422283f8-6d5d-4b46-8e49-f720f03b8a3c-kube-api-access-gkqmb\") pod \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") "
Jul 20 16:19:00.291525 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.291423    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-bundle\") pod \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\" (UID: \"422283f8-6d5d-4b46-8e49-f720f03b8a3c\") "
Jul 20 16:19:00.292092 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.292060    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-bundle" (OuterVolumeSpecName: "bundle") pod "422283f8-6d5d-4b46-8e49-f720f03b8a3c" (UID: "422283f8-6d5d-4b46-8e49-f720f03b8a3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:19:00.293696 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.293674    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/422283f8-6d5d-4b46-8e49-f720f03b8a3c-kube-api-access-gkqmb" (OuterVolumeSpecName: "kube-api-access-gkqmb") pod "422283f8-6d5d-4b46-8e49-f720f03b8a3c" (UID: "422283f8-6d5d-4b46-8e49-f720f03b8a3c"). InnerVolumeSpecName "kube-api-access-gkqmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:19:00.296089 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.296064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-util" (OuterVolumeSpecName: "util") pod "422283f8-6d5d-4b46-8e49-f720f03b8a3c" (UID: "422283f8-6d5d-4b46-8e49-f720f03b8a3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:19:00.392687 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.392652    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-util\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:19:00.392687 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.392682    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkqmb\" (UniqueName: \"kubernetes.io/projected/422283f8-6d5d-4b46-8e49-f720f03b8a3c-kube-api-access-gkqmb\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:19:00.392687 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:00.392692    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/422283f8-6d5d-4b46-8e49-f720f03b8a3c-bundle\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:19:01.028814 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:01.028775    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5" event={"ID":"422283f8-6d5d-4b46-8e49-f720f03b8a3c","Type":"ContainerDied","Data":"ff8279803a8e2841f6bad6fcf04b183380d762796ef54b428c2345b5c8890995"}
Jul 20 16:19:01.028980 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:01.028820    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crfb5"
Jul 20 16:19:01.028980 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:01.028825    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff8279803a8e2841f6bad6fcf04b183380d762796ef54b428c2345b5c8890995"
Jul 20 16:19:04.012354 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:04.012323    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 16:19:06.360227 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.360187    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"]
Jul 20 16:19:06.361729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.360549    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerName="extract"
Jul 20 16:19:06.361729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.360562    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerName="extract"
Jul 20 16:19:06.361729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.360574    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerName="util"
Jul 20 16:19:06.361729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.360580    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerName="util"
Jul 20 16:19:06.361729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.360601    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerName="pull"
Jul 20 16:19:06.361729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.360608    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerName="pull"
Jul 20 16:19:06.361729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.360673    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="422283f8-6d5d-4b46-8e49-f720f03b8a3c" containerName="extract"
Jul 20 16:19:06.362370 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.362350    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"
Jul 20 16:19:06.364944 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.364923    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 16:19:06.365065 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.364967    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 16:19:06.365065 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.364979    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4qw2p\""
Jul 20 16:19:06.375843 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.375821    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"]
Jul 20 16:19:06.438307 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.438269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5rzp\" (UniqueName: \"kubernetes.io/projected/e792bfe2-e39d-4bb7-9eba-e6c94c900382-kube-api-access-c5rzp\") pod \"cert-manager-operator-controller-manager-55c444bf86-96vs4\" (UID: \"e792bfe2-e39d-4bb7-9eba-e6c94c900382\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"
Jul 20 16:19:06.438492 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.438340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e792bfe2-e39d-4bb7-9eba-e6c94c900382-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-96vs4\" (UID: \"e792bfe2-e39d-4bb7-9eba-e6c94c900382\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"
Jul 20 16:19:06.539293 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.539255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e792bfe2-e39d-4bb7-9eba-e6c94c900382-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-96vs4\" (UID: \"e792bfe2-e39d-4bb7-9eba-e6c94c900382\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"
Jul 20 16:19:06.539497 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.539310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5rzp\" (UniqueName: \"kubernetes.io/projected/e792bfe2-e39d-4bb7-9eba-e6c94c900382-kube-api-access-c5rzp\") pod \"cert-manager-operator-controller-manager-55c444bf86-96vs4\" (UID: \"e792bfe2-e39d-4bb7-9eba-e6c94c900382\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"
Jul 20 16:19:06.539707 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.539681    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e792bfe2-e39d-4bb7-9eba-e6c94c900382-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-96vs4\" (UID: \"e792bfe2-e39d-4bb7-9eba-e6c94c900382\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"
Jul 20 16:19:06.547083 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.547054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5rzp\" (UniqueName: \"kubernetes.io/projected/e792bfe2-e39d-4bb7-9eba-e6c94c900382-kube-api-access-c5rzp\") pod \"cert-manager-operator-controller-manager-55c444bf86-96vs4\" (UID: \"e792bfe2-e39d-4bb7-9eba-e6c94c900382\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"
Jul 20 16:19:06.674695 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.674592    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"
Jul 20 16:19:06.799584 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:06.799554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4"]
Jul 20 16:19:06.803025 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:19:06.803000    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode792bfe2_e39d_4bb7_9eba_e6c94c900382.slice/crio-c4577a6196d031cb198799ae72e928ff5f4a0eb2465115ec8e92799227b5e802 WatchSource:0}: Error finding container c4577a6196d031cb198799ae72e928ff5f4a0eb2465115ec8e92799227b5e802: Status 404 returned error can't find the container with id c4577a6196d031cb198799ae72e928ff5f4a0eb2465115ec8e92799227b5e802
Jul 20 16:19:07.051040 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:07.051002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4" event={"ID":"e792bfe2-e39d-4bb7-9eba-e6c94c900382","Type":"ContainerStarted","Data":"c4577a6196d031cb198799ae72e928ff5f4a0eb2465115ec8e92799227b5e802"}
Jul 20 16:19:09.060532 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:09.060494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4" event={"ID":"e792bfe2-e39d-4bb7-9eba-e6c94c900382","Type":"ContainerStarted","Data":"46c762884edda1cf5ae9dd584d43e9267bb0ad0cf1e2d10f182161082c4a789a"}
Jul 20 16:19:09.081619 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:09.081569    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-96vs4" podStartSLOduration=1.686166941 podStartE2EDuration="3.081551212s" totalImagesPullingTime="1.395384271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:19:09.079102151 +0000 UTC m=+305.440802709" watchObservedRunningTime="2026-07-20 16:19:09.081551212 +0000 UTC m=+305.443251774"
Jul 20 16:19:10.064937 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.064908    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7skhj"]
Jul 20 16:19:10.067332 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.067313    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:10.069644 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.069625    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 16:19:10.069732 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.069624    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-w9wtf\""
Jul 20 16:19:10.070507 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.070491    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 16:19:10.081814 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.081793    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7skhj"]
Jul 20 16:19:10.170241 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.170199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a3d821c-4443-41ee-8a0c-9485fd33f78e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7skhj\" (UID: \"1a3d821c-4443-41ee-8a0c-9485fd33f78e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:10.170415 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.170278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvxvh\" (UniqueName: \"kubernetes.io/projected/1a3d821c-4443-41ee-8a0c-9485fd33f78e-kube-api-access-qvxvh\") pod \"cert-manager-webhook-6486ffd997-7skhj\" (UID: \"1a3d821c-4443-41ee-8a0c-9485fd33f78e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:10.180317 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.180282    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"]
Jul 20 16:19:10.187732 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.187700    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.190515 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.190490    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wbc96\""
Jul 20 16:19:10.190848 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.190587    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 16:19:10.191096 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.190637    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 16:19:10.192606 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.192570    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"]
Jul 20 16:19:10.271205 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.271169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a3d821c-4443-41ee-8a0c-9485fd33f78e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7skhj\" (UID: \"1a3d821c-4443-41ee-8a0c-9485fd33f78e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:10.271377 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.271227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.271377 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.271249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvxvh\" (UniqueName: \"kubernetes.io/projected/1a3d821c-4443-41ee-8a0c-9485fd33f78e-kube-api-access-qvxvh\") pod \"cert-manager-webhook-6486ffd997-7skhj\" (UID: \"1a3d821c-4443-41ee-8a0c-9485fd33f78e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:10.271377 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.271283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2b2h\" (UniqueName: \"kubernetes.io/projected/0fef761a-ad4f-41a4-ba3c-868ab3f16960-kube-api-access-j2b2h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.271377 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.271352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.280777 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.280748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a3d821c-4443-41ee-8a0c-9485fd33f78e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7skhj\" (UID: \"1a3d821c-4443-41ee-8a0c-9485fd33f78e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:10.281195 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.281171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvxvh\" (UniqueName: \"kubernetes.io/projected/1a3d821c-4443-41ee-8a0c-9485fd33f78e-kube-api-access-qvxvh\") pod \"cert-manager-webhook-6486ffd997-7skhj\" (UID: \"1a3d821c-4443-41ee-8a0c-9485fd33f78e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:10.372170 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.372069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.372170 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.372117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2b2h\" (UniqueName: \"kubernetes.io/projected/0fef761a-ad4f-41a4-ba3c-868ab3f16960-kube-api-access-j2b2h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.372354 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.372175    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.372445 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.372427    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.372489 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.372475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.385261 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.385236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2b2h\" (UniqueName: \"kubernetes.io/projected/0fef761a-ad4f-41a4-ba3c-868ab3f16960-kube-api-access-j2b2h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.389053 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.389033    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:10.498633 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.498604    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:10.515625 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.515604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7skhj"]
Jul 20 16:19:10.518175 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:19:10.518147    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a3d821c_4443_41ee_8a0c_9485fd33f78e.slice/crio-2a86bd218a0a43b813d081061fb8b8980854bb23369d6a0ea79b1c01e5ca3348 WatchSource:0}: Error finding container 2a86bd218a0a43b813d081061fb8b8980854bb23369d6a0ea79b1c01e5ca3348: Status 404 returned error can't find the container with id 2a86bd218a0a43b813d081061fb8b8980854bb23369d6a0ea79b1c01e5ca3348
Jul 20 16:19:10.520049 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.520030    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 16:19:10.623222 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:10.623200    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"]
Jul 20 16:19:10.625252 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:19:10.625229    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fef761a_ad4f_41a4_ba3c_868ab3f16960.slice/crio-fbd6d28dc290638f70e0eda60e0673b2c47560c8e750f2a5b40d5590b4d72a35 WatchSource:0}: Error finding container fbd6d28dc290638f70e0eda60e0673b2c47560c8e750f2a5b40d5590b4d72a35: Status 404 returned error can't find the container with id fbd6d28dc290638f70e0eda60e0673b2c47560c8e750f2a5b40d5590b4d72a35
Jul 20 16:19:11.068916 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:11.068879    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj" event={"ID":"1a3d821c-4443-41ee-8a0c-9485fd33f78e","Type":"ContainerStarted","Data":"2a86bd218a0a43b813d081061fb8b8980854bb23369d6a0ea79b1c01e5ca3348"}
Jul 20 16:19:11.070341 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:11.070313    2560 generic.go:356] "Generic (PLEG): container finished" podID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerID="c7741fae31dd832bdf01160c6a4beccd22cc89a83974410fe9ab3b5b67b043f3" exitCode=0
Jul 20 16:19:11.070475 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:11.070359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh" event={"ID":"0fef761a-ad4f-41a4-ba3c-868ab3f16960","Type":"ContainerDied","Data":"c7741fae31dd832bdf01160c6a4beccd22cc89a83974410fe9ab3b5b67b043f3"}
Jul 20 16:19:11.070475 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:11.070394    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh" event={"ID":"0fef761a-ad4f-41a4-ba3c-868ab3f16960","Type":"ContainerStarted","Data":"fbd6d28dc290638f70e0eda60e0673b2c47560c8e750f2a5b40d5590b4d72a35"}
Jul 20 16:19:14.085808 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:14.085766    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj" event={"ID":"1a3d821c-4443-41ee-8a0c-9485fd33f78e","Type":"ContainerStarted","Data":"7291f9e244fc0d57af8c4e2c806cd005218686c1f1f10c53acca6e6fbe72e325"}
Jul 20 16:19:14.086328 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:14.085835    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:14.087645 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:14.087583    2560 generic.go:356] "Generic (PLEG): container finished" podID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerID="53559c36effdfb7ceb342c0e360c2af68a7b92a7c236ae0a987ac448ef9a7b4f" exitCode=0
Jul 20 16:19:14.087742 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:14.087648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh" event={"ID":"0fef761a-ad4f-41a4-ba3c-868ab3f16960","Type":"ContainerDied","Data":"53559c36effdfb7ceb342c0e360c2af68a7b92a7c236ae0a987ac448ef9a7b4f"}
Jul 20 16:19:14.101573 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:14.101520    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj" podStartSLOduration=0.77932348 podStartE2EDuration="4.101504556s" totalImagesPullingTime="3.322181076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:19:14.100468899 +0000 UTC m=+310.462169463" watchObservedRunningTime="2026-07-20 16:19:14.101504556 +0000 UTC m=+310.463205118"
Jul 20 16:19:15.094178 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:15.094146    2560 generic.go:356] "Generic (PLEG): container finished" podID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerID="2c065c5c9c91b5c3492c8478c182180408e56949fda016a65ede092b3fc6a9ee" exitCode=0
Jul 20 16:19:15.094550 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:15.094229    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh" event={"ID":"0fef761a-ad4f-41a4-ba3c-868ab3f16960","Type":"ContainerDied","Data":"2c065c5c9c91b5c3492c8478c182180408e56949fda016a65ede092b3fc6a9ee"}
Jul 20 16:19:16.224173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.224147    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:16.323185 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.323153    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-bundle\") pod \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") "
Jul 20 16:19:16.323349 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.323201    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2b2h\" (UniqueName: \"kubernetes.io/projected/0fef761a-ad4f-41a4-ba3c-868ab3f16960-kube-api-access-j2b2h\") pod \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") "
Jul 20 16:19:16.323349 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.323220    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-util\") pod \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\" (UID: \"0fef761a-ad4f-41a4-ba3c-868ab3f16960\") "
Jul 20 16:19:16.323544 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.323523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-bundle" (OuterVolumeSpecName: "bundle") pod "0fef761a-ad4f-41a4-ba3c-868ab3f16960" (UID: "0fef761a-ad4f-41a4-ba3c-868ab3f16960"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:19:16.325223 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.325198    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fef761a-ad4f-41a4-ba3c-868ab3f16960-kube-api-access-j2b2h" (OuterVolumeSpecName: "kube-api-access-j2b2h") pod "0fef761a-ad4f-41a4-ba3c-868ab3f16960" (UID: "0fef761a-ad4f-41a4-ba3c-868ab3f16960"). InnerVolumeSpecName "kube-api-access-j2b2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:19:16.327690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.327651    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-util" (OuterVolumeSpecName: "util") pod "0fef761a-ad4f-41a4-ba3c-868ab3f16960" (UID: "0fef761a-ad4f-41a4-ba3c-868ab3f16960"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:19:16.424261 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.424175    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-bundle\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:19:16.424261 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.424206    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2b2h\" (UniqueName: \"kubernetes.io/projected/0fef761a-ad4f-41a4-ba3c-868ab3f16960-kube-api-access-j2b2h\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:19:16.424261 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:16.424217    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fef761a-ad4f-41a4-ba3c-868ab3f16960-util\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:19:17.104141 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:17.104086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh" event={"ID":"0fef761a-ad4f-41a4-ba3c-868ab3f16960","Type":"ContainerDied","Data":"fbd6d28dc290638f70e0eda60e0673b2c47560c8e750f2a5b40d5590b4d72a35"}
Jul 20 16:19:17.104141 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:17.104115    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrckh"
Jul 20 16:19:17.104351 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:17.104158    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbd6d28dc290638f70e0eda60e0673b2c47560c8e750f2a5b40d5590b4d72a35"
Jul 20 16:19:20.096494 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:20.096468    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7skhj"
Jul 20 16:19:22.573325 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.573286    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v5sj8"]
Jul 20 16:19:22.573895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.573691    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerName="util"
Jul 20 16:19:22.573895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.573724    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerName="util"
Jul 20 16:19:22.573895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.573747    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerName="extract"
Jul 20 16:19:22.573895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.573756    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerName="extract"
Jul 20 16:19:22.573895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.573777    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerName="pull"
Jul 20 16:19:22.573895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.573787    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerName="pull"
Jul 20 16:19:22.573895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.573856    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fef761a-ad4f-41a4-ba3c-868ab3f16960" containerName="extract"
Jul 20 16:19:22.577197 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.577174    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v5sj8"
Jul 20 16:19:22.579437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.579414    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c6dg2\""
Jul 20 16:19:22.585584 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.585561    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v5sj8"]
Jul 20 16:19:22.674520 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.674475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5k52\" (UniqueName: \"kubernetes.io/projected/d48ea1ea-21d8-4246-a09d-3e33be270a1e-kube-api-access-j5k52\") pod \"cert-manager-55b4d954d5-v5sj8\" (UID: \"d48ea1ea-21d8-4246-a09d-3e33be270a1e\") " pod="cert-manager/cert-manager-55b4d954d5-v5sj8"
Jul 20 16:19:22.674711 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.674575    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d48ea1ea-21d8-4246-a09d-3e33be270a1e-bound-sa-token\") pod \"cert-manager-55b4d954d5-v5sj8\" (UID: \"d48ea1ea-21d8-4246-a09d-3e33be270a1e\") " pod="cert-manager/cert-manager-55b4d954d5-v5sj8"
Jul 20 16:19:22.775883 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.775828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d48ea1ea-21d8-4246-a09d-3e33be270a1e-bound-sa-token\") pod \"cert-manager-55b4d954d5-v5sj8\" (UID: \"d48ea1ea-21d8-4246-a09d-3e33be270a1e\") " pod="cert-manager/cert-manager-55b4d954d5-v5sj8"
Jul 20 16:19:22.776074 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.775932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5k52\" (UniqueName: \"kubernetes.io/projected/d48ea1ea-21d8-4246-a09d-3e33be270a1e-kube-api-access-j5k52\") pod \"cert-manager-55b4d954d5-v5sj8\" (UID: \"d48ea1ea-21d8-4246-a09d-3e33be270a1e\") " pod="cert-manager/cert-manager-55b4d954d5-v5sj8"
Jul 20 16:19:22.783641 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.783615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d48ea1ea-21d8-4246-a09d-3e33be270a1e-bound-sa-token\") pod \"cert-manager-55b4d954d5-v5sj8\" (UID: \"d48ea1ea-21d8-4246-a09d-3e33be270a1e\") " pod="cert-manager/cert-manager-55b4d954d5-v5sj8"
Jul 20 16:19:22.783773 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.783763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5k52\" (UniqueName: \"kubernetes.io/projected/d48ea1ea-21d8-4246-a09d-3e33be270a1e-kube-api-access-j5k52\") pod \"cert-manager-55b4d954d5-v5sj8\" (UID: \"d48ea1ea-21d8-4246-a09d-3e33be270a1e\") " pod="cert-manager/cert-manager-55b4d954d5-v5sj8"
Jul 20 16:19:22.886631 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:22.886549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v5sj8"
Jul 20 16:19:23.017467 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.017446    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v5sj8"]
Jul 20 16:19:23.020003 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:19:23.019964    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd48ea1ea_21d8_4246_a09d_3e33be270a1e.slice/crio-da080063cb63548d0776fbdbb916597e843b6aac7486c8b23b825230faf073ea WatchSource:0}: Error finding container da080063cb63548d0776fbdbb916597e843b6aac7486c8b23b825230faf073ea: Status 404 returned error can't find the container with id da080063cb63548d0776fbdbb916597e843b6aac7486c8b23b825230faf073ea
Jul 20 16:19:23.130476 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.130442    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"]
Jul 20 16:19:23.133663 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.133639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v5sj8" event={"ID":"d48ea1ea-21d8-4246-a09d-3e33be270a1e","Type":"ContainerStarted","Data":"0a069c62d8a60f5971e8c01f007790add3c197c66c4b8bc6429a356b7e948f38"}
Jul 20 16:19:23.133663 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.133664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v5sj8" event={"ID":"d48ea1ea-21d8-4246-a09d-3e33be270a1e","Type":"ContainerStarted","Data":"da080063cb63548d0776fbdbb916597e843b6aac7486c8b23b825230faf073ea"}
Jul 20 16:19:23.133825 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.133747    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"
Jul 20 16:19:23.135699 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.135675    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q2fjn\""
Jul 20 16:19:23.135819 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.135783    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 16:19:23.135819 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.135794    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 16:19:23.144568 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.144545    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"]
Jul 20 16:19:23.147243 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.147204    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-v5sj8" podStartSLOduration=1.147190267 podStartE2EDuration="1.147190267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:19:23.145794936 +0000 UTC m=+319.507495509" watchObservedRunningTime="2026-07-20 16:19:23.147190267 +0000 UTC m=+319.508890830"
Jul 20 16:19:23.280079 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.280035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a0d8f26-03d4-4581-ab29-6c352faf0518-tmp\") pod \"openshift-lws-operator-fd8ccff4c-njn6r\" (UID: \"3a0d8f26-03d4-4581-ab29-6c352faf0518\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"
Jul 20 16:19:23.280281 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.280103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp26p\" (UniqueName: \"kubernetes.io/projected/3a0d8f26-03d4-4581-ab29-6c352faf0518-kube-api-access-kp26p\") pod \"openshift-lws-operator-fd8ccff4c-njn6r\" (UID: \"3a0d8f26-03d4-4581-ab29-6c352faf0518\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"
Jul 20 16:19:23.380978 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.380945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a0d8f26-03d4-4581-ab29-6c352faf0518-tmp\") pod \"openshift-lws-operator-fd8ccff4c-njn6r\" (UID: \"3a0d8f26-03d4-4581-ab29-6c352faf0518\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"
Jul 20 16:19:23.381169 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.380993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp26p\" (UniqueName: \"kubernetes.io/projected/3a0d8f26-03d4-4581-ab29-6c352faf0518-kube-api-access-kp26p\") pod \"openshift-lws-operator-fd8ccff4c-njn6r\" (UID: \"3a0d8f26-03d4-4581-ab29-6c352faf0518\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"
Jul 20 16:19:23.381362 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.381343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a0d8f26-03d4-4581-ab29-6c352faf0518-tmp\") pod \"openshift-lws-operator-fd8ccff4c-njn6r\" (UID: \"3a0d8f26-03d4-4581-ab29-6c352faf0518\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"
Jul 20 16:19:23.390299 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.390240    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp26p\" (UniqueName: \"kubernetes.io/projected/3a0d8f26-03d4-4581-ab29-6c352faf0518-kube-api-access-kp26p\") pod \"openshift-lws-operator-fd8ccff4c-njn6r\" (UID: \"3a0d8f26-03d4-4581-ab29-6c352faf0518\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"
Jul 20 16:19:23.443324 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.443296    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"
Jul 20 16:19:23.579580 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:23.579498    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r"]
Jul 20 16:19:23.581649 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:19:23.581626    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a0d8f26_03d4_4581_ab29_6c352faf0518.slice/crio-84e9aab4a2df9e2d11ae700b7bffb4d8281fcdacf669af00bd411df3a64750cf WatchSource:0}: Error finding container 84e9aab4a2df9e2d11ae700b7bffb4d8281fcdacf669af00bd411df3a64750cf: Status 404 returned error can't find the container with id 84e9aab4a2df9e2d11ae700b7bffb4d8281fcdacf669af00bd411df3a64750cf
Jul 20 16:19:24.138719 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:24.138673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r" event={"ID":"3a0d8f26-03d4-4581-ab29-6c352faf0518","Type":"ContainerStarted","Data":"84e9aab4a2df9e2d11ae700b7bffb4d8281fcdacf669af00bd411df3a64750cf"}
Jul 20 16:19:26.148872 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:26.148836    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r" event={"ID":"3a0d8f26-03d4-4581-ab29-6c352faf0518","Type":"ContainerStarted","Data":"1440da11914f3a38dc85ba8de4468cbaabc93043d3e2e7394e264a37b06e1cfe"}
Jul 20 16:19:26.164248 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:26.164203    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-njn6r" podStartSLOduration=1.365311362 podStartE2EDuration="3.16418723s" totalImagesPullingTime="1.798875868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:19:26.162712675 +0000 UTC m=+322.524413248" watchObservedRunningTime="2026-07-20 16:19:26.16418723 +0000 UTC m=+322.525887793"
Jul 20 16:19:30.147467 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.147432    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"]
Jul 20 16:19:30.165552 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.165526    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"]
Jul 20 16:19:30.165699 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.165619    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.168083 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.168058    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 16:19:30.168226 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.168086    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 16:19:30.168978 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.168956    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wbc96\""
Jul 20 16:19:30.344684 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.344645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.344684 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.344684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.344898 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.344719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbns6\" (UniqueName: \"kubernetes.io/projected/ef7210f3-d02c-4936-9263-4967dd5e721f-kube-api-access-gbns6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.446189 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.446100    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.446189 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.446152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.446382 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.446198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbns6\" (UniqueName: \"kubernetes.io/projected/ef7210f3-d02c-4936-9263-4967dd5e721f-kube-api-access-gbns6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.446488 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.446470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.446529 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.446491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.454476 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.454453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbns6\" (UniqueName: \"kubernetes.io/projected/ef7210f3-d02c-4936-9263-4967dd5e721f-kube-api-access-gbns6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.475427 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.475403    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:30.623023 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:30.623000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"]
Jul 20 16:19:30.625242 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:19:30.625211    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7210f3_d02c_4936_9263_4967dd5e721f.slice/crio-3b05c95349bf025dca2c4fea604940242fb08ab87dda014469c9a4a239955ade WatchSource:0}: Error finding container 3b05c95349bf025dca2c4fea604940242fb08ab87dda014469c9a4a239955ade: Status 404 returned error can't find the container with id 3b05c95349bf025dca2c4fea604940242fb08ab87dda014469c9a4a239955ade
Jul 20 16:19:31.170897 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:31.170864    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerID="7a54afbe46bce88db6074ab63d5d211aab4b4240aa141e314c990ee00c1f7227" exitCode=0
Jul 20 16:19:31.171388 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:31.170956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg" event={"ID":"ef7210f3-d02c-4936-9263-4967dd5e721f","Type":"ContainerDied","Data":"7a54afbe46bce88db6074ab63d5d211aab4b4240aa141e314c990ee00c1f7227"}
Jul 20 16:19:31.171388 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:31.171039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg" event={"ID":"ef7210f3-d02c-4936-9263-4967dd5e721f","Type":"ContainerStarted","Data":"3b05c95349bf025dca2c4fea604940242fb08ab87dda014469c9a4a239955ade"}
Jul 20 16:19:32.176339 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:32.176302    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerID="76e7ff17d589b0b6e4b832ea896bac83281c680ed6a76373259a1487d59562cc" exitCode=0
Jul 20 16:19:32.176748 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:32.176348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg" event={"ID":"ef7210f3-d02c-4936-9263-4967dd5e721f","Type":"ContainerDied","Data":"76e7ff17d589b0b6e4b832ea896bac83281c680ed6a76373259a1487d59562cc"}
Jul 20 16:19:33.182511 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:33.182477    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerID="776e3182b6e48ff54a0139c5eab4aa91fb0bb1175d6b2aafbc594c5a44a34db2" exitCode=0
Jul 20 16:19:33.182962 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:33.182560    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg" event={"ID":"ef7210f3-d02c-4936-9263-4967dd5e721f","Type":"ContainerDied","Data":"776e3182b6e48ff54a0139c5eab4aa91fb0bb1175d6b2aafbc594c5a44a34db2"}
Jul 20 16:19:34.314499 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.314475    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:34.376072 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.376039    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-util\") pod \"ef7210f3-d02c-4936-9263-4967dd5e721f\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") "
Jul 20 16:19:34.376237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.376088    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-bundle\") pod \"ef7210f3-d02c-4936-9263-4967dd5e721f\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") "
Jul 20 16:19:34.376237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.376151    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbns6\" (UniqueName: \"kubernetes.io/projected/ef7210f3-d02c-4936-9263-4967dd5e721f-kube-api-access-gbns6\") pod \"ef7210f3-d02c-4936-9263-4967dd5e721f\" (UID: \"ef7210f3-d02c-4936-9263-4967dd5e721f\") "
Jul 20 16:19:34.376813 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.376786    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-bundle" (OuterVolumeSpecName: "bundle") pod "ef7210f3-d02c-4936-9263-4967dd5e721f" (UID: "ef7210f3-d02c-4936-9263-4967dd5e721f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:19:34.378259 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.378236    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7210f3-d02c-4936-9263-4967dd5e721f-kube-api-access-gbns6" (OuterVolumeSpecName: "kube-api-access-gbns6") pod "ef7210f3-d02c-4936-9263-4967dd5e721f" (UID: "ef7210f3-d02c-4936-9263-4967dd5e721f"). InnerVolumeSpecName "kube-api-access-gbns6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:19:34.381820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.381800    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-util" (OuterVolumeSpecName: "util") pod "ef7210f3-d02c-4936-9263-4967dd5e721f" (UID: "ef7210f3-d02c-4936-9263-4967dd5e721f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:19:34.476974 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.476898    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-util\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:19:34.476974 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.476923    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7210f3-d02c-4936-9263-4967dd5e721f-bundle\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:19:34.476974 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:34.476932    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbns6\" (UniqueName: \"kubernetes.io/projected/ef7210f3-d02c-4936-9263-4967dd5e721f-kube-api-access-gbns6\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:19:35.192502 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:35.192468    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg"
Jul 20 16:19:35.192502 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:35.192487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdrzgg" event={"ID":"ef7210f3-d02c-4936-9263-4967dd5e721f","Type":"ContainerDied","Data":"3b05c95349bf025dca2c4fea604940242fb08ab87dda014469c9a4a239955ade"}
Jul 20 16:19:35.192719 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:35.192535    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b05c95349bf025dca2c4fea604940242fb08ab87dda014469c9a4a239955ade"
Jul 20 16:19:41.880605 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.880575    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"]
Jul 20 16:19:41.880988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.880842    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerName="util"
Jul 20 16:19:41.880988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.880853    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerName="util"
Jul 20 16:19:41.880988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.880860    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerName="pull"
Jul 20 16:19:41.880988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.880865    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerName="pull"
Jul 20 16:19:41.880988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.880876    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerName="extract"
Jul 20 16:19:41.880988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.880882    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerName="extract"
Jul 20 16:19:41.880988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.880936    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7210f3-d02c-4936-9263-4967dd5e721f" containerName="extract"
Jul 20 16:19:41.883680 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.883661    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:41.886229 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.886210    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 16:19:41.886484 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.886470    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 16:19:41.886674 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.886661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xzk42\""
Jul 20 16:19:41.887006 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.886982    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 16:19:41.887157 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.887112    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 16:19:41.907684 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.907659    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"]
Jul 20 16:19:41.938286 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.938255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa2ad733-3093-4e94-b6c7-4743804b7ab7-manifests\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:41.938443 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.938300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa2ad733-3093-4e94-b6c7-4743804b7ab7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:41.938443 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.938322    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa2ad733-3093-4e94-b6c7-4743804b7ab7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:41.938443 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.938395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa2ad733-3093-4e94-b6c7-4743804b7ab7-tmp\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:41.938443 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:41.938432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5b2p\" (UniqueName: \"kubernetes.io/projected/fa2ad733-3093-4e94-b6c7-4743804b7ab7-kube-api-access-f5b2p\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.039283 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.039244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa2ad733-3093-4e94-b6c7-4743804b7ab7-tmp\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.039283 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.039289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5b2p\" (UniqueName: \"kubernetes.io/projected/fa2ad733-3093-4e94-b6c7-4743804b7ab7-kube-api-access-f5b2p\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.039504 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.039312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa2ad733-3093-4e94-b6c7-4743804b7ab7-manifests\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.039504 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.039344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa2ad733-3093-4e94-b6c7-4743804b7ab7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.039504 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.039363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa2ad733-3093-4e94-b6c7-4743804b7ab7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.039752 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.039728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa2ad733-3093-4e94-b6c7-4743804b7ab7-manifests\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.041776 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.041752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa2ad733-3093-4e94-b6c7-4743804b7ab7-tmp\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.041862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.041842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa2ad733-3093-4e94-b6c7-4743804b7ab7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.041900 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.041871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa2ad733-3093-4e94-b6c7-4743804b7ab7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.046421 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.046401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5b2p\" (UniqueName: \"kubernetes.io/projected/fa2ad733-3093-4e94-b6c7-4743804b7ab7-kube-api-access-f5b2p\") pod \"opendatahub-operator-controller-manager-6bbb748554-4ph5k\" (UID: \"fa2ad733-3093-4e94-b6c7-4743804b7ab7\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.194150 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.194048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:42.349252 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:42.349223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"]
Jul 20 16:19:42.350913 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:19:42.350878    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2ad733_3093_4e94_b6c7_4743804b7ab7.slice/crio-3b03b7d653df08278d4e3ac14dab58c23109a05f034feae3ed6d9b3739ce81e6 WatchSource:0}: Error finding container 3b03b7d653df08278d4e3ac14dab58c23109a05f034feae3ed6d9b3739ce81e6: Status 404 returned error can't find the container with id 3b03b7d653df08278d4e3ac14dab58c23109a05f034feae3ed6d9b3739ce81e6
Jul 20 16:19:43.228103 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:43.228060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k" event={"ID":"fa2ad733-3093-4e94-b6c7-4743804b7ab7","Type":"ContainerStarted","Data":"3b03b7d653df08278d4e3ac14dab58c23109a05f034feae3ed6d9b3739ce81e6"}
Jul 20 16:19:46.245039 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:46.244994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k" event={"ID":"fa2ad733-3093-4e94-b6c7-4743804b7ab7","Type":"ContainerStarted","Data":"efe1b0d431e8623dff8feb4571144f1ee2b8351bb1a30117cc77553460fc3ffa"}
Jul 20 16:19:47.251113 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:47.251076    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa2ad733-3093-4e94-b6c7-4743804b7ab7" containerID="efe1b0d431e8623dff8feb4571144f1ee2b8351bb1a30117cc77553460fc3ffa" exitCode=0
Jul 20 16:19:47.251502 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:47.251141    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k" event={"ID":"fa2ad733-3093-4e94-b6c7-4743804b7ab7","Type":"ContainerDied","Data":"efe1b0d431e8623dff8feb4571144f1ee2b8351bb1a30117cc77553460fc3ffa"}
Jul 20 16:19:48.257547 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:48.257512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k" event={"ID":"fa2ad733-3093-4e94-b6c7-4743804b7ab7","Type":"ContainerStarted","Data":"d05cb777ff36c2a4a5529386ae4469df7b3551cfeccc97ed52dc3d0cbe606ba7"}
Jul 20 16:19:48.257942 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:48.257597    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:48.279743 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:48.279692    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k" podStartSLOduration=2.917195298 podStartE2EDuration="7.27967778s" totalImagesPullingTime="3.264929042s" totalInitContainerRuntime="1.09755344s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:19:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:19:48.278064965 +0000 UTC m=+344.639765528" watchObservedRunningTime="2026-07-20 16:19:48.27967778 +0000 UTC m=+344.641378343"
Jul 20 16:19:59.263575 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.263499    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-4ph5k"
Jul 20 16:19:59.730086 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.730046    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"]
Jul 20 16:19:59.734046 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.734023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.737267 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.737243    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 16:19:59.737457 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.737443    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 16:19:59.737642 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.737623    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 16:19:59.738336 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.738321    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w4fl7\""
Jul 20 16:19:59.745551 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.745523    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"]
Jul 20 16:19:59.789257 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.789228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac120eb3-d205-4bff-8366-72e06a0dbdf9-metrics-cert\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.789387 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.789293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87glr\" (UniqueName: \"kubernetes.io/projected/ac120eb3-d205-4bff-8366-72e06a0dbdf9-kube-api-access-87glr\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.789387 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.789371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac120eb3-d205-4bff-8366-72e06a0dbdf9-cert\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.789459 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.789412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac120eb3-d205-4bff-8366-72e06a0dbdf9-manager-config\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.890138 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.890091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87glr\" (UniqueName: \"kubernetes.io/projected/ac120eb3-d205-4bff-8366-72e06a0dbdf9-kube-api-access-87glr\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.890282 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.890146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac120eb3-d205-4bff-8366-72e06a0dbdf9-cert\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.890282 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.890168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac120eb3-d205-4bff-8366-72e06a0dbdf9-manager-config\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.890282 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.890191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac120eb3-d205-4bff-8366-72e06a0dbdf9-metrics-cert\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.890880 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.890855    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac120eb3-d205-4bff-8366-72e06a0dbdf9-manager-config\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.892732 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.892709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac120eb3-d205-4bff-8366-72e06a0dbdf9-metrics-cert\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.892819 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.892715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac120eb3-d205-4bff-8366-72e06a0dbdf9-cert\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:19:59.897869 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:19:59.897841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87glr\" (UniqueName: \"kubernetes.io/projected/ac120eb3-d205-4bff-8366-72e06a0dbdf9-kube-api-access-87glr\") pod \"lws-controller-manager-7797c4479d-xg69d\" (UID: \"ac120eb3-d205-4bff-8366-72e06a0dbdf9\") " pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:20:00.045467 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:00.045439    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:20:00.171121 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:00.171094    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"]
Jul 20 16:20:00.173055 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:20:00.173028    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac120eb3_d205_4bff_8366_72e06a0dbdf9.slice/crio-d7a5da1df6b71b41ae8757565713d1f76dfd144f8748ce002d88252255279a73 WatchSource:0}: Error finding container d7a5da1df6b71b41ae8757565713d1f76dfd144f8748ce002d88252255279a73: Status 404 returned error can't find the container with id d7a5da1df6b71b41ae8757565713d1f76dfd144f8748ce002d88252255279a73
Jul 20 16:20:00.312071 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:00.311975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d" event={"ID":"ac120eb3-d205-4bff-8366-72e06a0dbdf9","Type":"ContainerStarted","Data":"d7a5da1df6b71b41ae8757565713d1f76dfd144f8748ce002d88252255279a73"}
Jul 20 16:20:02.324312 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:02.324277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d" event={"ID":"ac120eb3-d205-4bff-8366-72e06a0dbdf9","Type":"ContainerStarted","Data":"ad33e31613cc762441b40f877227fa5baeacd075da5ce8832e64ddf570ccacff"}
Jul 20 16:20:02.324719 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:02.324414    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:20:02.360570 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:02.360518    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d" podStartSLOduration=1.892308766 podStartE2EDuration="3.360503339s" totalImagesPullingTime="1.468194573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:20:02.358243488 +0000 UTC m=+358.719944053" watchObservedRunningTime="2026-07-20 16:20:02.360503339 +0000 UTC m=+358.722203902"
Jul 20 16:20:10.258952 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.258914    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"]
Jul 20 16:20:10.265537 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.265508    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.267881 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.267856    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 16:20:10.268023 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.267862    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 16:20:10.268023 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.267862    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 16:20:10.268023 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.267888    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 16:20:10.268262 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.268242    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 16:20:10.268346 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.268329    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qd7x5\""
Jul 20 16:20:10.268726 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.268713    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 16:20:10.274926 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.274905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"]
Jul 20 16:20:10.380047 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.380018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8k2c\" (UniqueName: \"kubernetes.io/projected/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-kube-api-access-q8k2c\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.380047 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.380050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.380288 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.380073    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.380288 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.380090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.380288 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.380154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.380288 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.380179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.380288 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.380223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.481566 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.481531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.481725 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.481576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8k2c\" (UniqueName: \"kubernetes.io/projected/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-kube-api-access-q8k2c\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.481725 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.481627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.481725 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.481661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.481882 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.481767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.481882 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.481811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.481882 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.481859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.482539 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.482512    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.483880 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.483856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.484095 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.484078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.484219 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.484198    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.484278 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.484245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.496845 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.496811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.498895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.498874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8k2c\" (UniqueName: \"kubernetes.io/projected/f4be2a34-6dcf-4e89-ae7c-549d08cae6e7-kube-api-access-q8k2c\") pod \"istiod-openshift-gateway-94bb8fbfd-x5hpt\" (UID: \"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.575380 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.575350    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:10.714768 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:10.714742    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"]
Jul 20 16:20:10.716757 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:20:10.716725    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4be2a34_6dcf_4e89_ae7c_549d08cae6e7.slice/crio-f9116df2e01d1199e1e6256c8a6f21d0d707f5b8dff279233e1487a8e08cdfb3 WatchSource:0}: Error finding container f9116df2e01d1199e1e6256c8a6f21d0d707f5b8dff279233e1487a8e08cdfb3: Status 404 returned error can't find the container with id f9116df2e01d1199e1e6256c8a6f21d0d707f5b8dff279233e1487a8e08cdfb3
Jul 20 16:20:11.366749 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:11.366708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt" event={"ID":"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7","Type":"ContainerStarted","Data":"f9116df2e01d1199e1e6256c8a6f21d0d707f5b8dff279233e1487a8e08cdfb3"}
Jul 20 16:20:13.332505 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:13.332477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7797c4479d-xg69d"
Jul 20 16:20:13.364034 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:13.363994    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 16:20:13.364164 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:13.364064    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 16:20:14.382720 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:14.382684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt" event={"ID":"f4be2a34-6dcf-4e89-ae7c-549d08cae6e7","Type":"ContainerStarted","Data":"f484b727b54a6940e7d7af0a93f9344d112f0a441b362e4d34f8419ccfb1a286"}
Jul 20 16:20:14.383164 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:14.383001    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:14.384685 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:14.384662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt"
Jul 20 16:20:14.405190 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:20:14.405118    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x5hpt" podStartSLOduration=1.760099885 podStartE2EDuration="4.405104064s" totalImagesPullingTime="2.645004179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:20:14.40359958 +0000 UTC m=+370.765300144" watchObservedRunningTime="2026-07-20 16:20:14.405104064 +0000 UTC m=+370.766804627"
Jul 20 16:21:18.697715 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.697676    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"]
Jul 20 16:21:18.700504 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.700485    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:18.702876 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.702848    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 16:21:18.703816 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.703795    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 16:21:18.704029 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.704010    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nc4th\""
Jul 20 16:21:18.712401 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.712378    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"]
Jul 20 16:21:18.836118 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.836082    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"]
Jul 20 16:21:18.839104 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.839081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:18.841540 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.841517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8ssc\" (UniqueName: \"kubernetes.io/projected/36b97d55-8e41-43e9-8204-c4baca9d3e98-kube-api-access-j8ssc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:18.841651 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.841556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:18.841651 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.841589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:18.848308 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.848285    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"]
Jul 20 16:21:18.942431 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.942396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8ssc\" (UniqueName: \"kubernetes.io/projected/36b97d55-8e41-43e9-8204-c4baca9d3e98-kube-api-access-j8ssc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:18.942609 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.942440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:18.942609 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.942472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:18.942609 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.942514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmfjl\" (UniqueName: \"kubernetes.io/projected/21fdd515-674a-465c-baac-dabbde144bcb-kube-api-access-cmfjl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:18.942609 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.942564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:18.942782 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.942651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:18.942822 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.942786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:18.942822 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.942809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:18.950470 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:18.950408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8ssc\" (UniqueName: \"kubernetes.io/projected/36b97d55-8e41-43e9-8204-c4baca9d3e98-kube-api-access-j8ssc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:19.009499 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.009463    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:19.038810 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.038771    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"]
Jul 20 16:21:19.041513 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.041490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.043836 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.043797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:19.043972 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.043853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:19.043972 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.043922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmfjl\" (UniqueName: \"kubernetes.io/projected/21fdd515-674a-465c-baac-dabbde144bcb-kube-api-access-cmfjl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:19.044218 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.044200    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:19.044294 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.044270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:19.050600 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.050572    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"]
Jul 20 16:21:19.052565 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.052540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmfjl\" (UniqueName: \"kubernetes.io/projected/21fdd515-674a-465c-baac-dabbde144bcb-kube-api-access-cmfjl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:19.144789 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.144749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7q7q\" (UniqueName: \"kubernetes.io/projected/94fb34cd-7926-46ff-9c62-c86d9dd3a775-kube-api-access-w7q7q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.145058 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.144875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.145058 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.144962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.146600 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.146502    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"]
Jul 20 16:21:19.148999 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:21:19.148970    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b97d55_8e41_43e9_8204_c4baca9d3e98.slice/crio-c8c78411acd00db110649a663c7547fc656f4391a888718f45b35c91e487341f WatchSource:0}: Error finding container c8c78411acd00db110649a663c7547fc656f4391a888718f45b35c91e487341f: Status 404 returned error can't find the container with id c8c78411acd00db110649a663c7547fc656f4391a888718f45b35c91e487341f
Jul 20 16:21:19.149096 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.149040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:19.245809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.245765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.245976 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.245827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7q7q\" (UniqueName: \"kubernetes.io/projected/94fb34cd-7926-46ff-9c62-c86d9dd3a775-kube-api-access-w7q7q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.245976 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.245969    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.246302 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.246277    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.246388 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.246371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.254783 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.254748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7q7q\" (UniqueName: \"kubernetes.io/projected/94fb34cd-7926-46ff-9c62-c86d9dd3a775-kube-api-access-w7q7q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.281951 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.281926    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"]
Jul 20 16:21:19.290075 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:21:19.290041    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fdd515_674a_465c_baac_dabbde144bcb.slice/crio-f3e3add455414ab5176568b4901b5ab9f19045989ac8238c16bf782249f15d72 WatchSource:0}: Error finding container f3e3add455414ab5176568b4901b5ab9f19045989ac8238c16bf782249f15d72: Status 404 returned error can't find the container with id f3e3add455414ab5176568b4901b5ab9f19045989ac8238c16bf782249f15d72
Jul 20 16:21:19.352403 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.352382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:19.490887 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.490816    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"]
Jul 20 16:21:19.493863 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:21:19.493833    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fb34cd_7926_46ff_9c62_c86d9dd3a775.slice/crio-cf1403ddbc7ab9c7125c29a49256eb133079b48dc5668af7758265f260933673 WatchSource:0}: Error finding container cf1403ddbc7ab9c7125c29a49256eb133079b48dc5668af7758265f260933673: Status 404 returned error can't find the container with id cf1403ddbc7ab9c7125c29a49256eb133079b48dc5668af7758265f260933673
Jul 20 16:21:19.668539 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.668510    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"]
Jul 20 16:21:19.669610 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.669584    2560 generic.go:356] "Generic (PLEG): container finished" podID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerID="ed8e227291cefdfecf1ca967e7dddef112c30fa6d9ae884140e91b54f37a47a4" exitCode=0
Jul 20 16:21:19.671326 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.671304    2560 generic.go:356] "Generic (PLEG): container finished" podID="21fdd515-674a-465c-baac-dabbde144bcb" containerID="63bc2680e28debe3fb99f6733b903916afb973c3d340762d7c5482902ebe8f36" exitCode=0
Jul 20 16:21:19.671853 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.671830    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5" event={"ID":"94fb34cd-7926-46ff-9c62-c86d9dd3a775","Type":"ContainerDied","Data":"ed8e227291cefdfecf1ca967e7dddef112c30fa6d9ae884140e91b54f37a47a4"}
Jul 20 16:21:19.671941 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.671870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5" event={"ID":"94fb34cd-7926-46ff-9c62-c86d9dd3a775","Type":"ContainerStarted","Data":"cf1403ddbc7ab9c7125c29a49256eb133079b48dc5668af7758265f260933673"}
Jul 20 16:21:19.671941 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.671891    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd" event={"ID":"21fdd515-674a-465c-baac-dabbde144bcb","Type":"ContainerDied","Data":"63bc2680e28debe3fb99f6733b903916afb973c3d340762d7c5482902ebe8f36"}
Jul 20 16:21:19.671941 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.671915    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd" event={"ID":"21fdd515-674a-465c-baac-dabbde144bcb","Type":"ContainerStarted","Data":"f3e3add455414ab5176568b4901b5ab9f19045989ac8238c16bf782249f15d72"}
Jul 20 16:21:19.672100 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.671998    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.673775 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.673706    2560 generic.go:356] "Generic (PLEG): container finished" podID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerID="fe272a01608b7057d040813645916974e90a885c055b3c1b301eb2631dd07e61" exitCode=0
Jul 20 16:21:19.673775 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.673743    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2" event={"ID":"36b97d55-8e41-43e9-8204-c4baca9d3e98","Type":"ContainerDied","Data":"fe272a01608b7057d040813645916974e90a885c055b3c1b301eb2631dd07e61"}
Jul 20 16:21:19.673891 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.673828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2" event={"ID":"36b97d55-8e41-43e9-8204-c4baca9d3e98","Type":"ContainerStarted","Data":"c8c78411acd00db110649a663c7547fc656f4391a888718f45b35c91e487341f"}
Jul 20 16:21:19.684647 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.684623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"]
Jul 20 16:21:19.850743 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.850714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.851176 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.850782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4xqt\" (UniqueName: \"kubernetes.io/projected/e4c58a20-5650-4300-8b23-737afb523913-kube-api-access-v4xqt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.851176 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.850849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.951961 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.951924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.952117 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.951985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.952117 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.952020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4xqt\" (UniqueName: \"kubernetes.io/projected/e4c58a20-5650-4300-8b23-737afb523913-kube-api-access-v4xqt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.952440 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.952417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.952485 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.952461    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.960344 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.960312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4xqt\" (UniqueName: \"kubernetes.io/projected/e4c58a20-5650-4300-8b23-737afb523913-kube-api-access-v4xqt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:19.985189 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:19.985160    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:20.116380 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.116358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"]
Jul 20 16:21:20.117948 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:21:20.117920    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c58a20_5650_4300_8b23_737afb523913.slice/crio-eef4f4d9c76c79aff9e8be8fe744ae00ce591cb9457516e803dac5eaf3bf9a5f WatchSource:0}: Error finding container eef4f4d9c76c79aff9e8be8fe744ae00ce591cb9457516e803dac5eaf3bf9a5f: Status 404 returned error can't find the container with id eef4f4d9c76c79aff9e8be8fe744ae00ce591cb9457516e803dac5eaf3bf9a5f
Jul 20 16:21:20.680051 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.680012    2560 generic.go:356] "Generic (PLEG): container finished" podID="21fdd515-674a-465c-baac-dabbde144bcb" containerID="9b980acbcc58064bb9a6f6b1ac0b3fa65ff0cee66fa8d7d851878c0a6ad7c355" exitCode=0
Jul 20 16:21:20.680228 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.680094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd" event={"ID":"21fdd515-674a-465c-baac-dabbde144bcb","Type":"ContainerDied","Data":"9b980acbcc58064bb9a6f6b1ac0b3fa65ff0cee66fa8d7d851878c0a6ad7c355"}
Jul 20 16:21:20.681930 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.681899    2560 generic.go:356] "Generic (PLEG): container finished" podID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerID="8137e5b3728160253e7a469efbbfe4ca306ced853d008e76e29a76f6f1ab6d52" exitCode=0
Jul 20 16:21:20.682031 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.681980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2" event={"ID":"36b97d55-8e41-43e9-8204-c4baca9d3e98","Type":"ContainerDied","Data":"8137e5b3728160253e7a469efbbfe4ca306ced853d008e76e29a76f6f1ab6d52"}
Jul 20 16:21:20.683929 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.683894    2560 generic.go:356] "Generic (PLEG): container finished" podID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerID="f511efd39cae4843ad5f2ff142c0c7ead4d9a2a0faf671ebd699977d89069098" exitCode=0
Jul 20 16:21:20.684422 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.684275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5" event={"ID":"94fb34cd-7926-46ff-9c62-c86d9dd3a775","Type":"ContainerDied","Data":"f511efd39cae4843ad5f2ff142c0c7ead4d9a2a0faf671ebd699977d89069098"}
Jul 20 16:21:20.685798 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.685775    2560 generic.go:356] "Generic (PLEG): container finished" podID="e4c58a20-5650-4300-8b23-737afb523913" containerID="5dd70d0c7959185405b9b57670eb8688636cba4ccf7203fa5871e8e1169b5123" exitCode=0
Jul 20 16:21:20.685901 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.685834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv" event={"ID":"e4c58a20-5650-4300-8b23-737afb523913","Type":"ContainerDied","Data":"5dd70d0c7959185405b9b57670eb8688636cba4ccf7203fa5871e8e1169b5123"}
Jul 20 16:21:20.685901 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:20.685878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv" event={"ID":"e4c58a20-5650-4300-8b23-737afb523913","Type":"ContainerStarted","Data":"eef4f4d9c76c79aff9e8be8fe744ae00ce591cb9457516e803dac5eaf3bf9a5f"}
Jul 20 16:21:21.693387 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:21.693346    2560 generic.go:356] "Generic (PLEG): container finished" podID="21fdd515-674a-465c-baac-dabbde144bcb" containerID="0846b29ca35ce977c250541735c9742ee88ced94c7406d421e27c0ed61b325e5" exitCode=0
Jul 20 16:21:21.693829 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:21.693437    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd" event={"ID":"21fdd515-674a-465c-baac-dabbde144bcb","Type":"ContainerDied","Data":"0846b29ca35ce977c250541735c9742ee88ced94c7406d421e27c0ed61b325e5"}
Jul 20 16:21:21.695509 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:21.695487    2560 generic.go:356] "Generic (PLEG): container finished" podID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerID="ef45ca13f63b8291b6fd54cf9059c5b4b36b51873d11f5c319112f0a592bb875" exitCode=0
Jul 20 16:21:21.695596 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:21.695569    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2" event={"ID":"36b97d55-8e41-43e9-8204-c4baca9d3e98","Type":"ContainerDied","Data":"ef45ca13f63b8291b6fd54cf9059c5b4b36b51873d11f5c319112f0a592bb875"}
Jul 20 16:21:21.697517 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:21.697494    2560 generic.go:356] "Generic (PLEG): container finished" podID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerID="9d39df6995d46c2a0540f500aaa9edb7d5a45979d68e2c6253b9440b18e425a5" exitCode=0
Jul 20 16:21:21.697599 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:21.697576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5" event={"ID":"94fb34cd-7926-46ff-9c62-c86d9dd3a775","Type":"ContainerDied","Data":"9d39df6995d46c2a0540f500aaa9edb7d5a45979d68e2c6253b9440b18e425a5"}
Jul 20 16:21:22.709899 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.709867    2560 generic.go:356] "Generic (PLEG): container finished" podID="e4c58a20-5650-4300-8b23-737afb523913" containerID="d2be7cac295c74c3ec847b42de8fbef13ae8ae7ab730307d8eaa5372f052e638" exitCode=0
Jul 20 16:21:22.710398 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.709935    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv" event={"ID":"e4c58a20-5650-4300-8b23-737afb523913","Type":"ContainerDied","Data":"d2be7cac295c74c3ec847b42de8fbef13ae8ae7ab730307d8eaa5372f052e638"}
Jul 20 16:21:22.864834 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.864808    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:22.939467 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.939443    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:22.942219 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.942196    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:22.981079 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.980992    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-util\") pod \"36b97d55-8e41-43e9-8204-c4baca9d3e98\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") "
Jul 20 16:21:22.981079 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.981041    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8ssc\" (UniqueName: \"kubernetes.io/projected/36b97d55-8e41-43e9-8204-c4baca9d3e98-kube-api-access-j8ssc\") pod \"36b97d55-8e41-43e9-8204-c4baca9d3e98\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") "
Jul 20 16:21:22.981323 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.981099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-bundle\") pod \"36b97d55-8e41-43e9-8204-c4baca9d3e98\" (UID: \"36b97d55-8e41-43e9-8204-c4baca9d3e98\") "
Jul 20 16:21:22.981726 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.981703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-bundle" (OuterVolumeSpecName: "bundle") pod "36b97d55-8e41-43e9-8204-c4baca9d3e98" (UID: "36b97d55-8e41-43e9-8204-c4baca9d3e98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:21:22.983270 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.983245    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b97d55-8e41-43e9-8204-c4baca9d3e98-kube-api-access-j8ssc" (OuterVolumeSpecName: "kube-api-access-j8ssc") pod "36b97d55-8e41-43e9-8204-c4baca9d3e98" (UID: "36b97d55-8e41-43e9-8204-c4baca9d3e98"). InnerVolumeSpecName "kube-api-access-j8ssc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:21:22.987271 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:22.987237    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-util" (OuterVolumeSpecName: "util") pod "36b97d55-8e41-43e9-8204-c4baca9d3e98" (UID: "36b97d55-8e41-43e9-8204-c4baca9d3e98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:21:23.081855 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.081815    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-util\") pod \"21fdd515-674a-465c-baac-dabbde144bcb\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") "
Jul 20 16:21:23.082017 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.081892    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmfjl\" (UniqueName: \"kubernetes.io/projected/21fdd515-674a-465c-baac-dabbde144bcb-kube-api-access-cmfjl\") pod \"21fdd515-674a-465c-baac-dabbde144bcb\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") "
Jul 20 16:21:23.082017 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.081985    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-util\") pod \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") "
Jul 20 16:21:23.082017 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.082012    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-bundle\") pod \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") "
Jul 20 16:21:23.082179 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.082038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7q7q\" (UniqueName: \"kubernetes.io/projected/94fb34cd-7926-46ff-9c62-c86d9dd3a775-kube-api-access-w7q7q\") pod \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\" (UID: \"94fb34cd-7926-46ff-9c62-c86d9dd3a775\") "
Jul 20 16:21:23.082179 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.082063    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-bundle\") pod \"21fdd515-674a-465c-baac-dabbde144bcb\" (UID: \"21fdd515-674a-465c-baac-dabbde144bcb\") "
Jul 20 16:21:23.082350 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.082318    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-util\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:23.082350 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.082339    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8ssc\" (UniqueName: \"kubernetes.io/projected/36b97d55-8e41-43e9-8204-c4baca9d3e98-kube-api-access-j8ssc\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:23.082473 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.082353    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36b97d55-8e41-43e9-8204-c4baca9d3e98-bundle\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:23.082553 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.082527    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-bundle" (OuterVolumeSpecName: "bundle") pod "94fb34cd-7926-46ff-9c62-c86d9dd3a775" (UID: "94fb34cd-7926-46ff-9c62-c86d9dd3a775"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:21:23.082640 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.082611    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-bundle" (OuterVolumeSpecName: "bundle") pod "21fdd515-674a-465c-baac-dabbde144bcb" (UID: "21fdd515-674a-465c-baac-dabbde144bcb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:21:23.084068 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.084046    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21fdd515-674a-465c-baac-dabbde144bcb-kube-api-access-cmfjl" (OuterVolumeSpecName: "kube-api-access-cmfjl") pod "21fdd515-674a-465c-baac-dabbde144bcb" (UID: "21fdd515-674a-465c-baac-dabbde144bcb"). InnerVolumeSpecName "kube-api-access-cmfjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:21:23.084528 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.084505    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94fb34cd-7926-46ff-9c62-c86d9dd3a775-kube-api-access-w7q7q" (OuterVolumeSpecName: "kube-api-access-w7q7q") pod "94fb34cd-7926-46ff-9c62-c86d9dd3a775" (UID: "94fb34cd-7926-46ff-9c62-c86d9dd3a775"). InnerVolumeSpecName "kube-api-access-w7q7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:21:23.087782 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.087762    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-util" (OuterVolumeSpecName: "util") pod "94fb34cd-7926-46ff-9c62-c86d9dd3a775" (UID: "94fb34cd-7926-46ff-9c62-c86d9dd3a775"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:21:23.087982 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.087964    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-util" (OuterVolumeSpecName: "util") pod "21fdd515-674a-465c-baac-dabbde144bcb" (UID: "21fdd515-674a-465c-baac-dabbde144bcb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:21:23.182920 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.182886    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-util\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:23.182920 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.182916    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94fb34cd-7926-46ff-9c62-c86d9dd3a775-bundle\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:23.182920 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.182927    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7q7q\" (UniqueName: \"kubernetes.io/projected/94fb34cd-7926-46ff-9c62-c86d9dd3a775-kube-api-access-w7q7q\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:23.183200 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.182940    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-bundle\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:23.183200 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.182948    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fdd515-674a-465c-baac-dabbde144bcb-util\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:23.183200 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.182956    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmfjl\" (UniqueName: \"kubernetes.io/projected/21fdd515-674a-465c-baac-dabbde144bcb-kube-api-access-cmfjl\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:23.716411 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.716373    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5" event={"ID":"94fb34cd-7926-46ff-9c62-c86d9dd3a775","Type":"ContainerDied","Data":"cf1403ddbc7ab9c7125c29a49256eb133079b48dc5668af7758265f260933673"}
Jul 20 16:21:23.716814 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.716426    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf1403ddbc7ab9c7125c29a49256eb133079b48dc5668af7758265f260933673"
Jul 20 16:21:23.716814 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.716380    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5"
Jul 20 16:21:23.718552 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.718529    2560 generic.go:356] "Generic (PLEG): container finished" podID="e4c58a20-5650-4300-8b23-737afb523913" containerID="b4ab56a6dbff933a3166b52a1c216f1c8f9d50e96bcfdcce4e700c070490b98c" exitCode=0
Jul 20 16:21:23.718695 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.718610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv" event={"ID":"e4c58a20-5650-4300-8b23-737afb523913","Type":"ContainerDied","Data":"b4ab56a6dbff933a3166b52a1c216f1c8f9d50e96bcfdcce4e700c070490b98c"}
Jul 20 16:21:23.720500 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.720481    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd"
Jul 20 16:21:23.720500 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.720485    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd" event={"ID":"21fdd515-674a-465c-baac-dabbde144bcb","Type":"ContainerDied","Data":"f3e3add455414ab5176568b4901b5ab9f19045989ac8238c16bf782249f15d72"}
Jul 20 16:21:23.720651 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.720522    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3e3add455414ab5176568b4901b5ab9f19045989ac8238c16bf782249f15d72"
Jul 20 16:21:23.722358 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.722337    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2" event={"ID":"36b97d55-8e41-43e9-8204-c4baca9d3e98","Type":"ContainerDied","Data":"c8c78411acd00db110649a663c7547fc656f4391a888718f45b35c91e487341f"}
Jul 20 16:21:23.722456 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.722373    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2"
Jul 20 16:21:23.722456 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:23.722375    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8c78411acd00db110649a663c7547fc656f4391a888718f45b35c91e487341f"
Jul 20 16:21:24.850795 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:24.850774    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:21:24.997761 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:24.997688    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-bundle\") pod \"e4c58a20-5650-4300-8b23-737afb523913\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") "
Jul 20 16:21:24.997761 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:24.997726    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4xqt\" (UniqueName: \"kubernetes.io/projected/e4c58a20-5650-4300-8b23-737afb523913-kube-api-access-v4xqt\") pod \"e4c58a20-5650-4300-8b23-737afb523913\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") "
Jul 20 16:21:24.997761 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:24.997757    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-util\") pod \"e4c58a20-5650-4300-8b23-737afb523913\" (UID: \"e4c58a20-5650-4300-8b23-737afb523913\") "
Jul 20 16:21:24.998239 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:24.998210    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-bundle" (OuterVolumeSpecName: "bundle") pod "e4c58a20-5650-4300-8b23-737afb523913" (UID: "e4c58a20-5650-4300-8b23-737afb523913"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:21:24.999561 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:24.999535    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4c58a20-5650-4300-8b23-737afb523913-kube-api-access-v4xqt" (OuterVolumeSpecName: "kube-api-access-v4xqt") pod "e4c58a20-5650-4300-8b23-737afb523913" (UID: "e4c58a20-5650-4300-8b23-737afb523913"). InnerVolumeSpecName "kube-api-access-v4xqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:21:25.003318 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:25.003300    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-util" (OuterVolumeSpecName: "util") pod "e4c58a20-5650-4300-8b23-737afb523913" (UID: "e4c58a20-5650-4300-8b23-737afb523913"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:21:25.098905 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:25.098882    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-bundle\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:25.098905 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:25.098904    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4xqt\" (UniqueName: \"kubernetes.io/projected/e4c58a20-5650-4300-8b23-737afb523913-kube-api-access-v4xqt\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:25.099048 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:25.098913    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4c58a20-5650-4300-8b23-737afb523913-util\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:21:25.738524 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:25.738472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv" event={"ID":"e4c58a20-5650-4300-8b23-737afb523913","Type":"ContainerDied","Data":"eef4f4d9c76c79aff9e8be8fe744ae00ce591cb9457516e803dac5eaf3bf9a5f"}
Jul 20 16:21:25.738719 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:25.738588    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eef4f4d9c76c79aff9e8be8fe744ae00ce591cb9457516e803dac5eaf3bf9a5f"
Jul 20 16:21:25.738719 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:21:25.738588    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv"
Jul 20 16:22:01.513425 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513389    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"]
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513665    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fdd515-674a-465c-baac-dabbde144bcb" containerName="pull"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513675    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fdd515-674a-465c-baac-dabbde144bcb" containerName="pull"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513687    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerName="pull"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513692    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerName="pull"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513701    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fdd515-674a-465c-baac-dabbde144bcb" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513708    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fdd515-674a-465c-baac-dabbde144bcb" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513715    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c58a20-5650-4300-8b23-737afb523913" containerName="pull"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513719    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c58a20-5650-4300-8b23-737afb523913" containerName="pull"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513726    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513730    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513736    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerName="util"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513741    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerName="util"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513747    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c58a20-5650-4300-8b23-737afb523913" containerName="util"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513751    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c58a20-5650-4300-8b23-737afb523913" containerName="util"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513756    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerName="pull"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513762    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerName="pull"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513768    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c58a20-5650-4300-8b23-737afb523913" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513775    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c58a20-5650-4300-8b23-737afb523913" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513783    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513787    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513798    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fdd515-674a-465c-baac-dabbde144bcb" containerName="util"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513802    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fdd515-674a-465c-baac-dabbde144bcb" containerName="util"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513808    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerName="util"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513814    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerName="util"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513855    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b97d55-8e41-43e9-8204-c4baca9d3e98" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513864    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="94fb34cd-7926-46ff-9c62-c86d9dd3a775" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513870    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4c58a20-5650-4300-8b23-737afb523913" containerName="extract"
Jul 20 16:22:01.513958 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.513877    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21fdd515-674a-465c-baac-dabbde144bcb" containerName="extract"
Jul 20 16:22:01.516725 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.516710    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:01.520035 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.520012    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n542q\""
Jul 20 16:22:01.520170 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.520031    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 16:22:01.520170 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.520031    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 16:22:01.535513 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.535491    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"]
Jul 20 16:22:01.590518 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.590493    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f8vtv\" (UID: \"9b51c7af-29b0-4d8a-95fd-3128981cf8b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:01.590657 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.590533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlhpl\" (UniqueName: \"kubernetes.io/projected/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-kube-api-access-rlhpl\") pod \"kuadrant-operator-controller-manager-55467d9f7-f8vtv\" (UID: \"9b51c7af-29b0-4d8a-95fd-3128981cf8b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:01.629289 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.629252    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"]
Jul 20 16:22:01.629524 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:22:01.629505    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-rlhpl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv" podUID="9b51c7af-29b0-4d8a-95fd-3128981cf8b9"
Jul 20 16:22:01.690837 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.690805    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"]
Jul 20 16:22:01.691063 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.691043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f8vtv\" (UID: \"9b51c7af-29b0-4d8a-95fd-3128981cf8b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:01.691112 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.691080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlhpl\" (UniqueName: \"kubernetes.io/projected/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-kube-api-access-rlhpl\") pod \"kuadrant-operator-controller-manager-55467d9f7-f8vtv\" (UID: \"9b51c7af-29b0-4d8a-95fd-3128981cf8b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:01.691485 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.691470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f8vtv\" (UID: \"9b51c7af-29b0-4d8a-95fd-3128981cf8b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:01.708338 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.708315    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"]
Jul 20 16:22:01.711962 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:22:01.711941    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rlhpl for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv: failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-f8vtv" not found
Jul 20 16:22:01.712072 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:22:01.712002    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-kube-api-access-rlhpl podName:9b51c7af-29b0-4d8a-95fd-3128981cf8b9 nodeName:}" failed. No retries permitted until 2026-07-20 16:22:02.211985185 +0000 UTC m=+478.573685725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rlhpl" (UniqueName: "kubernetes.io/projected/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-kube-api-access-rlhpl") pod "kuadrant-operator-controller-manager-55467d9f7-f8vtv" (UID: "9b51c7af-29b0-4d8a-95fd-3128981cf8b9") : failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-f8vtv" not found
Jul 20 16:22:01.904585 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.901049    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:01.910647 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.910621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:01.912893 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:22:01.912867    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f8vtv\" is forbidden: User \"system:node:ip-10-0-135-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-221.ec2.internal' and this object" podUID="9b51c7af-29b0-4d8a-95fd-3128981cf8b9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:01.994552 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.994525    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-extensions-socket-volume\") pod \"9b51c7af-29b0-4d8a-95fd-3128981cf8b9\" (UID: \"9b51c7af-29b0-4d8a-95fd-3128981cf8b9\") "
Jul 20 16:22:01.994692 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.994678    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlhpl\" (UniqueName: \"kubernetes.io/projected/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-kube-api-access-rlhpl\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:22:01.994809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:01.994787    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b51c7af-29b0-4d8a-95fd-3128981cf8b9" (UID: "9b51c7af-29b0-4d8a-95fd-3128981cf8b9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:22:02.095214 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:02.095178    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b51c7af-29b0-4d8a-95fd-3128981cf8b9-extensions-socket-volume\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:22:02.905943 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:02.905910    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:02.908316 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:22:02.908285    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f8vtv\" is forbidden: User \"system:node:ip-10-0-135-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-221.ec2.internal' and this object" podUID="9b51c7af-29b0-4d8a-95fd-3128981cf8b9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:02.914042 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:22:02.914017    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f8vtv\" is forbidden: User \"system:node:ip-10-0-135-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-221.ec2.internal' and this object" podUID="9b51c7af-29b0-4d8a-95fd-3128981cf8b9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f8vtv"
Jul 20 16:22:03.849970 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:03.849933    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b51c7af-29b0-4d8a-95fd-3128981cf8b9" path="/var/lib/kubelet/pods/9b51c7af-29b0-4d8a-95fd-3128981cf8b9/volumes"
Jul 20 16:22:54.813525 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.813490    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:22:54.816840 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.816823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:22:54.819259 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.819236    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 16:22:54.819357 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.819235    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 16:22:54.820144 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.820109    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 16:22:54.820259 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.820117    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nc4th\""
Jul 20 16:22:54.826590 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.826568    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:22:54.857067 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.857033    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:22:54.937118 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.937081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b17735e3-b255-48b0-bc35-bbbf44c74d2c-config-file\") pod \"limitador-limitador-54d6d988d5-sdwj2\" (UID: \"b17735e3-b255-48b0-bc35-bbbf44c74d2c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:22:54.937302 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:54.937149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgc6h\" (UniqueName: \"kubernetes.io/projected/b17735e3-b255-48b0-bc35-bbbf44c74d2c-kube-api-access-pgc6h\") pod \"limitador-limitador-54d6d988d5-sdwj2\" (UID: \"b17735e3-b255-48b0-bc35-bbbf44c74d2c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:22:55.038515 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:55.038473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b17735e3-b255-48b0-bc35-bbbf44c74d2c-config-file\") pod \"limitador-limitador-54d6d988d5-sdwj2\" (UID: \"b17735e3-b255-48b0-bc35-bbbf44c74d2c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:22:55.038515 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:55.038524    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgc6h\" (UniqueName: \"kubernetes.io/projected/b17735e3-b255-48b0-bc35-bbbf44c74d2c-kube-api-access-pgc6h\") pod \"limitador-limitador-54d6d988d5-sdwj2\" (UID: \"b17735e3-b255-48b0-bc35-bbbf44c74d2c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:22:55.039123 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:55.039099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b17735e3-b255-48b0-bc35-bbbf44c74d2c-config-file\") pod \"limitador-limitador-54d6d988d5-sdwj2\" (UID: \"b17735e3-b255-48b0-bc35-bbbf44c74d2c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:22:55.047594 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:55.047565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgc6h\" (UniqueName: \"kubernetes.io/projected/b17735e3-b255-48b0-bc35-bbbf44c74d2c-kube-api-access-pgc6h\") pod \"limitador-limitador-54d6d988d5-sdwj2\" (UID: \"b17735e3-b255-48b0-bc35-bbbf44c74d2c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:22:55.127922 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:55.127830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:22:55.257640 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:55.257558    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:22:55.259793 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:22:55.259762    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17735e3_b255_48b0_bc35_bbbf44c74d2c.slice/crio-f2f0fd2946517015481656810a30bf2b446020996886f3db53ffd3314b900737 WatchSource:0}: Error finding container f2f0fd2946517015481656810a30bf2b446020996886f3db53ffd3314b900737: Status 404 returned error can't find the container with id f2f0fd2946517015481656810a30bf2b446020996886f3db53ffd3314b900737
Jul 20 16:22:56.164422 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:56.164383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2" event={"ID":"b17735e3-b255-48b0-bc35-bbbf44c74d2c","Type":"ContainerStarted","Data":"f2f0fd2946517015481656810a30bf2b446020996886f3db53ffd3314b900737"}
Jul 20 16:22:58.175651 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:58.175616    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2" event={"ID":"b17735e3-b255-48b0-bc35-bbbf44c74d2c","Type":"ContainerStarted","Data":"1874c870c40f2c81593f73fa01ca0ded91f9e40cb7207947bb2afbc6e14b2dbd"}
Jul 20 16:22:58.176049 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:58.175757    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:22:58.194261 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:22:58.194208    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2" podStartSLOduration=1.756946262 podStartE2EDuration="4.194189892s" totalImagesPullingTime="2.43724363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:22:58.192680479 +0000 UTC m=+534.554381044" watchObservedRunningTime="2026-07-20 16:22:58.194189892 +0000 UTC m=+534.555890482"
Jul 20 16:23:09.182252 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:23:09.182220    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"
Jul 20 16:24:09.492073 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:24:09.492029    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:24:25.696733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:24:25.696680    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:24:35.434398 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:24:35.434312    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:25:02.091177 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:02.091141    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:25:07.099846 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.099813    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"]
Jul 20 16:25:07.103476 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.103454    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.106553 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.106528    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mmwbr\""
Jul 20 16:25:07.106553 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.106548    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 20 16:25:07.106729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.106537    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 16:25:07.106729 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.106576    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 16:25:07.112276 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.112250    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"]
Jul 20 16:25:07.238529 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.238492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0979d5a6-8514-4268-a842-90499d8a4d2a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.238695 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.238630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.238695 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.238678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.238768 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.238737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.238811 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.238793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.238853 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.238833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9ztr\" (UniqueName: \"kubernetes.io/projected/0979d5a6-8514-4268-a842-90499d8a4d2a-kube-api-access-t9ztr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.339917 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.339878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0979d5a6-8514-4268-a842-90499d8a4d2a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.340113 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.339965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.340113 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.340000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.340113 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.340037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.340113 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.340075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.340113 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.340103    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9ztr\" (UniqueName: \"kubernetes.io/projected/0979d5a6-8514-4268-a842-90499d8a4d2a-kube-api-access-t9ztr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.340578 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.340531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.340685 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.340588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.340685 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.340638    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.342513 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.342491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0979d5a6-8514-4268-a842-90499d8a4d2a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.342601 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.342587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0979d5a6-8514-4268-a842-90499d8a4d2a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.347697 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.347670    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9ztr\" (UniqueName: \"kubernetes.io/projected/0979d5a6-8514-4268-a842-90499d8a4d2a-kube-api-access-t9ztr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8\" (UID: \"0979d5a6-8514-4268-a842-90499d8a4d2a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.415565 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.415477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:07.545902 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.545874    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"]
Jul 20 16:25:07.548137 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:25:07.548095    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0979d5a6_8514_4268_a842_90499d8a4d2a.slice/crio-cab16ed9a32548c1be51b50fa98ae2f8711215e83bda798c7d456852af23558f WatchSource:0}: Error finding container cab16ed9a32548c1be51b50fa98ae2f8711215e83bda798c7d456852af23558f: Status 404 returned error can't find the container with id cab16ed9a32548c1be51b50fa98ae2f8711215e83bda798c7d456852af23558f
Jul 20 16:25:07.549632 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.549608    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 16:25:07.781346 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:07.781312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8" event={"ID":"0979d5a6-8514-4268-a842-90499d8a4d2a","Type":"ContainerStarted","Data":"cab16ed9a32548c1be51b50fa98ae2f8711215e83bda798c7d456852af23558f"}
Jul 20 16:25:08.787657 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:08.787627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:25:13.817278 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:13.817238    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8" event={"ID":"0979d5a6-8514-4268-a842-90499d8a4d2a","Type":"ContainerStarted","Data":"aeb71c7782ce508c68584a9d220360eb369829d56ab52a8698624687d59a5a36"}
Jul 20 16:25:13.834455 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:13.834408    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8" podStartSLOduration=1.59702279 podStartE2EDuration="6.834394331s" totalImagesPullingTime="5.237371541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:25:13.832467066 +0000 UTC m=+670.194167643" watchObservedRunningTime="2026-07-20 16:25:13.834394331 +0000 UTC m=+670.196094898"
Jul 20 16:25:17.415971 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:17.415931    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:17.416480 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:17.416040    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:17.428609 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:17.428572    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:17.849975 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:17.849948    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8"
Jul 20 16:25:19.487142 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:19.487091    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:25:30.182775 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:25:30.182739    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:26:39.285691 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:26:39.285657    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:26:48.592941 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:26:48.592910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:27:00.288050 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:27:00.288016    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:28:41.579111 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:28:41.579073    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:28:50.289972 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:28:50.289932    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:29:20.084332 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:29:20.084296    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:29:29.778803 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:29:29.778769    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:29:40.578236 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:29:40.578201    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:29:48.785934 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:29:48.785897    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:30:00.201104 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:30:00.201065    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:30:09.684818 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:30:09.684782    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:30:20.486234 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:30:20.486199    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:30:30.282110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:30:30.282031    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:30:52.880883 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:30:52.880846    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:31:04.682110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:31:04.682073    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:31:27.988603 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:31:27.988563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:31:39.686139 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:31:39.686089    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:31:49.480327 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:31:49.480296    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:31:56.693227 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:31:56.693138    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:32:06.391533 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:32:06.391498    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:32:16.585513 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:32:16.585480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:32:26.095421 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:32:26.095386    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:32:35.482732 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:32:35.482699    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:34:21.986392 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:34:21.986352    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:34:32.682085 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:34:32.682051    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:34:43.284942 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:34:43.284911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:34:54.435436 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:34:54.435398    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:35:06.194473 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:35:06.194379    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:35:15.582716 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:35:15.582677    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:35:25.106060 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:35:25.106025    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:35:36.377922 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:35:36.377889    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:35:47.095651 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:35:47.095618    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:35:55.487830 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:35:55.487795    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:36:06.300168 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:36:06.300116    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:36:27.896445 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:36:27.896367    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:36:37.235089 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:36:37.235050    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:37:01.215223 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.215191    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"]
Jul 20 16:37:01.218541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.218523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.221156 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.221119    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-294bb9f1-kserve-self-signed-certs\""
Jul 20 16:37:01.229960 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.229937    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"]
Jul 20 16:37:01.351674 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.351648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a424912f-7528-4bc4-b425-61a7609353dd-tls-certs\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.351847 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.351681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-home\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.351847 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.351701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-tmp-dir\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.351847 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.351724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25cjm\" (UniqueName: \"kubernetes.io/projected/a424912f-7528-4bc4-b425-61a7609353dd-kube-api-access-25cjm\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.351847 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.351778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-dshm\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.351847 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.351814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-model-cache\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.452680 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.452645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-dshm\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.452843 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.452708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-model-cache\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.452843 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.452749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a424912f-7528-4bc4-b425-61a7609353dd-tls-certs\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.452843 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.452780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-home\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.453032 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.452904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-tmp-dir\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.453032 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.452938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cjm\" (UniqueName: \"kubernetes.io/projected/a424912f-7528-4bc4-b425-61a7609353dd-kube-api-access-25cjm\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.453239 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.453206    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-model-cache\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.453366 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.453214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-home\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.453366 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.453347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-tmp-dir\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.454954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.454931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-dshm\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.455200 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.455182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a424912f-7528-4bc4-b425-61a7609353dd-tls-certs\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.460581 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.460565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25cjm\" (UniqueName: \"kubernetes.io/projected/a424912f-7528-4bc4-b425-61a7609353dd-kube-api-access-25cjm\") pod \"e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") " pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.527752 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.527727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:01.653461 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.653437    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"]
Jul 20 16:37:01.655253 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:37:01.655229    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda424912f_7528_4bc4_b425_61a7609353dd.slice/crio-7332e8d1123377e8ddf221d104d9ee5df54fa13028d76a2709eb3a4e6e5e277d WatchSource:0}: Error finding container 7332e8d1123377e8ddf221d104d9ee5df54fa13028d76a2709eb3a4e6e5e277d: Status 404 returned error can't find the container with id 7332e8d1123377e8ddf221d104d9ee5df54fa13028d76a2709eb3a4e6e5e277d
Jul 20 16:37:01.680941 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:01.680918    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:37:02.244926 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:02.244882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b" event={"ID":"a424912f-7528-4bc4-b425-61a7609353dd","Type":"ContainerStarted","Data":"e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610"}
Jul 20 16:37:02.245299 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:02.244934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b" event={"ID":"a424912f-7528-4bc4-b425-61a7609353dd","Type":"ContainerStarted","Data":"7332e8d1123377e8ddf221d104d9ee5df54fa13028d76a2709eb3a4e6e5e277d"}
Jul 20 16:37:02.261499 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:02.261448    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b" podStartSLOduration=1.261433141 podStartE2EDuration="1.261433141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:37:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:37:02.260932631 +0000 UTC m=+1378.622633194" watchObservedRunningTime="2026-07-20 16:37:02.261433141 +0000 UTC m=+1378.623133706"
Jul 20 16:37:11.528023 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:11.527989    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:11.528536 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:11.528036    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:11.540359 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:11.540336    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:12.303374 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:12.303345    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:17.480871 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:17.480839    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:37:28.798576 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:28.798536    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"]
Jul 20 16:37:31.992010 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:31.991980    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:37:43.820601 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:43.820541    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b" podUID="a424912f-7528-4bc4-b425-61a7609353dd" containerName="main" containerID="cri-o://e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610" gracePeriod=45
Jul 20 16:37:44.061420 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.061396    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:44.075623 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.075568    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-dshm\") pod \"a424912f-7528-4bc4-b425-61a7609353dd\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") "
Jul 20 16:37:44.075718 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.075654    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a424912f-7528-4bc4-b425-61a7609353dd-tls-certs\") pod \"a424912f-7528-4bc4-b425-61a7609353dd\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") "
Jul 20 16:37:44.075718 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.075678    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25cjm\" (UniqueName: \"kubernetes.io/projected/a424912f-7528-4bc4-b425-61a7609353dd-kube-api-access-25cjm\") pod \"a424912f-7528-4bc4-b425-61a7609353dd\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") "
Jul 20 16:37:44.075718 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.075695    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-model-cache\") pod \"a424912f-7528-4bc4-b425-61a7609353dd\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") "
Jul 20 16:37:44.075858 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.075745    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-home\") pod \"a424912f-7528-4bc4-b425-61a7609353dd\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") "
Jul 20 16:37:44.075858 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.075767    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-tmp-dir\") pod \"a424912f-7528-4bc4-b425-61a7609353dd\" (UID: \"a424912f-7528-4bc4-b425-61a7609353dd\") "
Jul 20 16:37:44.076022 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.075997    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-model-cache" (OuterVolumeSpecName: "model-cache") pod "a424912f-7528-4bc4-b425-61a7609353dd" (UID: "a424912f-7528-4bc4-b425-61a7609353dd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:37:44.076086 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.076011    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-home" (OuterVolumeSpecName: "home") pod "a424912f-7528-4bc4-b425-61a7609353dd" (UID: "a424912f-7528-4bc4-b425-61a7609353dd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:37:44.076140 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.076082    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a424912f-7528-4bc4-b425-61a7609353dd" (UID: "a424912f-7528-4bc4-b425-61a7609353dd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:37:44.078539 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.078331    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-dshm" (OuterVolumeSpecName: "dshm") pod "a424912f-7528-4bc4-b425-61a7609353dd" (UID: "a424912f-7528-4bc4-b425-61a7609353dd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:37:44.078680 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.078607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a424912f-7528-4bc4-b425-61a7609353dd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a424912f-7528-4bc4-b425-61a7609353dd" (UID: "a424912f-7528-4bc4-b425-61a7609353dd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:37:44.079027 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.079000    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a424912f-7528-4bc4-b425-61a7609353dd-kube-api-access-25cjm" (OuterVolumeSpecName: "kube-api-access-25cjm") pod "a424912f-7528-4bc4-b425-61a7609353dd" (UID: "a424912f-7528-4bc4-b425-61a7609353dd"). InnerVolumeSpecName "kube-api-access-25cjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:37:44.176788 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.176766    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-dshm\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:37:44.176788 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.176788    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a424912f-7528-4bc4-b425-61a7609353dd-tls-certs\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:37:44.176903 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.176798    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25cjm\" (UniqueName: \"kubernetes.io/projected/a424912f-7528-4bc4-b425-61a7609353dd-kube-api-access-25cjm\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:37:44.176903 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.176806    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-model-cache\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:37:44.176903 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.176814    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-home\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:37:44.176903 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.176823    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a424912f-7528-4bc4-b425-61a7609353dd-tmp-dir\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:37:44.456233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.456142    2560 generic.go:356] "Generic (PLEG): container finished" podID="a424912f-7528-4bc4-b425-61a7609353dd" containerID="e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610" exitCode=0
Jul 20 16:37:44.456233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.456196    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"
Jul 20 16:37:44.456233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.456217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b" event={"ID":"a424912f-7528-4bc4-b425-61a7609353dd","Type":"ContainerDied","Data":"e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610"}
Jul 20 16:37:44.456428 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.456260    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b" event={"ID":"a424912f-7528-4bc4-b425-61a7609353dd","Type":"ContainerDied","Data":"7332e8d1123377e8ddf221d104d9ee5df54fa13028d76a2709eb3a4e6e5e277d"}
Jul 20 16:37:44.456428 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.456278    2560 scope.go:117] "RemoveContainer" containerID="e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610"
Jul 20 16:37:44.465377 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.465358    2560 scope.go:117] "RemoveContainer" containerID="e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610"
Jul 20 16:37:44.465610 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:37:44.465592    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610\": container with ID starting with e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610 not found: ID does not exist" containerID="e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610"
Jul 20 16:37:44.465657 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.465619    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610"} err="failed to get container status \"e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610\": rpc error: code = NotFound desc = could not find container \"e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610\": container with ID starting with e30958273d17c817059600f8821c3cdf5a2a0424b08c9928622b1b9e9c525610 not found: ID does not exist"
Jul 20 16:37:44.477249 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.477230    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"]
Jul 20 16:37:44.480764 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:44.480740    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-294bb9f1-kserve-6b48b796f9-r2b4b"]
Jul 20 16:37:45.849985 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:45.849953    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a424912f-7528-4bc4-b425-61a7609353dd" path="/var/lib/kubelet/pods/a424912f-7528-4bc4-b425-61a7609353dd/volumes"
Jul 20 16:37:46.682513 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:46.682481    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:37:56.190327 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:37:56.190294    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:38:09.292821 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:38:09.292788    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:38:23.703143 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:38:23.703096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:38:33.193581 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:38:33.193546    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:38:47.094318 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:38:47.094283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:38:56.577156 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:38:56.577102    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:39:10.081573 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:39:10.081533    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:39:19.089080 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:39:19.089046    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:39:28.885803 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:39:28.885725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:39:41.488527 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:39:41.488494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:39:54.482465 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:39:54.482427    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:40:02.593398 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:40:02.593364    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:40:15.684252 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:40:15.684218    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:40:28.277895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:40:28.277864    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:40:40.493716 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:40:40.493675    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:40:50.281848 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:40:50.281814    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:41:00.691031 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:00.690958    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:41:13.387273 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:13.387237    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:41:21.162757 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.162718    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"]
Jul 20 16:41:21.163212 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.163197    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a424912f-7528-4bc4-b425-61a7609353dd" containerName="main"
Jul 20 16:41:21.163264 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.163215    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a424912f-7528-4bc4-b425-61a7609353dd" containerName="main"
Jul 20 16:41:21.163311 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.163300    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a424912f-7528-4bc4-b425-61a7609353dd" containerName="main"
Jul 20 16:41:21.166368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.166352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.168740 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.168716    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 16:41:21.169541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.169517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d56dc9f8-serving-cert\""
Jul 20 16:41:21.169638 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.169554    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\""
Jul 20 16:41:21.169638 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.169520    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 16:41:21.175347 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.175322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"]
Jul 20 16:41:21.231945 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.231924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-524pd\" (UniqueName: \"kubernetes.io/projected/f923c623-f72d-4b04-9505-945720dd4fe0-kube-api-access-524pd\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.232056 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.231969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f923c623-f72d-4b04-9505-945720dd4fe0-openshift-service-ca\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.232110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.232049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f923c623-f72d-4b04-9505-945720dd4fe0-maas-api-tls\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.332914 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.332889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f923c623-f72d-4b04-9505-945720dd4fe0-maas-api-tls\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.333031 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.332946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-524pd\" (UniqueName: \"kubernetes.io/projected/f923c623-f72d-4b04-9505-945720dd4fe0-kube-api-access-524pd\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.333031 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.332972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f923c623-f72d-4b04-9505-945720dd4fe0-openshift-service-ca\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.333174 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:41:21.333060    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-serving-cert: secret "maas-api-e2e-ait-d56dc9f8-serving-cert" not found
Jul 20 16:41:21.333174 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:41:21.333150    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923c623-f72d-4b04-9505-945720dd4fe0-maas-api-tls podName:f923c623-f72d-4b04-9505-945720dd4fe0 nodeName:}" failed. No retries permitted until 2026-07-20 16:41:21.833111942 +0000 UTC m=+1638.194812504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f923c623-f72d-4b04-9505-945720dd4fe0-maas-api-tls") pod "maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48" (UID: "f923c623-f72d-4b04-9505-945720dd4fe0") : secret "maas-api-e2e-ait-d56dc9f8-serving-cert" not found
Jul 20 16:41:21.333547 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.333529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f923c623-f72d-4b04-9505-945720dd4fe0-openshift-service-ca\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.349327 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.349302    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-524pd\" (UniqueName: \"kubernetes.io/projected/f923c623-f72d-4b04-9505-945720dd4fe0-kube-api-access-524pd\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.837945 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.837915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f923c623-f72d-4b04-9505-945720dd4fe0-maas-api-tls\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:21.843423 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:21.841176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f923c623-f72d-4b04-9505-945720dd4fe0-maas-api-tls\") pod \"maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:22.078965 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:22.078935    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:22.202586 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:22.202563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"]
Jul 20 16:41:22.204279 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:41:22.204253    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf923c623_f72d_4b04_9505_945720dd4fe0.slice/crio-e013661ab7b44e8ace5eb83aa46b048dbe2c5a63ad920b4cd8b83d11bfcc288b WatchSource:0}: Error finding container e013661ab7b44e8ace5eb83aa46b048dbe2c5a63ad920b4cd8b83d11bfcc288b: Status 404 returned error can't find the container with id e013661ab7b44e8ace5eb83aa46b048dbe2c5a63ad920b4cd8b83d11bfcc288b
Jul 20 16:41:22.205658 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:22.205642    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 16:41:22.507687 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:22.507626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48" event={"ID":"f923c623-f72d-4b04-9505-945720dd4fe0","Type":"ContainerStarted","Data":"e013661ab7b44e8ace5eb83aa46b048dbe2c5a63ad920b4cd8b83d11bfcc288b"}
Jul 20 16:41:24.082456 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:24.082424    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:41:25.527065 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:25.527029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48" event={"ID":"f923c623-f72d-4b04-9505-945720dd4fe0","Type":"ContainerStarted","Data":"fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0"}
Jul 20 16:41:25.527519 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:25.527097    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:25.543900 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:25.543853    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48" podStartSLOduration=2.096097747 podStartE2EDuration="4.543838671s" totalImagesPullingTime="2.447740924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:41:25.542468198 +0000 UTC m=+1641.904168752" watchObservedRunningTime="2026-07-20 16:41:25.543838671 +0000 UTC m=+1641.905539234"
Jul 20 16:41:31.539415 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:31.539384    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:46.701347 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:46.701315    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"]
Jul 20 16:41:46.706045 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:46.706025    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"
Jul 20 16:41:46.708411 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:46.708358    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:41:46.711444 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:46.711419    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"]
Jul 20 16:41:46.826208 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:46.826180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54915614-5635-4bd6-8041-4735268185b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm\" (UID: \"54915614-5635-4bd6-8041-4735268185b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"
Jul 20 16:41:46.927178 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:46.927155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54915614-5635-4bd6-8041-4735268185b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm\" (UID: \"54915614-5635-4bd6-8041-4735268185b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"
Jul 20 16:41:46.927724 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:46.927704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54915614-5635-4bd6-8041-4735268185b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm\" (UID: \"54915614-5635-4bd6-8041-4735268185b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"
Jul 20 16:41:47.018041 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:47.017994    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"
Jul 20 16:41:47.346605 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:47.346582    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"]
Jul 20 16:41:47.348368 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:41:47.348341    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54915614_5635_4bd6_8041_4735268185b1.slice/crio-93ef2b0ebe43b30a9d23098f19ec254605894a906b723438ae86b56dde6b36bc WatchSource:0}: Error finding container 93ef2b0ebe43b30a9d23098f19ec254605894a906b723438ae86b56dde6b36bc: Status 404 returned error can't find the container with id 93ef2b0ebe43b30a9d23098f19ec254605894a906b723438ae86b56dde6b36bc
Jul 20 16:41:47.635115 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:47.635036    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm" event={"ID":"54915614-5635-4bd6-8041-4735268185b1","Type":"ContainerStarted","Data":"93ef2b0ebe43b30a9d23098f19ec254605894a906b723438ae86b56dde6b36bc"}
Jul 20 16:41:50.651916 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:50.651841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm" event={"ID":"54915614-5635-4bd6-8041-4735268185b1","Type":"ContainerStarted","Data":"91c1dbc525882a33e4b86d7e58c498012167cc0d3fd8bc34de7eed50bccc80fd"}
Jul 20 16:41:50.666886 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:50.666845    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm" podStartSLOduration=1.739551863 podStartE2EDuration="4.666830974s" totalImagesPullingTime="2.927279111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:41:50.665058564 +0000 UTC m=+1667.026759109" watchObservedRunningTime="2026-07-20 16:41:50.666830974 +0000 UTC m=+1667.028531536"
Jul 20 16:41:51.658244 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:51.658217    2560 generic.go:356] "Generic (PLEG): container finished" podID="54915614-5635-4bd6-8041-4735268185b1" containerID="91c1dbc525882a33e4b86d7e58c498012167cc0d3fd8bc34de7eed50bccc80fd" exitCode=0
Jul 20 16:41:51.658579 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:51.658302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm" event={"ID":"54915614-5635-4bd6-8041-4735268185b1","Type":"ContainerDied","Data":"91c1dbc525882a33e4b86d7e58c498012167cc0d3fd8bc34de7eed50bccc80fd"}
Jul 20 16:41:52.792332 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:52.792311    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"
Jul 20 16:41:52.875234 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:52.875207    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54915614-5635-4bd6-8041-4735268185b1-maas-api-service-ca\") pod \"54915614-5635-4bd6-8041-4735268185b1\" (UID: \"54915614-5635-4bd6-8041-4735268185b1\") "
Jul 20 16:41:52.875528 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:52.875508    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54915614-5635-4bd6-8041-4735268185b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54915614-5635-4bd6-8041-4735268185b1" (UID: "54915614-5635-4bd6-8041-4735268185b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:41:52.975709 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:52.975659    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54915614-5635-4bd6-8041-4735268185b1-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:41:53.668712 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:53.668683    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"
Jul 20 16:41:53.668869 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:53.668684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm" event={"ID":"54915614-5635-4bd6-8041-4735268185b1","Type":"ContainerDied","Data":"93ef2b0ebe43b30a9d23098f19ec254605894a906b723438ae86b56dde6b36bc"}
Jul 20 16:41:53.668869 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:53.668808    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93ef2b0ebe43b30a9d23098f19ec254605894a906b723438ae86b56dde6b36bc"
Jul 20 16:41:57.177356 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.177309    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"]
Jul 20 16:41:57.177824 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.177546    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48" podUID="f923c623-f72d-4b04-9505-945720dd4fe0" containerName="maas-api" containerID="cri-o://fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0" gracePeriod=30
Jul 20 16:41:57.417423 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.417400    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:57.505862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.505789    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f923c623-f72d-4b04-9505-945720dd4fe0-openshift-service-ca\") pod \"f923c623-f72d-4b04-9505-945720dd4fe0\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") "
Jul 20 16:41:57.505862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.505825    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f923c623-f72d-4b04-9505-945720dd4fe0-maas-api-tls\") pod \"f923c623-f72d-4b04-9505-945720dd4fe0\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") "
Jul 20 16:41:57.505862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.505856    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-524pd\" (UniqueName: \"kubernetes.io/projected/f923c623-f72d-4b04-9505-945720dd4fe0-kube-api-access-524pd\") pod \"f923c623-f72d-4b04-9505-945720dd4fe0\" (UID: \"f923c623-f72d-4b04-9505-945720dd4fe0\") "
Jul 20 16:41:57.506199 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.506173    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f923c623-f72d-4b04-9505-945720dd4fe0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f923c623-f72d-4b04-9505-945720dd4fe0" (UID: "f923c623-f72d-4b04-9505-945720dd4fe0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:41:57.507989 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.507958    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f923c623-f72d-4b04-9505-945720dd4fe0-kube-api-access-524pd" (OuterVolumeSpecName: "kube-api-access-524pd") pod "f923c623-f72d-4b04-9505-945720dd4fe0" (UID: "f923c623-f72d-4b04-9505-945720dd4fe0"). InnerVolumeSpecName "kube-api-access-524pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:41:57.507989 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.507965    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f923c623-f72d-4b04-9505-945720dd4fe0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f923c623-f72d-4b04-9505-945720dd4fe0" (UID: "f923c623-f72d-4b04-9505-945720dd4fe0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:41:57.606887 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.606868    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f923c623-f72d-4b04-9505-945720dd4fe0-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:41:57.606887 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.606888    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f923c623-f72d-4b04-9505-945720dd4fe0-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:41:57.607019 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.606898    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-524pd\" (UniqueName: \"kubernetes.io/projected/f923c623-f72d-4b04-9505-945720dd4fe0-kube-api-access-524pd\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:41:57.690233 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.690209    2560 generic.go:356] "Generic (PLEG): container finished" podID="f923c623-f72d-4b04-9505-945720dd4fe0" containerID="fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0" exitCode=0
Jul 20 16:41:57.690322 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.690255    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"
Jul 20 16:41:57.690322 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.690295    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48" event={"ID":"f923c623-f72d-4b04-9505-945720dd4fe0","Type":"ContainerDied","Data":"fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0"}
Jul 20 16:41:57.690398 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.690350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48" event={"ID":"f923c623-f72d-4b04-9505-945720dd4fe0","Type":"ContainerDied","Data":"e013661ab7b44e8ace5eb83aa46b048dbe2c5a63ad920b4cd8b83d11bfcc288b"}
Jul 20 16:41:57.690398 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.690382    2560 scope.go:117] "RemoveContainer" containerID="fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0"
Jul 20 16:41:57.698963 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.698947    2560 scope.go:117] "RemoveContainer" containerID="fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0"
Jul 20 16:41:57.699238 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:41:57.699219    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0\": container with ID starting with fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0 not found: ID does not exist" containerID="fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0"
Jul 20 16:41:57.699296 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.699244    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0"} err="failed to get container status \"fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0\": rpc error: code = NotFound desc = could not find container \"fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0\": container with ID starting with fbf273bbc7a46e6d1284935452c452a3705f1a19ed75f585b8a6c93d76bd39e0 not found: ID does not exist"
Jul 20 16:41:57.710900 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.710880    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"]
Jul 20 16:41:57.714321 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.714301    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d56dc9f8-5fd65895d6-56r48"]
Jul 20 16:41:57.850898 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:41:57.850873    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f923c623-f72d-4b04-9505-945720dd4fe0" path="/var/lib/kubelet/pods/f923c623-f72d-4b04-9505-945720dd4fe0/volumes"
Jul 20 16:42:00.476755 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:00.476721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:42:01.803577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:01.803541    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"]
Jul 20 16:42:01.807883 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:01.807855    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d56dc9f8-5sgdm"]
Jul 20 16:42:01.849796 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:01.849771    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54915614-5635-4bd6-8041-4735268185b1" path="/var/lib/kubelet/pods/54915614-5635-4bd6-8041-4735268185b1/volumes"
Jul 20 16:42:05.593768 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.593740    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"]
Jul 20 16:42:05.594090 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.594041    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f923c623-f72d-4b04-9505-945720dd4fe0" containerName="maas-api"
Jul 20 16:42:05.594090 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.594051    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f923c623-f72d-4b04-9505-945720dd4fe0" containerName="maas-api"
Jul 20 16:42:05.594090 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.594067    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54915614-5635-4bd6-8041-4735268185b1" containerName="revoke-keys"
Jul 20 16:42:05.594090 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.594072    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="54915614-5635-4bd6-8041-4735268185b1" containerName="revoke-keys"
Jul 20 16:42:05.594242 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.594122    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="54915614-5635-4bd6-8041-4735268185b1" containerName="revoke-keys"
Jul 20 16:42:05.594242 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.594144    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f923c623-f72d-4b04-9505-945720dd4fe0" containerName="maas-api"
Jul 20 16:42:05.595931 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.595915    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.598078 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.598045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-3d81c45c-serving-cert\""
Jul 20 16:42:05.598236 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.598081    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 16:42:05.598236 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.598081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\""
Jul 20 16:42:05.598768 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.598754    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 16:42:05.606097 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.606074    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"]
Jul 20 16:42:05.767815 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.767781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca01fcaf-0d51-43b1-bced-deb386e1c032-maas-api-tls\") pod \"maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.767815 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.767816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca01fcaf-0d51-43b1-bced-deb386e1c032-openshift-service-ca\") pod \"maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.768013 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.767847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vg5t\" (UniqueName: \"kubernetes.io/projected/ca01fcaf-0d51-43b1-bced-deb386e1c032-kube-api-access-2vg5t\") pod \"maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.868904 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.868842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca01fcaf-0d51-43b1-bced-deb386e1c032-maas-api-tls\") pod \"maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.868904 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.868872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca01fcaf-0d51-43b1-bced-deb386e1c032-openshift-service-ca\") pod \"maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.868904 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.868904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vg5t\" (UniqueName: \"kubernetes.io/projected/ca01fcaf-0d51-43b1-bced-deb386e1c032-kube-api-access-2vg5t\") pod \"maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.869549 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.869527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca01fcaf-0d51-43b1-bced-deb386e1c032-openshift-service-ca\") pod \"maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.871158 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.871119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca01fcaf-0d51-43b1-bced-deb386e1c032-maas-api-tls\") pod \"maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.883243 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.883224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vg5t\" (UniqueName: \"kubernetes.io/projected/ca01fcaf-0d51-43b1-bced-deb386e1c032-kube-api-access-2vg5t\") pod \"maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:05.905508 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:05.905491    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:06.033582 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:06.033557    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"]
Jul 20 16:42:06.035216 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:42:06.035185    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca01fcaf_0d51_43b1_bced_deb386e1c032.slice/crio-e642095aa4baec5cfd33755823a727155a9935300a96adaa352d4c6e471ff7a1 WatchSource:0}: Error finding container e642095aa4baec5cfd33755823a727155a9935300a96adaa352d4c6e471ff7a1: Status 404 returned error can't find the container with id e642095aa4baec5cfd33755823a727155a9935300a96adaa352d4c6e471ff7a1
Jul 20 16:42:06.738104 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:06.738031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb" event={"ID":"ca01fcaf-0d51-43b1-bced-deb386e1c032","Type":"ContainerStarted","Data":"84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62"}
Jul 20 16:42:06.738104 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:06.738080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb" event={"ID":"ca01fcaf-0d51-43b1-bced-deb386e1c032","Type":"ContainerStarted","Data":"e642095aa4baec5cfd33755823a727155a9935300a96adaa352d4c6e471ff7a1"}
Jul 20 16:42:06.738494 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:06.738159    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:06.755548 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:06.755505    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb" podStartSLOduration=1.43755109 podStartE2EDuration="1.755489173s" totalImagesPullingTime="317.938083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:42:06.753986136 +0000 UTC m=+1683.115686720" watchObservedRunningTime="2026-07-20 16:42:06.755489173 +0000 UTC m=+1683.117189735"
Jul 20 16:42:11.581474 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:11.581442    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:42:12.749577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:12.749547    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:30.526146 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:30.526095    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"]
Jul 20 16:42:30.533550 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:30.533522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"
Jul 20 16:42:30.535859 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:30.535831    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:42:30.536306 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:30.536279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"]
Jul 20 16:42:30.552765 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:30.552731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d517ed8f-32f7-4aac-a2b9-81d9b86f5821-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc\" (UID: \"d517ed8f-32f7-4aac-a2b9-81d9b86f5821\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"
Jul 20 16:42:30.654024 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:30.653992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d517ed8f-32f7-4aac-a2b9-81d9b86f5821-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc\" (UID: \"d517ed8f-32f7-4aac-a2b9-81d9b86f5821\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"
Jul 20 16:42:30.654608 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:30.654586    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d517ed8f-32f7-4aac-a2b9-81d9b86f5821-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc\" (UID: \"d517ed8f-32f7-4aac-a2b9-81d9b86f5821\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"
Jul 20 16:42:30.846186 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:30.846103    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"
Jul 20 16:42:30.971650 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:30.971587    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"]
Jul 20 16:42:30.974050 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:42:30.974025    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd517ed8f_32f7_4aac_a2b9_81d9b86f5821.slice/crio-71d950575cbae1375ec7bc34be579c9f34b2ed857797da460ea8479d4429a5f2 WatchSource:0}: Error finding container 71d950575cbae1375ec7bc34be579c9f34b2ed857797da460ea8479d4429a5f2: Status 404 returned error can't find the container with id 71d950575cbae1375ec7bc34be579c9f34b2ed857797da460ea8479d4429a5f2
Jul 20 16:42:31.861443 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:31.861365    2560 generic.go:356] "Generic (PLEG): container finished" podID="d517ed8f-32f7-4aac-a2b9-81d9b86f5821" containerID="5a72cbf515b0ce93aa99f40e8b26401453435b60daa1ca1db6e96e6e374fb2ff" exitCode=0
Jul 20 16:42:31.861443 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:31.861397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc" event={"ID":"d517ed8f-32f7-4aac-a2b9-81d9b86f5821","Type":"ContainerDied","Data":"5a72cbf515b0ce93aa99f40e8b26401453435b60daa1ca1db6e96e6e374fb2ff"}
Jul 20 16:42:31.861888 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:31.861451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc" event={"ID":"d517ed8f-32f7-4aac-a2b9-81d9b86f5821","Type":"ContainerStarted","Data":"71d950575cbae1375ec7bc34be579c9f34b2ed857797da460ea8479d4429a5f2"}
Jul 20 16:42:32.992856 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:32.992832    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"
Jul 20 16:42:33.070053 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:33.070026    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d517ed8f-32f7-4aac-a2b9-81d9b86f5821-maas-api-service-ca\") pod \"d517ed8f-32f7-4aac-a2b9-81d9b86f5821\" (UID: \"d517ed8f-32f7-4aac-a2b9-81d9b86f5821\") "
Jul 20 16:42:33.070357 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:33.070338    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d517ed8f-32f7-4aac-a2b9-81d9b86f5821-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d517ed8f-32f7-4aac-a2b9-81d9b86f5821" (UID: "d517ed8f-32f7-4aac-a2b9-81d9b86f5821"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:42:33.170750 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:33.170689    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d517ed8f-32f7-4aac-a2b9-81d9b86f5821-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:42:33.872044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:33.872023    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"
Jul 20 16:42:33.872187 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:33.872074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc" event={"ID":"d517ed8f-32f7-4aac-a2b9-81d9b86f5821","Type":"ContainerDied","Data":"71d950575cbae1375ec7bc34be579c9f34b2ed857797da460ea8479d4429a5f2"}
Jul 20 16:42:33.872187 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:33.872115    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71d950575cbae1375ec7bc34be579c9f34b2ed857797da460ea8479d4429a5f2"
Jul 20 16:42:41.075224 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.075187    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"]
Jul 20 16:42:41.075684 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.075421    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb" podUID="ca01fcaf-0d51-43b1-bced-deb386e1c032" containerName="maas-api" containerID="cri-o://84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62" gracePeriod=30
Jul 20 16:42:41.316065 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.316039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:41.427482 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.427422    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca01fcaf-0d51-43b1-bced-deb386e1c032-maas-api-tls\") pod \"ca01fcaf-0d51-43b1-bced-deb386e1c032\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") "
Jul 20 16:42:41.427482 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.427453    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca01fcaf-0d51-43b1-bced-deb386e1c032-openshift-service-ca\") pod \"ca01fcaf-0d51-43b1-bced-deb386e1c032\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") "
Jul 20 16:42:41.427656 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.427485    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vg5t\" (UniqueName: \"kubernetes.io/projected/ca01fcaf-0d51-43b1-bced-deb386e1c032-kube-api-access-2vg5t\") pod \"ca01fcaf-0d51-43b1-bced-deb386e1c032\" (UID: \"ca01fcaf-0d51-43b1-bced-deb386e1c032\") "
Jul 20 16:42:41.427753 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.427732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca01fcaf-0d51-43b1-bced-deb386e1c032-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca01fcaf-0d51-43b1-bced-deb386e1c032" (UID: "ca01fcaf-0d51-43b1-bced-deb386e1c032"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:42:41.429487 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.429463    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca01fcaf-0d51-43b1-bced-deb386e1c032-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca01fcaf-0d51-43b1-bced-deb386e1c032" (UID: "ca01fcaf-0d51-43b1-bced-deb386e1c032"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:42:41.429552 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.429530    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca01fcaf-0d51-43b1-bced-deb386e1c032-kube-api-access-2vg5t" (OuterVolumeSpecName: "kube-api-access-2vg5t") pod "ca01fcaf-0d51-43b1-bced-deb386e1c032" (UID: "ca01fcaf-0d51-43b1-bced-deb386e1c032"). InnerVolumeSpecName "kube-api-access-2vg5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:42:41.528247 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.528221    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca01fcaf-0d51-43b1-bced-deb386e1c032-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:42:41.528247 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.528245    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca01fcaf-0d51-43b1-bced-deb386e1c032-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:42:41.528376 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.528255    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vg5t\" (UniqueName: \"kubernetes.io/projected/ca01fcaf-0d51-43b1-bced-deb386e1c032-kube-api-access-2vg5t\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:42:41.912575 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.912542    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca01fcaf-0d51-43b1-bced-deb386e1c032" containerID="84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62" exitCode=0
Jul 20 16:42:41.912709 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.912584    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"
Jul 20 16:42:41.912709 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.912623    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb" event={"ID":"ca01fcaf-0d51-43b1-bced-deb386e1c032","Type":"ContainerDied","Data":"84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62"}
Jul 20 16:42:41.912709 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.912677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb" event={"ID":"ca01fcaf-0d51-43b1-bced-deb386e1c032","Type":"ContainerDied","Data":"e642095aa4baec5cfd33755823a727155a9935300a96adaa352d4c6e471ff7a1"}
Jul 20 16:42:41.912820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.912709    2560 scope.go:117] "RemoveContainer" containerID="84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62"
Jul 20 16:42:41.921225 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.921206    2560 scope.go:117] "RemoveContainer" containerID="84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62"
Jul 20 16:42:41.921472 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:42:41.921454    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62\": container with ID starting with 84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62 not found: ID does not exist" containerID="84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62"
Jul 20 16:42:41.921513 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.921482    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62"} err="failed to get container status \"84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62\": rpc error: code = NotFound desc = could not find container \"84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62\": container with ID starting with 84fdee8497dc843c4463d509c11b2526affe4f145e0fec1a0f3d6d1a36b61b62 not found: ID does not exist"
Jul 20 16:42:41.929628 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.929605    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"]
Jul 20 16:42:41.931676 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:41.931658    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3d81c45c-75c5479f47-vhzqb"]
Jul 20 16:42:43.855250 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:43.855215    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca01fcaf-0d51-43b1-bced-deb386e1c032" path="/var/lib/kubelet/pods/ca01fcaf-0d51-43b1-bced-deb386e1c032/volumes"
Jul 20 16:42:44.286912 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:44.286885    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:42:45.611353 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:45.611316    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"]
Jul 20 16:42:45.613610 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:45.613590    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3d81c45c-2h6nc"]
Jul 20 16:42:45.850904 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:45.850872    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d517ed8f-32f7-4aac-a2b9-81d9b86f5821" path="/var/lib/kubelet/pods/d517ed8f-32f7-4aac-a2b9-81d9b86f5821/volumes"
Jul 20 16:42:48.614812 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.614784    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"]
Jul 20 16:42:48.615272 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.615244    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d517ed8f-32f7-4aac-a2b9-81d9b86f5821" containerName="revoke-keys"
Jul 20 16:42:48.615272 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.615263    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d517ed8f-32f7-4aac-a2b9-81d9b86f5821" containerName="revoke-keys"
Jul 20 16:42:48.615386 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.615277    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca01fcaf-0d51-43b1-bced-deb386e1c032" containerName="maas-api"
Jul 20 16:42:48.615386 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.615286    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca01fcaf-0d51-43b1-bced-deb386e1c032" containerName="maas-api"
Jul 20 16:42:48.615386 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.615380    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca01fcaf-0d51-43b1-bced-deb386e1c032" containerName="maas-api"
Jul 20 16:42:48.615531 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.615397    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d517ed8f-32f7-4aac-a2b9-81d9b86f5821" containerName="revoke-keys"
Jul 20 16:42:48.618501 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.618483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:48.621452 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.621432    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e7bb30ee-serving-cert\""
Jul 20 16:42:48.621452 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.621444    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 16:42:48.621619 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.621523    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 16:42:48.626165 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.622609    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\""
Jul 20 16:42:48.631554 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.631530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"]
Jul 20 16:42:48.681789 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.681765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxpbl\" (UniqueName: \"kubernetes.io/projected/aff950d4-d9d5-49ed-94bf-245ba5fda3da-kube-api-access-zxpbl\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:48.681895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.681797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:48.681895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.681869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff950d4-d9d5-49ed-94bf-245ba5fda3da-openshift-service-ca\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:48.782291 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.782262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff950d4-d9d5-49ed-94bf-245ba5fda3da-openshift-service-ca\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:48.782417 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.782322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxpbl\" (UniqueName: \"kubernetes.io/projected/aff950d4-d9d5-49ed-94bf-245ba5fda3da-kube-api-access-zxpbl\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:48.782417 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.782351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:48.782528 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:42:48.782496    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-serving-cert: secret "maas-api-e2e-ait-e7bb30ee-serving-cert" not found
Jul 20 16:42:48.782579 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:42:48.782561    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls podName:aff950d4-d9d5-49ed-94bf-245ba5fda3da nodeName:}" failed. No retries permitted until 2026-07-20 16:42:49.282538047 +0000 UTC m=+1725.644238606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls") pod "maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8" (UID: "aff950d4-d9d5-49ed-94bf-245ba5fda3da") : secret "maas-api-e2e-ait-e7bb30ee-serving-cert" not found
Jul 20 16:42:48.782876 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.782856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff950d4-d9d5-49ed-94bf-245ba5fda3da-openshift-service-ca\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:48.790869 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:48.790843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxpbl\" (UniqueName: \"kubernetes.io/projected/aff950d4-d9d5-49ed-94bf-245ba5fda3da-kube-api-access-zxpbl\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:49.286917 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:49.286883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:49.287095 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:42:49.287004    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-serving-cert: secret "maas-api-e2e-ait-e7bb30ee-serving-cert" not found
Jul 20 16:42:49.287095 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:42:49.287056    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls podName:aff950d4-d9d5-49ed-94bf-245ba5fda3da nodeName:}" failed. No retries permitted until 2026-07-20 16:42:50.287041862 +0000 UTC m=+1726.648742403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls") pod "maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8" (UID: "aff950d4-d9d5-49ed-94bf-245ba5fda3da") : secret "maas-api-e2e-ait-e7bb30ee-serving-cert" not found
Jul 20 16:42:50.293089 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:50.293050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:50.295478 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:50.295454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls\") pod \"maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:50.432421 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:50.432396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:50.556550 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:50.556527    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"]
Jul 20 16:42:50.558163 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:42:50.558119    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff950d4_d9d5_49ed_94bf_245ba5fda3da.slice/crio-bd873e51807ba038a4c768333bd8b1ad43adeb4ab22b64e3ff21263bfea204e2 WatchSource:0}: Error finding container bd873e51807ba038a4c768333bd8b1ad43adeb4ab22b64e3ff21263bfea204e2: Status 404 returned error can't find the container with id bd873e51807ba038a4c768333bd8b1ad43adeb4ab22b64e3ff21263bfea204e2
Jul 20 16:42:50.955223 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:50.955199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8" event={"ID":"aff950d4-d9d5-49ed-94bf-245ba5fda3da","Type":"ContainerStarted","Data":"bd873e51807ba038a4c768333bd8b1ad43adeb4ab22b64e3ff21263bfea204e2"}
Jul 20 16:42:51.961207 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:51.961155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8" event={"ID":"aff950d4-d9d5-49ed-94bf-245ba5fda3da","Type":"ContainerStarted","Data":"7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f"}
Jul 20 16:42:51.961601 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:51.961340    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:42:51.978862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:51.978818    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8" podStartSLOduration=3.59720504 podStartE2EDuration="3.978804449s" totalImagesPullingTime="381.599409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:42:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:42:51.977407173 +0000 UTC m=+1728.339107739" watchObservedRunningTime="2026-07-20 16:42:51.978804449 +0000 UTC m=+1728.340505012"
Jul 20 16:42:55.780926 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:55.780887    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:42:57.971100 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:42:57.971073    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:43:14.218260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:14.218229    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"]
Jul 20 16:43:14.221626 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:14.221608    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"
Jul 20 16:43:14.223841 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:14.223826    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:43:14.228156 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:14.228114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"]
Jul 20 16:43:14.364024 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:14.363996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f242d874-7e9e-4a81-89d5-69050980e421-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw\" (UID: \"f242d874-7e9e-4a81-89d5-69050980e421\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"
Jul 20 16:43:14.465397 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:14.465366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f242d874-7e9e-4a81-89d5-69050980e421-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw\" (UID: \"f242d874-7e9e-4a81-89d5-69050980e421\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"
Jul 20 16:43:14.465955 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:14.465938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f242d874-7e9e-4a81-89d5-69050980e421-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw\" (UID: \"f242d874-7e9e-4a81-89d5-69050980e421\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"
Jul 20 16:43:14.533534 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:14.533516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"
Jul 20 16:43:14.656968 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:14.656749    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"]
Jul 20 16:43:14.659355 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:43:14.659329    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf242d874_7e9e_4a81_89d5_69050980e421.slice/crio-a4e1ecef9fd0f183cfd823ee0a3e9cb041a57752af4a7ccf8effabbb8943c976 WatchSource:0}: Error finding container a4e1ecef9fd0f183cfd823ee0a3e9cb041a57752af4a7ccf8effabbb8943c976: Status 404 returned error can't find the container with id a4e1ecef9fd0f183cfd823ee0a3e9cb041a57752af4a7ccf8effabbb8943c976
Jul 20 16:43:15.069790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:15.069723    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw" event={"ID":"f242d874-7e9e-4a81-89d5-69050980e421","Type":"ContainerStarted","Data":"1c088fc003f596466ab52c45aab7626b701a07cc48044580c8b292a60659cdad"}
Jul 20 16:43:15.069790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:15.069782    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw" event={"ID":"f242d874-7e9e-4a81-89d5-69050980e421","Type":"ContainerStarted","Data":"a4e1ecef9fd0f183cfd823ee0a3e9cb041a57752af4a7ccf8effabbb8943c976"}
Jul 20 16:43:15.086070 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:15.086026    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw" podStartSLOduration=1.0860137380000001 podStartE2EDuration="1.086013738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:43:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:43:15.083963493 +0000 UTC m=+1751.445664057" watchObservedRunningTime="2026-07-20 16:43:15.086013738 +0000 UTC m=+1751.447714301"
Jul 20 16:43:16.075470 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:16.075434    2560 generic.go:356] "Generic (PLEG): container finished" podID="f242d874-7e9e-4a81-89d5-69050980e421" containerID="1c088fc003f596466ab52c45aab7626b701a07cc48044580c8b292a60659cdad" exitCode=0
Jul 20 16:43:16.075835 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:16.075512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw" event={"ID":"f242d874-7e9e-4a81-89d5-69050980e421","Type":"ContainerDied","Data":"1c088fc003f596466ab52c45aab7626b701a07cc48044580c8b292a60659cdad"}
Jul 20 16:43:17.207198 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:17.207177    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"
Jul 20 16:43:17.286278 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:17.286253    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f242d874-7e9e-4a81-89d5-69050980e421-maas-api-service-ca\") pod \"f242d874-7e9e-4a81-89d5-69050980e421\" (UID: \"f242d874-7e9e-4a81-89d5-69050980e421\") "
Jul 20 16:43:17.286625 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:17.286605    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f242d874-7e9e-4a81-89d5-69050980e421-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f242d874-7e9e-4a81-89d5-69050980e421" (UID: "f242d874-7e9e-4a81-89d5-69050980e421"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:43:17.387890 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:17.387825    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f242d874-7e9e-4a81-89d5-69050980e421-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:43:18.086197 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:18.086173    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"
Jul 20 16:43:18.086376 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:18.086224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw" event={"ID":"f242d874-7e9e-4a81-89d5-69050980e421","Type":"ContainerDied","Data":"a4e1ecef9fd0f183cfd823ee0a3e9cb041a57752af4a7ccf8effabbb8943c976"}
Jul 20 16:43:18.086376 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:18.086305    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4e1ecef9fd0f183cfd823ee0a3e9cb041a57752af4a7ccf8effabbb8943c976"
Jul 20 16:43:24.681034 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:24.680991    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"]
Jul 20 16:43:24.681417 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:24.681257    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8" podUID="aff950d4-d9d5-49ed-94bf-245ba5fda3da" containerName="maas-api" containerID="cri-o://7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f" gracePeriod=30
Jul 20 16:43:24.921706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:24.921682    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:43:25.042543 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.042520    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls\") pod \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") "
Jul 20 16:43:25.042698 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.042551    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff950d4-d9d5-49ed-94bf-245ba5fda3da-openshift-service-ca\") pod \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") "
Jul 20 16:43:25.042698 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.042585    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxpbl\" (UniqueName: \"kubernetes.io/projected/aff950d4-d9d5-49ed-94bf-245ba5fda3da-kube-api-access-zxpbl\") pod \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\" (UID: \"aff950d4-d9d5-49ed-94bf-245ba5fda3da\") "
Jul 20 16:43:25.042936 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.042911    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff950d4-d9d5-49ed-94bf-245ba5fda3da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aff950d4-d9d5-49ed-94bf-245ba5fda3da" (UID: "aff950d4-d9d5-49ed-94bf-245ba5fda3da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:43:25.044557 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.044532    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff950d4-d9d5-49ed-94bf-245ba5fda3da-kube-api-access-zxpbl" (OuterVolumeSpecName: "kube-api-access-zxpbl") pod "aff950d4-d9d5-49ed-94bf-245ba5fda3da" (UID: "aff950d4-d9d5-49ed-94bf-245ba5fda3da"). InnerVolumeSpecName "kube-api-access-zxpbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:43:25.044669 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.044600    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aff950d4-d9d5-49ed-94bf-245ba5fda3da" (UID: "aff950d4-d9d5-49ed-94bf-245ba5fda3da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:43:25.121369 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.121340    2560 generic.go:356] "Generic (PLEG): container finished" podID="aff950d4-d9d5-49ed-94bf-245ba5fda3da" containerID="7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f" exitCode=0
Jul 20 16:43:25.121495 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.121388    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"
Jul 20 16:43:25.121495 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.121423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8" event={"ID":"aff950d4-d9d5-49ed-94bf-245ba5fda3da","Type":"ContainerDied","Data":"7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f"}
Jul 20 16:43:25.121495 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.121473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8" event={"ID":"aff950d4-d9d5-49ed-94bf-245ba5fda3da","Type":"ContainerDied","Data":"bd873e51807ba038a4c768333bd8b1ad43adeb4ab22b64e3ff21263bfea204e2"}
Jul 20 16:43:25.121495 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.121494    2560 scope.go:117] "RemoveContainer" containerID="7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f"
Jul 20 16:43:25.129952 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.129939    2560 scope.go:117] "RemoveContainer" containerID="7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f"
Jul 20 16:43:25.130231 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:43:25.130214    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f\": container with ID starting with 7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f not found: ID does not exist" containerID="7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f"
Jul 20 16:43:25.130305 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.130239    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f"} err="failed to get container status \"7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f\": rpc error: code = NotFound desc = could not find container \"7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f\": container with ID starting with 7ddc242b45bda11480581431864db030a64606563a5182667b31430b2d30bf1f not found: ID does not exist"
Jul 20 16:43:25.143925 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.143897    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxpbl\" (UniqueName: \"kubernetes.io/projected/aff950d4-d9d5-49ed-94bf-245ba5fda3da-kube-api-access-zxpbl\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:43:25.143988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.143929    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff950d4-d9d5-49ed-94bf-245ba5fda3da-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:43:25.143988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.143939    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff950d4-d9d5-49ed-94bf-245ba5fda3da-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:43:25.172752 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.172724    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"]
Jul 20 16:43:25.182659 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.182637    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7bb30ee-5d8c9ff96d-56dg8"]
Jul 20 16:43:25.850306 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:25.850276    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff950d4-d9d5-49ed-94bf-245ba5fda3da" path="/var/lib/kubelet/pods/aff950d4-d9d5-49ed-94bf-245ba5fda3da/volumes"
Jul 20 16:43:27.678577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:27.678541    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:43:29.300048 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:29.300014    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"]
Jul 20 16:43:29.301980 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:29.301955    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7bb30ee-dtpsw"]
Jul 20 16:43:29.850534 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:29.850504    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f242d874-7e9e-4a81-89d5-69050980e421" path="/var/lib/kubelet/pods/f242d874-7e9e-4a81-89d5-69050980e421/volumes"
Jul 20 16:43:33.911805 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.911776    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"]
Jul 20 16:43:33.912269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.912063    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff950d4-d9d5-49ed-94bf-245ba5fda3da" containerName="maas-api"
Jul 20 16:43:33.912269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.912073    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff950d4-d9d5-49ed-94bf-245ba5fda3da" containerName="maas-api"
Jul 20 16:43:33.912269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.912083    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f242d874-7e9e-4a81-89d5-69050980e421" containerName="revoke-keys"
Jul 20 16:43:33.912269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.912088    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f242d874-7e9e-4a81-89d5-69050980e421" containerName="revoke-keys"
Jul 20 16:43:33.912269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.912173    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f242d874-7e9e-4a81-89d5-69050980e421" containerName="revoke-keys"
Jul 20 16:43:33.912269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.912187    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff950d4-d9d5-49ed-94bf-245ba5fda3da" containerName="maas-api"
Jul 20 16:43:33.916551 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.916528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:33.918785 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.918764    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 16:43:33.919035 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.919015    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-1172f5be-serving-cert\""
Jul 20 16:43:33.919103 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.919083    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\""
Jul 20 16:43:33.919767 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.919752    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 16:43:33.925851 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:33.925828    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"]
Jul 20 16:43:34.010228 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.010196    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-openshift-service-ca\") pod \"maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.010339 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.010291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-maas-api-tls\") pod \"maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.010339 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.010323    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lf2n\" (UniqueName: \"kubernetes.io/projected/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-kube-api-access-8lf2n\") pod \"maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.111371 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.111341    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-maas-api-tls\") pod \"maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.111500 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.111380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lf2n\" (UniqueName: \"kubernetes.io/projected/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-kube-api-access-8lf2n\") pod \"maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.111500 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.111428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-openshift-service-ca\") pod \"maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.112107 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.112089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-openshift-service-ca\") pod \"maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.113546 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.113529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-maas-api-tls\") pod \"maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.120843 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.120820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lf2n\" (UniqueName: \"kubernetes.io/projected/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-kube-api-access-8lf2n\") pod \"maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.228274 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.228218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:34.361848 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:34.359242    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"]
Jul 20 16:43:35.172200 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:35.172163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w" event={"ID":"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e","Type":"ContainerStarted","Data":"3c634975995edbc3d1de0547d78744a16e0ccea1675f1c6e95705204f48d746f"}
Jul 20 16:43:35.172538 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:35.172223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w" event={"ID":"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e","Type":"ContainerStarted","Data":"18593585dc5f19cb043f110e78db1594abfbab7e6ece300719d37e68d39595a6"}
Jul 20 16:43:35.172538 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:35.172367    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:35.188351 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:35.188305    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w" podStartSLOduration=1.581806381 podStartE2EDuration="2.188292472s" totalImagesPullingTime="606.486091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:43:35.187075188 +0000 UTC m=+1771.548775760" watchObservedRunningTime="2026-07-20 16:43:35.188292472 +0000 UTC m=+1771.549993073"
Jul 20 16:43:39.488141 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:39.488095    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:43:41.181730 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:41.181700    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:43:58.735754 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:58.735682    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"]
Jul 20 16:43:58.739152 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:58.739121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"
Jul 20 16:43:58.741438 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:58.741422    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:43:58.747285 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:58.747261    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"]
Jul 20 16:43:58.888683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:58.888659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/027b4a43-f2a1-4944-88e5-cb3014235a6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1172f5be-n4trp\" (UID: \"027b4a43-f2a1-4944-88e5-cb3014235a6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"
Jul 20 16:43:58.989275 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:58.989217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/027b4a43-f2a1-4944-88e5-cb3014235a6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1172f5be-n4trp\" (UID: \"027b4a43-f2a1-4944-88e5-cb3014235a6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"
Jul 20 16:43:58.989800 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:58.989780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/027b4a43-f2a1-4944-88e5-cb3014235a6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1172f5be-n4trp\" (UID: \"027b4a43-f2a1-4944-88e5-cb3014235a6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"
Jul 20 16:43:59.050794 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:59.050772    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"
Jul 20 16:43:59.381703 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:43:59.381680    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"]
Jul 20 16:43:59.383787 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:43:59.383757    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027b4a43_f2a1_4944_88e5_cb3014235a6a.slice/crio-2d207d62763137cc15b38e33424a1f6fd0144be6d8cc23d99951ab7e1cbe195b WatchSource:0}: Error finding container 2d207d62763137cc15b38e33424a1f6fd0144be6d8cc23d99951ab7e1cbe195b: Status 404 returned error can't find the container with id 2d207d62763137cc15b38e33424a1f6fd0144be6d8cc23d99951ab7e1cbe195b
Jul 20 16:44:00.298792 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:00.298758    2560 generic.go:356] "Generic (PLEG): container finished" podID="027b4a43-f2a1-4944-88e5-cb3014235a6a" containerID="fbb84c98e7d7d843d5d93130c3e9a78865df1e492dd0fb998a853655864e886a" exitCode=0
Jul 20 16:44:00.299158 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:00.298842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp" event={"ID":"027b4a43-f2a1-4944-88e5-cb3014235a6a","Type":"ContainerDied","Data":"fbb84c98e7d7d843d5d93130c3e9a78865df1e492dd0fb998a853655864e886a"}
Jul 20 16:44:00.299158 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:00.298893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp" event={"ID":"027b4a43-f2a1-4944-88e5-cb3014235a6a","Type":"ContainerStarted","Data":"2d207d62763137cc15b38e33424a1f6fd0144be6d8cc23d99951ab7e1cbe195b"}
Jul 20 16:44:01.431750 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:01.431725    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"
Jul 20 16:44:01.608075 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:01.608007    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/027b4a43-f2a1-4944-88e5-cb3014235a6a-maas-api-service-ca\") pod \"027b4a43-f2a1-4944-88e5-cb3014235a6a\" (UID: \"027b4a43-f2a1-4944-88e5-cb3014235a6a\") "
Jul 20 16:44:01.608350 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:01.608329    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/027b4a43-f2a1-4944-88e5-cb3014235a6a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "027b4a43-f2a1-4944-88e5-cb3014235a6a" (UID: "027b4a43-f2a1-4944-88e5-cb3014235a6a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:44:01.708711 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:01.708687    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/027b4a43-f2a1-4944-88e5-cb3014235a6a-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:44:02.309980 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:02.309952    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"
Jul 20 16:44:02.310142 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:02.309989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp" event={"ID":"027b4a43-f2a1-4944-88e5-cb3014235a6a","Type":"ContainerDied","Data":"2d207d62763137cc15b38e33424a1f6fd0144be6d8cc23d99951ab7e1cbe195b"}
Jul 20 16:44:02.310142 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:02.310041    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d207d62763137cc15b38e33424a1f6fd0144be6d8cc23d99951ab7e1cbe195b"
Jul 20 16:44:09.198690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.198653    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"]
Jul 20 16:44:09.199253 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.198914    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w" podUID="6d6a9bce-02d1-4462-88a2-95e4c99fcc6e" containerName="maas-api" containerID="cri-o://3c634975995edbc3d1de0547d78744a16e0ccea1675f1c6e95705204f48d746f" gracePeriod=30
Jul 20 16:44:09.346652 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.346622    2560 generic.go:356] "Generic (PLEG): container finished" podID="6d6a9bce-02d1-4462-88a2-95e4c99fcc6e" containerID="3c634975995edbc3d1de0547d78744a16e0ccea1675f1c6e95705204f48d746f" exitCode=0
Jul 20 16:44:09.346816 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.346704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w" event={"ID":"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e","Type":"ContainerDied","Data":"3c634975995edbc3d1de0547d78744a16e0ccea1675f1c6e95705204f48d746f"}
Jul 20 16:44:09.443529 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.443506    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:44:09.467146 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.467067    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-openshift-service-ca\") pod \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") "
Jul 20 16:44:09.467146 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.467108    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lf2n\" (UniqueName: \"kubernetes.io/projected/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-kube-api-access-8lf2n\") pod \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") "
Jul 20 16:44:09.467339 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.467200    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-maas-api-tls\") pod \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\" (UID: \"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e\") "
Jul 20 16:44:09.467424 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.467401    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d6a9bce-02d1-4462-88a2-95e4c99fcc6e" (UID: "6d6a9bce-02d1-4462-88a2-95e4c99fcc6e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:44:09.469267 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.469245    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d6a9bce-02d1-4462-88a2-95e4c99fcc6e" (UID: "6d6a9bce-02d1-4462-88a2-95e4c99fcc6e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:44:09.469267 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.469257    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-kube-api-access-8lf2n" (OuterVolumeSpecName: "kube-api-access-8lf2n") pod "6d6a9bce-02d1-4462-88a2-95e4c99fcc6e" (UID: "6d6a9bce-02d1-4462-88a2-95e4c99fcc6e"). InnerVolumeSpecName "kube-api-access-8lf2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:44:09.568451 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.568420    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:44:09.568451 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.568451    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:44:09.568451 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:09.568462    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lf2n\" (UniqueName: \"kubernetes.io/projected/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e-kube-api-access-8lf2n\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:44:10.353360 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:10.353327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w" event={"ID":"6d6a9bce-02d1-4462-88a2-95e4c99fcc6e","Type":"ContainerDied","Data":"18593585dc5f19cb043f110e78db1594abfbab7e6ece300719d37e68d39595a6"}
Jul 20 16:44:10.353360 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:10.353344    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"
Jul 20 16:44:10.353939 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:10.353391    2560 scope.go:117] "RemoveContainer" containerID="3c634975995edbc3d1de0547d78744a16e0ccea1675f1c6e95705204f48d746f"
Jul 20 16:44:10.368784 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:10.368761    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"]
Jul 20 16:44:10.372157 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:10.372121    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1172f5be-885dc4cbf-jnm7w"]
Jul 20 16:44:11.850460 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:11.850433    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d6a9bce-02d1-4462-88a2-95e4c99fcc6e" path="/var/lib/kubelet/pods/6d6a9bce-02d1-4462-88a2-95e4c99fcc6e/volumes"
Jul 20 16:44:12.286889 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:12.286858    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:44:13.813746 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:13.813684    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"]
Jul 20 16:44:13.816144 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:13.816114    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1172f5be-n4trp"]
Jul 20 16:44:13.850292 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:44:13.850265    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="027b4a43-f2a1-4944-88e5-cb3014235a6a" path="/var/lib/kubelet/pods/027b4a43-f2a1-4944-88e5-cb3014235a6a/volumes"
Jul 20 16:45:00.137299 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.137266    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5"]
Jul 20 16:45:00.139809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.137730    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6a9bce-02d1-4462-88a2-95e4c99fcc6e" containerName="maas-api"
Jul 20 16:45:00.139809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.137746    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6a9bce-02d1-4462-88a2-95e4c99fcc6e" containerName="maas-api"
Jul 20 16:45:00.139809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.137762    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="027b4a43-f2a1-4944-88e5-cb3014235a6a" containerName="revoke-keys"
Jul 20 16:45:00.139809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.137768    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="027b4a43-f2a1-4944-88e5-cb3014235a6a" containerName="revoke-keys"
Jul 20 16:45:00.139809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.137817    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6a9bce-02d1-4462-88a2-95e4c99fcc6e" containerName="maas-api"
Jul 20 16:45:00.139809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.137825    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="027b4a43-f2a1-4944-88e5-cb3014235a6a" containerName="revoke-keys"
Jul 20 16:45:00.140681 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.140659    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5"
Jul 20 16:45:00.159300 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.159276    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:45:00.162367 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.162345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5"]
Jul 20 16:45:00.162614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.162600    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5"
Jul 20 16:45:00.492541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.492468    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5"]
Jul 20 16:45:00.495664 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:45:00.495628    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e144ca_1630_4ee3_9f6d_8fb08824b01a.slice/crio-3b35f5a42ee0ff44431726de0eab3111e0bfd0b33698f4e71a0ab9644b2d3608 WatchSource:0}: Error finding container 3b35f5a42ee0ff44431726de0eab3111e0bfd0b33698f4e71a0ab9644b2d3608: Status 404 returned error can't find the container with id 3b35f5a42ee0ff44431726de0eab3111e0bfd0b33698f4e71a0ab9644b2d3608
Jul 20 16:45:00.606692 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:00.606664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5" event={"ID":"c4e144ca-1630-4ee3-9f6d-8fb08824b01a","Type":"ContainerStarted","Data":"3b35f5a42ee0ff44431726de0eab3111e0bfd0b33698f4e71a0ab9644b2d3608"}
Jul 20 16:45:01.612987 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:01.612957    2560 generic.go:356] "Generic (PLEG): container finished" podID="c4e144ca-1630-4ee3-9f6d-8fb08824b01a" containerID="298a4307a2d792d8b5acd1a6fb71fbb6fc739c799b04aecf6ad1b9d0e5fde2da" exitCode=0
Jul 20 16:45:01.613314 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:01.613020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5" event={"ID":"c4e144ca-1630-4ee3-9f6d-8fb08824b01a","Type":"ContainerDied","Data":"298a4307a2d792d8b5acd1a6fb71fbb6fc739c799b04aecf6ad1b9d0e5fde2da"}
Jul 20 16:45:02.747599 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:02.747573    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5"
Jul 20 16:45:03.626680 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:03.626648    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5"
Jul 20 16:45:03.626865 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:03.626676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742765-h82l5" event={"ID":"c4e144ca-1630-4ee3-9f6d-8fb08824b01a","Type":"ContainerDied","Data":"3b35f5a42ee0ff44431726de0eab3111e0bfd0b33698f4e71a0ab9644b2d3608"}
Jul 20 16:45:03.626865 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:03.626736    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b35f5a42ee0ff44431726de0eab3111e0bfd0b33698f4e71a0ab9644b2d3608"
Jul 20 16:45:40.392951 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:40.392916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:45:51.296142 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:51.296085    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:45:59.199990 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.199948    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"]
Jul 20 16:45:59.200493 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.200276    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e144ca-1630-4ee3-9f6d-8fb08824b01a" containerName="cleanup"
Jul 20 16:45:59.200493 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.200290    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e144ca-1630-4ee3-9f6d-8fb08824b01a" containerName="cleanup"
Jul 20 16:45:59.200493 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.200363    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e144ca-1630-4ee3-9f6d-8fb08824b01a" containerName="cleanup"
Jul 20 16:45:59.203465 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.203443    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.206096 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.206075    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-be2c65ba-serving-cert\""
Jul 20 16:45:59.206234 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.206077    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\""
Jul 20 16:45:59.206829 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.206811    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 16:45:59.207068 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.207052    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 16:45:59.215087 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.215068    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"]
Jul 20 16:45:59.274795 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.274775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af43601-84de-457f-94e3-146c467b920b-maas-api-tls\") pod \"maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.274916 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.274802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp8qg\" (UniqueName: \"kubernetes.io/projected/8af43601-84de-457f-94e3-146c467b920b-kube-api-access-tp8qg\") pod \"maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.274916 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.274845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af43601-84de-457f-94e3-146c467b920b-openshift-service-ca\") pod \"maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.376179 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.376152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af43601-84de-457f-94e3-146c467b920b-openshift-service-ca\") pod \"maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.376314 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.376215    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af43601-84de-457f-94e3-146c467b920b-maas-api-tls\") pod \"maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.376314 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.376239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp8qg\" (UniqueName: \"kubernetes.io/projected/8af43601-84de-457f-94e3-146c467b920b-kube-api-access-tp8qg\") pod \"maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.376794 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.376774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af43601-84de-457f-94e3-146c467b920b-openshift-service-ca\") pod \"maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.378890 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.378867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af43601-84de-457f-94e3-146c467b920b-maas-api-tls\") pod \"maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.388775 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.388751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp8qg\" (UniqueName: \"kubernetes.io/projected/8af43601-84de-457f-94e3-146c467b920b-kube-api-access-tp8qg\") pod \"maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.514093 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.514036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:45:59.648672 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.648648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"]
Jul 20 16:45:59.650513 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:45:59.650486    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af43601_84de_457f_94e3_146c467b920b.slice/crio-4354e1a9edc5a8c022f03014cb4176864b46eb690798c9fd11ce23faa5ce2a38 WatchSource:0}: Error finding container 4354e1a9edc5a8c022f03014cb4176864b46eb690798c9fd11ce23faa5ce2a38: Status 404 returned error can't find the container with id 4354e1a9edc5a8c022f03014cb4176864b46eb690798c9fd11ce23faa5ce2a38
Jul 20 16:45:59.931268 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:45:59.931229    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f" event={"ID":"8af43601-84de-457f-94e3-146c467b920b","Type":"ContainerStarted","Data":"4354e1a9edc5a8c022f03014cb4176864b46eb690798c9fd11ce23faa5ce2a38"}
Jul 20 16:46:00.937148 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:00.937089    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f" event={"ID":"8af43601-84de-457f-94e3-146c467b920b","Type":"ContainerStarted","Data":"22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91"}
Jul 20 16:46:00.937594 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:00.937182    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:46:00.957263 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:00.957215    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f" podStartSLOduration=1.414344149 podStartE2EDuration="1.957201137s" totalImagesPullingTime="542.856988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:46:00.954422369 +0000 UTC m=+1917.316122941" watchObservedRunningTime="2026-07-20 16:46:00.957201137 +0000 UTC m=+1917.318901699"
Jul 20 16:46:04.492237 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:04.492201    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:46:06.946087 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:06.946056    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:46:10.578306 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:10.578272    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"]
Jul 20 16:46:10.581509 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:10.581493    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"
Jul 20 16:46:10.584389 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:10.584369    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:46:10.590852 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:10.590827    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"]
Jul 20 16:46:10.659838 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:10.659814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5182af9e-383c-4327-9369-c706afa8726e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-be2c65ba-56spt\" (UID: \"5182af9e-383c-4327-9369-c706afa8726e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"
Jul 20 16:46:10.760181 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:10.760153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5182af9e-383c-4327-9369-c706afa8726e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-be2c65ba-56spt\" (UID: \"5182af9e-383c-4327-9369-c706afa8726e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"
Jul 20 16:46:10.760751 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:10.760733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5182af9e-383c-4327-9369-c706afa8726e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-be2c65ba-56spt\" (UID: \"5182af9e-383c-4327-9369-c706afa8726e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"
Jul 20 16:46:10.892397 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:10.892346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"
Jul 20 16:46:11.029002 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:11.028980    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"]
Jul 20 16:46:11.031067 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:46:11.031043    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5182af9e_383c_4327_9369_c706afa8726e.slice/crio-11ae475ca2f1f45ffb4b3bec8872384c327343af23a54beddf23125f49d2946c WatchSource:0}: Error finding container 11ae475ca2f1f45ffb4b3bec8872384c327343af23a54beddf23125f49d2946c: Status 404 returned error can't find the container with id 11ae475ca2f1f45ffb4b3bec8872384c327343af23a54beddf23125f49d2946c
Jul 20 16:46:11.998706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:11.998635    2560 generic.go:356] "Generic (PLEG): container finished" podID="5182af9e-383c-4327-9369-c706afa8726e" containerID="04c3bcaa8400792add6013484e365e23b1cdc8849b36723db7d3317e85a74773" exitCode=0
Jul 20 16:46:11.998706 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:11.998684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt" event={"ID":"5182af9e-383c-4327-9369-c706afa8726e","Type":"ContainerDied","Data":"04c3bcaa8400792add6013484e365e23b1cdc8849b36723db7d3317e85a74773"}
Jul 20 16:46:11.999180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:11.998725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt" event={"ID":"5182af9e-383c-4327-9369-c706afa8726e","Type":"ContainerStarted","Data":"11ae475ca2f1f45ffb4b3bec8872384c327343af23a54beddf23125f49d2946c"}
Jul 20 16:46:13.131965 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:13.131938    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"
Jul 20 16:46:13.177859 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:13.177830    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5182af9e-383c-4327-9369-c706afa8726e-maas-api-service-ca\") pod \"5182af9e-383c-4327-9369-c706afa8726e\" (UID: \"5182af9e-383c-4327-9369-c706afa8726e\") "
Jul 20 16:46:13.178155 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:13.178121    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5182af9e-383c-4327-9369-c706afa8726e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5182af9e-383c-4327-9369-c706afa8726e" (UID: "5182af9e-383c-4327-9369-c706afa8726e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:46:13.278978 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:13.278956    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5182af9e-383c-4327-9369-c706afa8726e-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:46:14.009865 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:14.009835    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"
Jul 20 16:46:14.010024 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:14.009833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt" event={"ID":"5182af9e-383c-4327-9369-c706afa8726e","Type":"ContainerDied","Data":"11ae475ca2f1f45ffb4b3bec8872384c327343af23a54beddf23125f49d2946c"}
Jul 20 16:46:14.010024 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:14.009982    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11ae475ca2f1f45ffb4b3bec8872384c327343af23a54beddf23125f49d2946c"
Jul 20 16:46:21.047825 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.047791    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"]
Jul 20 16:46:21.048340 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.048009    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f" podUID="8af43601-84de-457f-94e3-146c467b920b" containerName="maas-api" containerID="cri-o://22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91" gracePeriod=30
Jul 20 16:46:21.286930 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.286906    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:46:21.335165 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.335107    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af43601-84de-457f-94e3-146c467b920b-maas-api-tls\") pod \"8af43601-84de-457f-94e3-146c467b920b\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") "
Jul 20 16:46:21.335374 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.335180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp8qg\" (UniqueName: \"kubernetes.io/projected/8af43601-84de-457f-94e3-146c467b920b-kube-api-access-tp8qg\") pod \"8af43601-84de-457f-94e3-146c467b920b\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") "
Jul 20 16:46:21.335374 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.335206    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af43601-84de-457f-94e3-146c467b920b-openshift-service-ca\") pod \"8af43601-84de-457f-94e3-146c467b920b\" (UID: \"8af43601-84de-457f-94e3-146c467b920b\") "
Jul 20 16:46:21.335600 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.335578    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8af43601-84de-457f-94e3-146c467b920b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8af43601-84de-457f-94e3-146c467b920b" (UID: "8af43601-84de-457f-94e3-146c467b920b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:46:21.337139 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.337110    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8af43601-84de-457f-94e3-146c467b920b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8af43601-84de-457f-94e3-146c467b920b" (UID: "8af43601-84de-457f-94e3-146c467b920b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:46:21.337256 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.337238    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af43601-84de-457f-94e3-146c467b920b-kube-api-access-tp8qg" (OuterVolumeSpecName: "kube-api-access-tp8qg") pod "8af43601-84de-457f-94e3-146c467b920b" (UID: "8af43601-84de-457f-94e3-146c467b920b"). InnerVolumeSpecName "kube-api-access-tp8qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:46:21.435739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.435716    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af43601-84de-457f-94e3-146c467b920b-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:46:21.435739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.435739    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp8qg\" (UniqueName: \"kubernetes.io/projected/8af43601-84de-457f-94e3-146c467b920b-kube-api-access-tp8qg\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:46:21.435859 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:21.435750    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af43601-84de-457f-94e3-146c467b920b-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:46:22.050678 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:22.050644    2560 generic.go:356] "Generic (PLEG): container finished" podID="8af43601-84de-457f-94e3-146c467b920b" containerID="22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91" exitCode=0
Jul 20 16:46:22.051014 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:22.050699    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"
Jul 20 16:46:22.051014 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:22.050714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f" event={"ID":"8af43601-84de-457f-94e3-146c467b920b","Type":"ContainerDied","Data":"22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91"}
Jul 20 16:46:22.051014 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:22.050761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f" event={"ID":"8af43601-84de-457f-94e3-146c467b920b","Type":"ContainerDied","Data":"4354e1a9edc5a8c022f03014cb4176864b46eb690798c9fd11ce23faa5ce2a38"}
Jul 20 16:46:22.051014 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:22.050783    2560 scope.go:117] "RemoveContainer" containerID="22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91"
Jul 20 16:46:22.059813 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:22.059794    2560 scope.go:117] "RemoveContainer" containerID="22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91"
Jul 20 16:46:22.060086 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:46:22.060067    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91\": container with ID starting with 22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91 not found: ID does not exist" containerID="22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91"
Jul 20 16:46:22.060195 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:22.060093    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91"} err="failed to get container status \"22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91\": rpc error: code = NotFound desc = could not find container \"22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91\": container with ID starting with 22d8572a28bef4d500f9722e6ba1d3debb821d25f8a7527abb2a2ae9ece06c91 not found: ID does not exist"
Jul 20 16:46:22.068850 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:22.068829    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"]
Jul 20 16:46:22.072286 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:22.072263    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-be2c65ba-65dd5fd57d-4x48f"]
Jul 20 16:46:23.850784 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:23.850751    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8af43601-84de-457f-94e3-146c467b920b" path="/var/lib/kubelet/pods/8af43601-84de-457f-94e3-146c467b920b/volumes"
Jul 20 16:46:24.284442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:24.284409    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:46:25.666787 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:25.666734    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"]
Jul 20 16:46:25.669179 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:25.669143    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be2c65ba-56spt"]
Jul 20 16:46:25.850508 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:25.850478    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5182af9e-383c-4327-9369-c706afa8726e" path="/var/lib/kubelet/pods/5182af9e-383c-4327-9369-c706afa8726e/volumes"
Jul 20 16:46:54.483858 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.483821    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"]
Jul 20 16:46:54.484458 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.484270    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8af43601-84de-457f-94e3-146c467b920b" containerName="maas-api"
Jul 20 16:46:54.484458 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.484289    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8af43601-84de-457f-94e3-146c467b920b" containerName="maas-api"
Jul 20 16:46:54.484458 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.484347    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5182af9e-383c-4327-9369-c706afa8726e" containerName="revoke-keys"
Jul 20 16:46:54.484458 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.484357    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5182af9e-383c-4327-9369-c706afa8726e" containerName="revoke-keys"
Jul 20 16:46:54.484458 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.484436    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8af43601-84de-457f-94e3-146c467b920b" containerName="maas-api"
Jul 20 16:46:54.484458 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.484450    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5182af9e-383c-4327-9369-c706afa8726e" containerName="revoke-keys"
Jul 20 16:46:54.487571 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.487551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.490018 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.489999    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3b97b792-serving-cert\""
Jul 20 16:46:54.490018 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.490011    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 16:46:54.490159 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.490029    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 16:46:54.490927 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.490906    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\""
Jul 20 16:46:54.497268 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.497248    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"]
Jul 20 16:46:54.590936 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.590900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wbgs\" (UniqueName: \"kubernetes.io/projected/d283213a-a111-4d4d-b0b2-8ec15b333712-kube-api-access-2wbgs\") pod \"maas-api-e2e-mt-3b97b792-8b954768f-6g2bz\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.590936 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.590937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d283213a-a111-4d4d-b0b2-8ec15b333712-openshift-service-ca\") pod \"maas-api-e2e-mt-3b97b792-8b954768f-6g2bz\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.591084 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.590973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d283213a-a111-4d4d-b0b2-8ec15b333712-maas-api-tls\") pod \"maas-api-e2e-mt-3b97b792-8b954768f-6g2bz\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.692040 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.692011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wbgs\" (UniqueName: \"kubernetes.io/projected/d283213a-a111-4d4d-b0b2-8ec15b333712-kube-api-access-2wbgs\") pod \"maas-api-e2e-mt-3b97b792-8b954768f-6g2bz\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.692040 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.692042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d283213a-a111-4d4d-b0b2-8ec15b333712-openshift-service-ca\") pod \"maas-api-e2e-mt-3b97b792-8b954768f-6g2bz\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.692219 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.692067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d283213a-a111-4d4d-b0b2-8ec15b333712-maas-api-tls\") pod \"maas-api-e2e-mt-3b97b792-8b954768f-6g2bz\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.692655 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.692638    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d283213a-a111-4d4d-b0b2-8ec15b333712-openshift-service-ca\") pod \"maas-api-e2e-mt-3b97b792-8b954768f-6g2bz\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.694498 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.694477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d283213a-a111-4d4d-b0b2-8ec15b333712-maas-api-tls\") pod \"maas-api-e2e-mt-3b97b792-8b954768f-6g2bz\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.700475 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.700452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wbgs\" (UniqueName: \"kubernetes.io/projected/d283213a-a111-4d4d-b0b2-8ec15b333712-kube-api-access-2wbgs\") pod \"maas-api-e2e-mt-3b97b792-8b954768f-6g2bz\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.798739 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.798717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:54.928323 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.928288    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"]
Jul 20 16:46:54.929951 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:46:54.929928    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd283213a_a111_4d4d_b0b2_8ec15b333712.slice/crio-7a182570c4ddc6700fcf0f0efdf64c5483c593160d88fd4c00d53d9b90bc00a3 WatchSource:0}: Error finding container 7a182570c4ddc6700fcf0f0efdf64c5483c593160d88fd4c00d53d9b90bc00a3: Status 404 returned error can't find the container with id 7a182570c4ddc6700fcf0f0efdf64c5483c593160d88fd4c00d53d9b90bc00a3
Jul 20 16:46:54.931524 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:54.931508    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 16:46:55.220905 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:55.220818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz" event={"ID":"d283213a-a111-4d4d-b0b2-8ec15b333712","Type":"ContainerStarted","Data":"7a182570c4ddc6700fcf0f0efdf64c5483c593160d88fd4c00d53d9b90bc00a3"}
Jul 20 16:46:57.231927 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:57.231895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz" event={"ID":"d283213a-a111-4d4d-b0b2-8ec15b333712","Type":"ContainerStarted","Data":"89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d"}
Jul 20 16:46:57.232330 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:57.232026    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:46:57.248988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:46:57.248937    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz" podStartSLOduration=1.551651123 podStartE2EDuration="3.248919151s" totalImagesPullingTime="1.697268028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:46:57.248288188 +0000 UTC m=+1973.609988751" watchObservedRunningTime="2026-07-20 16:46:57.248919151 +0000 UTC m=+1973.610619716"
Jul 20 16:47:00.586792 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:00.586757    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:47:03.242867 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:03.242837    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:47:09.382201 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:09.382170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:47:28.600657 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:28.600615    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:47:32.285165 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:32.285109    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"]
Jul 20 16:47:32.288994 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:32.288971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"
Jul 20 16:47:32.293161 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:32.293121    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:47:32.321720 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:32.321697    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"]
Jul 20 16:47:32.373601 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:32.373578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85380e9-b89f-4162-9bca-f59b593c7314-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc\" (UID: \"b85380e9-b89f-4162-9bca-f59b593c7314\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"
Jul 20 16:47:32.474186 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:32.474159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85380e9-b89f-4162-9bca-f59b593c7314-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc\" (UID: \"b85380e9-b89f-4162-9bca-f59b593c7314\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"
Jul 20 16:47:32.474690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:32.474672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85380e9-b89f-4162-9bca-f59b593c7314-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc\" (UID: \"b85380e9-b89f-4162-9bca-f59b593c7314\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"
Jul 20 16:47:32.602614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:32.602550    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"
Jul 20 16:47:32.733329 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:32.733303    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"]
Jul 20 16:47:32.735869 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:47:32.735841    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85380e9_b89f_4162_9bca_f59b593c7314.slice/crio-9b1ad6f59a3997d20e996f3bef319590bce90c539eddd88f5f2fa181e944587a WatchSource:0}: Error finding container 9b1ad6f59a3997d20e996f3bef319590bce90c539eddd88f5f2fa181e944587a: Status 404 returned error can't find the container with id 9b1ad6f59a3997d20e996f3bef319590bce90c539eddd88f5f2fa181e944587a
Jul 20 16:47:33.419999 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:33.419969    2560 generic.go:356] "Generic (PLEG): container finished" podID="b85380e9-b89f-4162-9bca-f59b593c7314" containerID="0dfd49878c7487e858d2f1b1e30f3b9e7260dd301eaa8e7154da8055a5970b3f" exitCode=0
Jul 20 16:47:33.420353 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:33.420058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc" event={"ID":"b85380e9-b89f-4162-9bca-f59b593c7314","Type":"ContainerDied","Data":"0dfd49878c7487e858d2f1b1e30f3b9e7260dd301eaa8e7154da8055a5970b3f"}
Jul 20 16:47:33.420353 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:33.420105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc" event={"ID":"b85380e9-b89f-4162-9bca-f59b593c7314","Type":"ContainerStarted","Data":"9b1ad6f59a3997d20e996f3bef319590bce90c539eddd88f5f2fa181e944587a"}
Jul 20 16:47:34.559101 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:34.559080    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"
Jul 20 16:47:34.593416 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:34.593394    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85380e9-b89f-4162-9bca-f59b593c7314-maas-api-service-ca\") pod \"b85380e9-b89f-4162-9bca-f59b593c7314\" (UID: \"b85380e9-b89f-4162-9bca-f59b593c7314\") "
Jul 20 16:47:34.593707 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:34.593688    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85380e9-b89f-4162-9bca-f59b593c7314-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b85380e9-b89f-4162-9bca-f59b593c7314" (UID: "b85380e9-b89f-4162-9bca-f59b593c7314"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:47:34.694336 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:34.694284    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b85380e9-b89f-4162-9bca-f59b593c7314-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:47:35.432147 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:35.432095    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"
Jul 20 16:47:35.432147 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:35.432120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc" event={"ID":"b85380e9-b89f-4162-9bca-f59b593c7314","Type":"ContainerDied","Data":"9b1ad6f59a3997d20e996f3bef319590bce90c539eddd88f5f2fa181e944587a"}
Jul 20 16:47:35.432413 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:35.432185    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b1ad6f59a3997d20e996f3bef319590bce90c539eddd88f5f2fa181e944587a"
Jul 20 16:47:46.798301 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:46.798266    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:47:47.841858 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:47.841819    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"]
Jul 20 16:47:47.842368 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:47.842046    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz" podUID="d283213a-a111-4d4d-b0b2-8ec15b333712" containerName="maas-api" containerID="cri-o://89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d" gracePeriod=30
Jul 20 16:47:48.087987 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.087965    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:47:48.199813 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.199750    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wbgs\" (UniqueName: \"kubernetes.io/projected/d283213a-a111-4d4d-b0b2-8ec15b333712-kube-api-access-2wbgs\") pod \"d283213a-a111-4d4d-b0b2-8ec15b333712\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") "
Jul 20 16:47:48.199813 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.199815    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d283213a-a111-4d4d-b0b2-8ec15b333712-maas-api-tls\") pod \"d283213a-a111-4d4d-b0b2-8ec15b333712\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") "
Jul 20 16:47:48.200018 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.199874    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d283213a-a111-4d4d-b0b2-8ec15b333712-openshift-service-ca\") pod \"d283213a-a111-4d4d-b0b2-8ec15b333712\" (UID: \"d283213a-a111-4d4d-b0b2-8ec15b333712\") "
Jul 20 16:47:48.200225 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.200200    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d283213a-a111-4d4d-b0b2-8ec15b333712-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d283213a-a111-4d4d-b0b2-8ec15b333712" (UID: "d283213a-a111-4d4d-b0b2-8ec15b333712"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:47:48.201733 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.201705    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d283213a-a111-4d4d-b0b2-8ec15b333712-kube-api-access-2wbgs" (OuterVolumeSpecName: "kube-api-access-2wbgs") pod "d283213a-a111-4d4d-b0b2-8ec15b333712" (UID: "d283213a-a111-4d4d-b0b2-8ec15b333712"). InnerVolumeSpecName "kube-api-access-2wbgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:47:48.201822 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.201732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d283213a-a111-4d4d-b0b2-8ec15b333712-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d283213a-a111-4d4d-b0b2-8ec15b333712" (UID: "d283213a-a111-4d4d-b0b2-8ec15b333712"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:47:48.300650 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.300624    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d283213a-a111-4d4d-b0b2-8ec15b333712-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:47:48.300650 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.300646    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wbgs\" (UniqueName: \"kubernetes.io/projected/d283213a-a111-4d4d-b0b2-8ec15b333712-kube-api-access-2wbgs\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:47:48.300767 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.300657    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d283213a-a111-4d4d-b0b2-8ec15b333712-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:47:48.501120 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.501053    2560 generic.go:356] "Generic (PLEG): container finished" podID="d283213a-a111-4d4d-b0b2-8ec15b333712" containerID="89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d" exitCode=0
Jul 20 16:47:48.501120 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.501102    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"
Jul 20 16:47:48.501269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.501165    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz" event={"ID":"d283213a-a111-4d4d-b0b2-8ec15b333712","Type":"ContainerDied","Data":"89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d"}
Jul 20 16:47:48.501269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.501225    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz" event={"ID":"d283213a-a111-4d4d-b0b2-8ec15b333712","Type":"ContainerDied","Data":"7a182570c4ddc6700fcf0f0efdf64c5483c593160d88fd4c00d53d9b90bc00a3"}
Jul 20 16:47:48.501269 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.501253    2560 scope.go:117] "RemoveContainer" containerID="89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d"
Jul 20 16:47:48.510795 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.510773    2560 scope.go:117] "RemoveContainer" containerID="89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d"
Jul 20 16:47:48.511097 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:47:48.511074    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d\": container with ID starting with 89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d not found: ID does not exist" containerID="89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d"
Jul 20 16:47:48.511187 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.511110    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d"} err="failed to get container status \"89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d\": rpc error: code = NotFound desc = could not find container \"89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d\": container with ID starting with 89fb5296a1e13514905a7521de0107cc6fe2adbba016a9742b6056da21aa8f7d not found: ID does not exist"
Jul 20 16:47:48.523223 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.523195    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"]
Jul 20 16:47:48.526550 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:48.526525    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b97b792-8b954768f-6g2bz"]
Jul 20 16:47:49.856910 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:49.856874    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d283213a-a111-4d4d-b0b2-8ec15b333712" path="/var/lib/kubelet/pods/d283213a-a111-4d4d-b0b2-8ec15b333712/volumes"
Jul 20 16:47:52.385654 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:52.385614    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"]
Jul 20 16:47:52.390101 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:52.390071    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b97b792-pqlvc"]
Jul 20 16:47:53.850837 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:53.850797    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b85380e9-b89f-4162-9bca-f59b593c7314" path="/var/lib/kubelet/pods/b85380e9-b89f-4162-9bca-f59b593c7314/volumes"
Jul 20 16:47:55.192504 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:47:55.192464    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:48:04.248893 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:48:04.248860    2560 scope.go:117] "RemoveContainer" containerID="91c1dbc525882a33e4b86d7e58c498012167cc0d3fd8bc34de7eed50bccc80fd"
Jul 20 16:48:46.606927 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:48:46.606894    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:48:56.292236 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:48:56.292202    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:49:04.272248 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:04.272219    2560 scope.go:117] "RemoveContainer" containerID="5a72cbf515b0ce93aa99f40e8b26401453435b60daa1ca1db6e96e6e374fb2ff"
Jul 20 16:49:42.249849 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.249819    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"]
Jul 20 16:49:42.250260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.250115    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d283213a-a111-4d4d-b0b2-8ec15b333712" containerName="maas-api"
Jul 20 16:49:42.250260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.250141    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d283213a-a111-4d4d-b0b2-8ec15b333712" containerName="maas-api"
Jul 20 16:49:42.250260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.250155    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85380e9-b89f-4162-9bca-f59b593c7314" containerName="revoke-keys"
Jul 20 16:49:42.250260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.250161    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85380e9-b89f-4162-9bca-f59b593c7314" containerName="revoke-keys"
Jul 20 16:49:42.250260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.250205    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d283213a-a111-4d4d-b0b2-8ec15b333712" containerName="maas-api"
Jul 20 16:49:42.250260 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.250216    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b85380e9-b89f-4162-9bca-f59b593c7314" containerName="revoke-keys"
Jul 20 16:49:42.252997 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.252976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:42.258901 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.258882    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2acd56-serving-cert\""
Jul 20 16:49:42.259775 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.259264    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 16:49:42.259775 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.259268    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 16:49:42.259775 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.259330    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\""
Jul 20 16:49:42.273982 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.273958    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"]
Jul 20 16:49:42.446494 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.446462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0541b656-81b4-4fed-8402-192c1960dccd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:42.446630 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.446520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw9k5\" (UniqueName: \"kubernetes.io/projected/0541b656-81b4-4fed-8402-192c1960dccd-kube-api-access-bw9k5\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:42.446630 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.446594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0541b656-81b4-4fed-8402-192c1960dccd-maas-api-tls\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:42.547715 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.547690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0541b656-81b4-4fed-8402-192c1960dccd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:42.547826 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.547741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw9k5\" (UniqueName: \"kubernetes.io/projected/0541b656-81b4-4fed-8402-192c1960dccd-kube-api-access-bw9k5\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:42.547872 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.547857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0541b656-81b4-4fed-8402-192c1960dccd-maas-api-tls\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:42.547973 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:49:42.547959    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-serving-cert: secret "maas-api-e2e-inf-a-2acd56-serving-cert" not found
Jul 20 16:49:42.548032 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:49:42.548024    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0541b656-81b4-4fed-8402-192c1960dccd-maas-api-tls podName:0541b656-81b4-4fed-8402-192c1960dccd nodeName:}" failed. No retries permitted until 2026-07-20 16:49:43.048009305 +0000 UTC m=+2139.409709845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0541b656-81b4-4fed-8402-192c1960dccd-maas-api-tls") pod "maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl" (UID: "0541b656-81b4-4fed-8402-192c1960dccd") : secret "maas-api-e2e-inf-a-2acd56-serving-cert" not found
Jul 20 16:49:42.548292 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.548277    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0541b656-81b4-4fed-8402-192c1960dccd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:42.556566 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:42.556540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw9k5\" (UniqueName: \"kubernetes.io/projected/0541b656-81b4-4fed-8402-192c1960dccd-kube-api-access-bw9k5\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:43.051576 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:43.051548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0541b656-81b4-4fed-8402-192c1960dccd-maas-api-tls\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:43.054097 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:43.054074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0541b656-81b4-4fed-8402-192c1960dccd-maas-api-tls\") pod \"maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:43.162895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:43.162868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:43.291292 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:43.291262    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"]
Jul 20 16:49:43.292300 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:49:43.292267    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0541b656_81b4_4fed_8402_192c1960dccd.slice/crio-9204a15817c5f96dfb8c219cbd4298fff55a62e6911cd16936f1027c330add17 WatchSource:0}: Error finding container 9204a15817c5f96dfb8c219cbd4298fff55a62e6911cd16936f1027c330add17: Status 404 returned error can't find the container with id 9204a15817c5f96dfb8c219cbd4298fff55a62e6911cd16936f1027c330add17
Jul 20 16:49:44.107227 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:44.107193    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl" event={"ID":"0541b656-81b4-4fed-8402-192c1960dccd","Type":"ContainerStarted","Data":"6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711"}
Jul 20 16:49:44.107387 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:44.107278    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:44.107387 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:44.107298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl" event={"ID":"0541b656-81b4-4fed-8402-192c1960dccd","Type":"ContainerStarted","Data":"9204a15817c5f96dfb8c219cbd4298fff55a62e6911cd16936f1027c330add17"}
Jul 20 16:49:47.129095 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:47.129039    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl" podStartSLOduration=4.665911982 podStartE2EDuration="5.129013538s" totalImagesPullingTime="463.101556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:49:44.130319042 +0000 UTC m=+2140.492019607" watchObservedRunningTime="2026-07-20 16:49:47.129013538 +0000 UTC m=+2143.490714151"
Jul 20 16:49:47.129563 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:47.129546    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:49:50.118115 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:50.118079    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:49:51.265149 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.265107    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"]
Jul 20 16:49:51.268522 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.268505    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.271794 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.271773    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-59dc77-serving-cert\""
Jul 20 16:49:51.289950 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.289926    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"]
Jul 20 16:49:51.308618 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.308592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f22446a0-98cc-4563-9e46-c28c3635174f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.308730 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.308623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdrlf\" (UniqueName: \"kubernetes.io/projected/f22446a0-98cc-4563-9e46-c28c3635174f-kube-api-access-cdrlf\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.308730 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.308702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f22446a0-98cc-4563-9e46-c28c3635174f-maas-api-tls\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.409930 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.409845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f22446a0-98cc-4563-9e46-c28c3635174f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.410030 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.409956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdrlf\" (UniqueName: \"kubernetes.io/projected/f22446a0-98cc-4563-9e46-c28c3635174f-kube-api-access-cdrlf\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.410030 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.410012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f22446a0-98cc-4563-9e46-c28c3635174f-maas-api-tls\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.410170 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:49:51.410154    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-serving-cert: secret "maas-api-e2e-inf-b-59dc77-serving-cert" not found
Jul 20 16:49:51.410237 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:49:51.410226    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22446a0-98cc-4563-9e46-c28c3635174f-maas-api-tls podName:f22446a0-98cc-4563-9e46-c28c3635174f nodeName:}" failed. No retries permitted until 2026-07-20 16:49:51.910209036 +0000 UTC m=+2148.271909595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f22446a0-98cc-4563-9e46-c28c3635174f-maas-api-tls") pod "maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds" (UID: "f22446a0-98cc-4563-9e46-c28c3635174f") : secret "maas-api-e2e-inf-b-59dc77-serving-cert" not found
Jul 20 16:49:51.410444 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.410426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f22446a0-98cc-4563-9e46-c28c3635174f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.421964 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.421945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdrlf\" (UniqueName: \"kubernetes.io/projected/f22446a0-98cc-4563-9e46-c28c3635174f-kube-api-access-cdrlf\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.913430 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.913405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f22446a0-98cc-4563-9e46-c28c3635174f-maas-api-tls\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:51.915789 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:51.915768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f22446a0-98cc-4563-9e46-c28c3635174f-maas-api-tls\") pod \"maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:52.177979 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:52.177904    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:52.316448 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:52.316427    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"]
Jul 20 16:49:52.318673 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:49:52.318645    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22446a0_98cc_4563_9e46_c28c3635174f.slice/crio-eaf3c6947e618d51c9abec66a9c97184c1a07302c72c0a4e06d65fdac2db9f10 WatchSource:0}: Error finding container eaf3c6947e618d51c9abec66a9c97184c1a07302c72c0a4e06d65fdac2db9f10: Status 404 returned error can't find the container with id eaf3c6947e618d51c9abec66a9c97184c1a07302c72c0a4e06d65fdac2db9f10
Jul 20 16:49:53.153457 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:53.153380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds" event={"ID":"f22446a0-98cc-4563-9e46-c28c3635174f","Type":"ContainerStarted","Data":"cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824"}
Jul 20 16:49:53.153457 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:53.153429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds" event={"ID":"f22446a0-98cc-4563-9e46-c28c3635174f","Type":"ContainerStarted","Data":"eaf3c6947e618d51c9abec66a9c97184c1a07302c72c0a4e06d65fdac2db9f10"}
Jul 20 16:49:53.153644 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:53.153521    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:49:53.182104 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:53.182058    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds" podStartSLOduration=1.687210155 podStartE2EDuration="2.182044926s" totalImagesPullingTime="494.834771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:49:53.180793741 +0000 UTC m=+2149.542494304" watchObservedRunningTime="2026-07-20 16:49:53.182044926 +0000 UTC m=+2149.543745501"
Jul 20 16:49:57.515424 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.515336    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"]
Jul 20 16:49:57.518837 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.518817    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.522110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.522091    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2acd56\"/\"test-model-2acd56-kserve-self-signed-certs\""
Jul 20 16:49:57.522963 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.522940    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2acd56\"/\"openshift-service-ca.crt\""
Jul 20 16:49:57.522963 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.522950    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2acd56\"/\"default-dockercfg-z95f6\""
Jul 20 16:49:57.523147 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.522974    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2acd56\"/\"kube-root-ca.crt\""
Jul 20 16:49:57.535065 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.535042    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"]
Jul 20 16:49:57.555818 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.555792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-dshm\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.555926 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.555829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-home\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.555926 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.555853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-model-cache\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.555926 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.555880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-tmp-dir\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.556051 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.555960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a057b27-99c1-41ec-be83-3818ff7df255-tls-certs\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.556051 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.556013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z2sw\" (UniqueName: \"kubernetes.io/projected/0a057b27-99c1-41ec-be83-3818ff7df255-kube-api-access-9z2sw\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.657252 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.657224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-home\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.657252 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.657253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-model-cache\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.657474 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.657275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-tmp-dir\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.657474 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.657311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a057b27-99c1-41ec-be83-3818ff7df255-tls-certs\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.657474 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.657346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z2sw\" (UniqueName: \"kubernetes.io/projected/0a057b27-99c1-41ec-be83-3818ff7df255-kube-api-access-9z2sw\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.657474 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.657437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-dshm\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.657690 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.657642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-home\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.657757 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.657689    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-model-cache\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.657757 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.657738    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-tmp-dir\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.659529 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.659506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-dshm\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.659942 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.659923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a057b27-99c1-41ec-be83-3818ff7df255-tls-certs\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.665806 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.665785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z2sw\" (UniqueName: \"kubernetes.io/projected/0a057b27-99c1-41ec-be83-3818ff7df255-kube-api-access-9z2sw\") pod \"test-model-2acd56-kserve-55d989976c-5sqf8\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") " pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.827925 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.827895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:49:57.968331 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:57.968245    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"]
Jul 20 16:49:57.971037 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:49:57.971002    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a057b27_99c1_41ec_be83_3818ff7df255.slice/crio-2dbda75694d1cce4fdc02cceaee1bdf7e1a90c0e97812cd0f18260718a4edb10 WatchSource:0}: Error finding container 2dbda75694d1cce4fdc02cceaee1bdf7e1a90c0e97812cd0f18260718a4edb10: Status 404 returned error can't find the container with id 2dbda75694d1cce4fdc02cceaee1bdf7e1a90c0e97812cd0f18260718a4edb10
Jul 20 16:49:58.012483 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:58.012460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:49:58.180006 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:58.179916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8" event={"ID":"0a057b27-99c1-41ec-be83-3818ff7df255","Type":"ContainerStarted","Data":"fadce4c7865c100c83a2596a9f38aa573267c0cd6c5998d86bd210146e5b92ae"}
Jul 20 16:49:58.180006 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:58.179957    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8" event={"ID":"0a057b27-99c1-41ec-be83-3818ff7df255","Type":"ContainerStarted","Data":"2dbda75694d1cce4fdc02cceaee1bdf7e1a90c0e97812cd0f18260718a4edb10"}
Jul 20 16:49:58.201158 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:58.201093    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8" podStartSLOduration=1.201076038 podStartE2EDuration="1.201076038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:49:58.198627433 +0000 UTC m=+2154.560327996" watchObservedRunningTime="2026-07-20 16:49:58.201076038 +0000 UTC m=+2154.562776600"
Jul 20 16:49:59.163755 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:49:59.163730    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:50:04.291750 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:04.291715    2560 scope.go:117] "RemoveContainer" containerID="1c088fc003f596466ab52c45aab7626b701a07cc48044580c8b292a60659cdad"
Jul 20 16:50:04.299787 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:04.299765    2560 scope.go:117] "RemoveContainer" containerID="fbb84c98e7d7d843d5d93130c3e9a78865df1e492dd0fb998a853655864e886a"
Jul 20 16:50:07.526119 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:07.526083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:50:07.828929 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:07.828849    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:50:07.828929 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:07.828912    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:50:07.841216 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:07.841191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:50:08.246779 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:08.246710    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:50:24.001793 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:24.001758    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:50:36.701968 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:36.701925    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:50:44.287564 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:44.287530    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"]
Jul 20 16:50:45.366572 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:45.366538    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"]
Jul 20 16:50:45.374144 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:45.374107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"
Jul 20 16:50:45.377036 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:45.377003    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:50:45.381188 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:45.381160    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"]
Jul 20 16:50:45.518190 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:45.518158    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7\" (UID: \"1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"
Jul 20 16:50:45.618818 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:45.618757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7\" (UID: \"1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"
Jul 20 16:50:45.619395 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:45.619377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7\" (UID: \"1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"
Jul 20 16:50:45.686480 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:45.686453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"
Jul 20 16:50:45.813382 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:45.813358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"]
Jul 20 16:50:45.814977 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:50:45.814942    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7d3549_1f0a_4b23_abb0_8f9e4961e6b1.slice/crio-1a572d3bb02b63056e3585814ae7d20b39470ef14a7c14c9d1dfbf283094482e WatchSource:0}: Error finding container 1a572d3bb02b63056e3585814ae7d20b39470ef14a7c14c9d1dfbf283094482e: Status 404 returned error can't find the container with id 1a572d3bb02b63056e3585814ae7d20b39470ef14a7c14c9d1dfbf283094482e
Jul 20 16:50:46.436021 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:46.435981    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7" event={"ID":"1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1","Type":"ContainerStarted","Data":"fe89d4a8fce4ed2233d5da0e7e96c363d99f8b9c5c1ff1a7e193253eb9974399"}
Jul 20 16:50:46.436494 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:46.436035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7" event={"ID":"1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1","Type":"ContainerStarted","Data":"1a572d3bb02b63056e3585814ae7d20b39470ef14a7c14c9d1dfbf283094482e"}
Jul 20 16:50:46.452920 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:46.452873    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7" podStartSLOduration=1.452859209 podStartE2EDuration="1.452859209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:50:46.450024866 +0000 UTC m=+2202.811725454" watchObservedRunningTime="2026-07-20 16:50:46.452859209 +0000 UTC m=+2202.814559772"
Jul 20 16:50:47.442612 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:47.442578    2560 generic.go:356] "Generic (PLEG): container finished" podID="1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1" containerID="fe89d4a8fce4ed2233d5da0e7e96c363d99f8b9c5c1ff1a7e193253eb9974399" exitCode=0
Jul 20 16:50:47.442993 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:47.442658    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7" event={"ID":"1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1","Type":"ContainerDied","Data":"fe89d4a8fce4ed2233d5da0e7e96c363d99f8b9c5c1ff1a7e193253eb9974399"}
Jul 20 16:50:47.906292 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:47.906263    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:50:48.576296 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:48.576275    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"
Jul 20 16:50:48.644159 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:48.644121    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1-maas-api-service-ca\") pod \"1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1\" (UID: \"1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1\") "
Jul 20 16:50:48.644415 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:48.644395    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1" (UID: "1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:50:48.745675 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:48.745610    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:50:49.461054 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:49.461012    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7" event={"ID":"1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1","Type":"ContainerDied","Data":"1a572d3bb02b63056e3585814ae7d20b39470ef14a7c14c9d1dfbf283094482e"}
Jul 20 16:50:49.461054 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:49.461037    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"
Jul 20 16:50:49.461305 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:49.461089    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a572d3bb02b63056e3585814ae7d20b39470ef14a7c14c9d1dfbf283094482e"
Jul 20 16:50:55.869020 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:55.868985    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"]
Jul 20 16:50:55.869471 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:55.869241    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl" podUID="0541b656-81b4-4fed-8402-192c1960dccd" containerName="maas-api" containerID="cri-o://6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711" gracePeriod=30
Jul 20 16:50:56.120101 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.120050    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:50:56.204586 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.204557    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw9k5\" (UniqueName: \"kubernetes.io/projected/0541b656-81b4-4fed-8402-192c1960dccd-kube-api-access-bw9k5\") pod \"0541b656-81b4-4fed-8402-192c1960dccd\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") "
Jul 20 16:50:56.204736 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.204617    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0541b656-81b4-4fed-8402-192c1960dccd-openshift-service-ca\") pod \"0541b656-81b4-4fed-8402-192c1960dccd\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") "
Jul 20 16:50:56.204736 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.204646    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0541b656-81b4-4fed-8402-192c1960dccd-maas-api-tls\") pod \"0541b656-81b4-4fed-8402-192c1960dccd\" (UID: \"0541b656-81b4-4fed-8402-192c1960dccd\") "
Jul 20 16:50:56.204965 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.204938    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0541b656-81b4-4fed-8402-192c1960dccd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0541b656-81b4-4fed-8402-192c1960dccd" (UID: "0541b656-81b4-4fed-8402-192c1960dccd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:50:56.206671 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.206641    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0541b656-81b4-4fed-8402-192c1960dccd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0541b656-81b4-4fed-8402-192c1960dccd" (UID: "0541b656-81b4-4fed-8402-192c1960dccd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:50:56.206783 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.206725    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0541b656-81b4-4fed-8402-192c1960dccd-kube-api-access-bw9k5" (OuterVolumeSpecName: "kube-api-access-bw9k5") pod "0541b656-81b4-4fed-8402-192c1960dccd" (UID: "0541b656-81b4-4fed-8402-192c1960dccd"). InnerVolumeSpecName "kube-api-access-bw9k5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:50:56.305627 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.305603    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw9k5\" (UniqueName: \"kubernetes.io/projected/0541b656-81b4-4fed-8402-192c1960dccd-kube-api-access-bw9k5\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:50:56.305627 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.305624    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0541b656-81b4-4fed-8402-192c1960dccd-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:50:56.305778 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.305635    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0541b656-81b4-4fed-8402-192c1960dccd-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:50:56.498424 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.498351    2560 generic.go:356] "Generic (PLEG): container finished" podID="0541b656-81b4-4fed-8402-192c1960dccd" containerID="6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711" exitCode=0
Jul 20 16:50:56.498424 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.498401    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"
Jul 20 16:50:56.498558 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.498399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl" event={"ID":"0541b656-81b4-4fed-8402-192c1960dccd","Type":"ContainerDied","Data":"6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711"}
Jul 20 16:50:56.498558 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.498512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl" event={"ID":"0541b656-81b4-4fed-8402-192c1960dccd","Type":"ContainerDied","Data":"9204a15817c5f96dfb8c219cbd4298fff55a62e6911cd16936f1027c330add17"}
Jul 20 16:50:56.498558 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.498541    2560 scope.go:117] "RemoveContainer" containerID="6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711"
Jul 20 16:50:56.508055 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.508036    2560 scope.go:117] "RemoveContainer" containerID="6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711"
Jul 20 16:50:56.508327 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:50:56.508306    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711\": container with ID starting with 6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711 not found: ID does not exist" containerID="6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711"
Jul 20 16:50:56.508399 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.508334    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711"} err="failed to get container status \"6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711\": rpc error: code = NotFound desc = could not find container \"6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711\": container with ID starting with 6d006cb319d7bbc77e2db049201460169e581d934f0e69f324655168bfcfa711 not found: ID does not exist"
Jul 20 16:50:56.524636 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.524611    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"]
Jul 20 16:50:56.529497 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:56.529467    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2acd56-86648644d9-bgnhl"]
Jul 20 16:50:57.850713 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:57.850679    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0541b656-81b4-4fed-8402-192c1960dccd" path="/var/lib/kubelet/pods/0541b656-81b4-4fed-8402-192c1960dccd/volumes"
Jul 20 16:50:59.307399 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.307331    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8" podUID="0a057b27-99c1-41ec-be83-3818ff7df255" containerName="main" containerID="cri-o://fadce4c7865c100c83a2596a9f38aa573267c0cd6c5998d86bd210146e5b92ae" gracePeriod=45
Jul 20 16:50:59.516774 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.516744    2560 generic.go:356] "Generic (PLEG): container finished" podID="0a057b27-99c1-41ec-be83-3818ff7df255" containerID="fadce4c7865c100c83a2596a9f38aa573267c0cd6c5998d86bd210146e5b92ae" exitCode=0
Jul 20 16:50:59.516909 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.516816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8" event={"ID":"0a057b27-99c1-41ec-be83-3818ff7df255","Type":"ContainerDied","Data":"fadce4c7865c100c83a2596a9f38aa573267c0cd6c5998d86bd210146e5b92ae"}
Jul 20 16:50:59.562954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.562902    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:50:59.732556 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.732533    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z2sw\" (UniqueName: \"kubernetes.io/projected/0a057b27-99c1-41ec-be83-3818ff7df255-kube-api-access-9z2sw\") pod \"0a057b27-99c1-41ec-be83-3818ff7df255\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") "
Jul 20 16:50:59.732683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.732588    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-model-cache\") pod \"0a057b27-99c1-41ec-be83-3818ff7df255\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") "
Jul 20 16:50:59.732683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.732622    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a057b27-99c1-41ec-be83-3818ff7df255-tls-certs\") pod \"0a057b27-99c1-41ec-be83-3818ff7df255\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") "
Jul 20 16:50:59.732683 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.732672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-dshm\") pod \"0a057b27-99c1-41ec-be83-3818ff7df255\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") "
Jul 20 16:50:59.732856 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.732703    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-tmp-dir\") pod \"0a057b27-99c1-41ec-be83-3818ff7df255\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") "
Jul 20 16:50:59.732856 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.732761    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-home\") pod \"0a057b27-99c1-41ec-be83-3818ff7df255\" (UID: \"0a057b27-99c1-41ec-be83-3818ff7df255\") "
Jul 20 16:50:59.732949 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.732914    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-model-cache" (OuterVolumeSpecName: "model-cache") pod "0a057b27-99c1-41ec-be83-3818ff7df255" (UID: "0a057b27-99c1-41ec-be83-3818ff7df255"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:50:59.732996 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.732927    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0a057b27-99c1-41ec-be83-3818ff7df255" (UID: "0a057b27-99c1-41ec-be83-3818ff7df255"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:50:59.733074 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.732998    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-home" (OuterVolumeSpecName: "home") pod "0a057b27-99c1-41ec-be83-3818ff7df255" (UID: "0a057b27-99c1-41ec-be83-3818ff7df255"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:50:59.733151 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.733083    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-model-cache\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:50:59.733151 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.733096    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-tmp-dir\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:50:59.733151 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.733103    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-home\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:50:59.734825 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.734804    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a057b27-99c1-41ec-be83-3818ff7df255-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a057b27-99c1-41ec-be83-3818ff7df255" (UID: "0a057b27-99c1-41ec-be83-3818ff7df255"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:50:59.734936 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.734846    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-dshm" (OuterVolumeSpecName: "dshm") pod "0a057b27-99c1-41ec-be83-3818ff7df255" (UID: "0a057b27-99c1-41ec-be83-3818ff7df255"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:50:59.734936 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.734897    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a057b27-99c1-41ec-be83-3818ff7df255-kube-api-access-9z2sw" (OuterVolumeSpecName: "kube-api-access-9z2sw") pod "0a057b27-99c1-41ec-be83-3818ff7df255" (UID: "0a057b27-99c1-41ec-be83-3818ff7df255"). InnerVolumeSpecName "kube-api-access-9z2sw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:50:59.790509 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.790487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:50:59.834255 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.834206    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a057b27-99c1-41ec-be83-3818ff7df255-tls-certs\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:50:59.834255 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.834225    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a057b27-99c1-41ec-be83-3818ff7df255-dshm\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:50:59.834255 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:50:59.834233    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z2sw\" (UniqueName: \"kubernetes.io/projected/0a057b27-99c1-41ec-be83-3818ff7df255-kube-api-access-9z2sw\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:51:00.459880 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:00.459837    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"]
Jul 20 16:51:00.461882 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:00.461859    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2acd56-8pgd7"]
Jul 20 16:51:00.523507 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:00.523484    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"
Jul 20 16:51:00.523637 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:00.523520    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8" event={"ID":"0a057b27-99c1-41ec-be83-3818ff7df255","Type":"ContainerDied","Data":"2dbda75694d1cce4fdc02cceaee1bdf7e1a90c0e97812cd0f18260718a4edb10"}
Jul 20 16:51:00.523637 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:00.523566    2560 scope.go:117] "RemoveContainer" containerID="fadce4c7865c100c83a2596a9f38aa573267c0cd6c5998d86bd210146e5b92ae"
Jul 20 16:51:00.539705 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:00.539681    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"]
Jul 20 16:51:00.544197 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:00.544174    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2acd56/test-model-2acd56-kserve-55d989976c-5sqf8"]
Jul 20 16:51:01.850933 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:01.850895    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a057b27-99c1-41ec-be83-3818ff7df255" path="/var/lib/kubelet/pods/0a057b27-99c1-41ec-be83-3818ff7df255/volumes"
Jul 20 16:51:01.851373 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:01.851228    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1" path="/var/lib/kubelet/pods/1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1/volumes"
Jul 20 16:51:07.245164 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245111    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"]
Jul 20 16:51:07.245656 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245636    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1" containerName="revoke-keys"
Jul 20 16:51:07.245656 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245656    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1" containerName="revoke-keys"
Jul 20 16:51:07.245790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245673    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0541b656-81b4-4fed-8402-192c1960dccd" containerName="maas-api"
Jul 20 16:51:07.245790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245682    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0541b656-81b4-4fed-8402-192c1960dccd" containerName="maas-api"
Jul 20 16:51:07.245790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245695    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a057b27-99c1-41ec-be83-3818ff7df255" containerName="main"
Jul 20 16:51:07.245790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245703    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a057b27-99c1-41ec-be83-3818ff7df255" containerName="main"
Jul 20 16:51:07.245790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245776    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a057b27-99c1-41ec-be83-3818ff7df255" containerName="main"
Jul 20 16:51:07.245790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245789    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7d3549-1f0a-4b23-abb0-8f9e4961e6b1" containerName="revoke-keys"
Jul 20 16:51:07.246070 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.245800    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0541b656-81b4-4fed-8402-192c1960dccd" containerName="maas-api"
Jul 20 16:51:07.250473 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.250444    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"
Jul 20 16:51:07.253073 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.253052    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:51:07.257381 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.257354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"]
Jul 20 16:51:07.393785 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.393750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bdcf06-11f8-4bff-b843-53238e488c8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq\" (UID: \"54bdcf06-11f8-4bff-b843-53238e488c8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"
Jul 20 16:51:07.494235 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.494208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bdcf06-11f8-4bff-b843-53238e488c8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq\" (UID: \"54bdcf06-11f8-4bff-b843-53238e488c8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"
Jul 20 16:51:07.494823 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.494796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bdcf06-11f8-4bff-b843-53238e488c8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq\" (UID: \"54bdcf06-11f8-4bff-b843-53238e488c8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"
Jul 20 16:51:07.565242 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.565209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"
Jul 20 16:51:07.693454 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:07.693432    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"]
Jul 20 16:51:07.695670 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:51:07.695641    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54bdcf06_11f8_4bff_b843_53238e488c8d.slice/crio-80c7a7e6623b3c09e4f5e04420135dac0065759a29be650dee4fbd9f81be22d1 WatchSource:0}: Error finding container 80c7a7e6623b3c09e4f5e04420135dac0065759a29be650dee4fbd9f81be22d1: Status 404 returned error can't find the container with id 80c7a7e6623b3c09e4f5e04420135dac0065759a29be650dee4fbd9f81be22d1
Jul 20 16:51:08.564305 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:08.564272    2560 generic.go:356] "Generic (PLEG): container finished" podID="54bdcf06-11f8-4bff-b843-53238e488c8d" containerID="db83a57f6004592ac396400ca87e6ba0d74db6386fda2a73f3a6751fc4e1e52e" exitCode=0
Jul 20 16:51:08.564657 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:08.564360    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq" event={"ID":"54bdcf06-11f8-4bff-b843-53238e488c8d","Type":"ContainerDied","Data":"db83a57f6004592ac396400ca87e6ba0d74db6386fda2a73f3a6751fc4e1e52e"}
Jul 20 16:51:08.564657 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:08.564435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq" event={"ID":"54bdcf06-11f8-4bff-b843-53238e488c8d","Type":"ContainerStarted","Data":"80c7a7e6623b3c09e4f5e04420135dac0065759a29be650dee4fbd9f81be22d1"}
Jul 20 16:51:09.693317 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:09.693293    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"
Jul 20 16:51:09.812699 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:09.812669    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bdcf06-11f8-4bff-b843-53238e488c8d-maas-api-service-ca\") pod \"54bdcf06-11f8-4bff-b843-53238e488c8d\" (UID: \"54bdcf06-11f8-4bff-b843-53238e488c8d\") "
Jul 20 16:51:09.813004 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:09.812982    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54bdcf06-11f8-4bff-b843-53238e488c8d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54bdcf06-11f8-4bff-b843-53238e488c8d" (UID: "54bdcf06-11f8-4bff-b843-53238e488c8d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:51:09.913973 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:09.913949    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bdcf06-11f8-4bff-b843-53238e488c8d-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:51:10.576100 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:10.576066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq" event={"ID":"54bdcf06-11f8-4bff-b843-53238e488c8d","Type":"ContainerDied","Data":"80c7a7e6623b3c09e4f5e04420135dac0065759a29be650dee4fbd9f81be22d1"}
Jul 20 16:51:10.576265 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:10.576114    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80c7a7e6623b3c09e4f5e04420135dac0065759a29be650dee4fbd9f81be22d1"
Jul 20 16:51:10.576265 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:10.576075    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"
Jul 20 16:51:17.698908 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:17.698875    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"]
Jul 20 16:51:17.699359 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:17.699078    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds" podUID="f22446a0-98cc-4563-9e46-c28c3635174f" containerName="maas-api" containerID="cri-o://cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824" gracePeriod=30
Jul 20 16:51:17.940446 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:17.940424    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:51:17.973301 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:17.973238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f22446a0-98cc-4563-9e46-c28c3635174f-openshift-service-ca\") pod \"f22446a0-98cc-4563-9e46-c28c3635174f\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") "
Jul 20 16:51:17.973301 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:17.973291    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f22446a0-98cc-4563-9e46-c28c3635174f-maas-api-tls\") pod \"f22446a0-98cc-4563-9e46-c28c3635174f\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") "
Jul 20 16:51:17.973490 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:17.973354    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdrlf\" (UniqueName: \"kubernetes.io/projected/f22446a0-98cc-4563-9e46-c28c3635174f-kube-api-access-cdrlf\") pod \"f22446a0-98cc-4563-9e46-c28c3635174f\" (UID: \"f22446a0-98cc-4563-9e46-c28c3635174f\") "
Jul 20 16:51:17.973643 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:17.973619    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f22446a0-98cc-4563-9e46-c28c3635174f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f22446a0-98cc-4563-9e46-c28c3635174f" (UID: "f22446a0-98cc-4563-9e46-c28c3635174f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:51:17.975336 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:17.975308    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f22446a0-98cc-4563-9e46-c28c3635174f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f22446a0-98cc-4563-9e46-c28c3635174f" (UID: "f22446a0-98cc-4563-9e46-c28c3635174f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:51:17.975422 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:17.975358    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f22446a0-98cc-4563-9e46-c28c3635174f-kube-api-access-cdrlf" (OuterVolumeSpecName: "kube-api-access-cdrlf") pod "f22446a0-98cc-4563-9e46-c28c3635174f" (UID: "f22446a0-98cc-4563-9e46-c28c3635174f"). InnerVolumeSpecName "kube-api-access-cdrlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:51:18.074240 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.074213    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f22446a0-98cc-4563-9e46-c28c3635174f-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:51:18.074240 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.074236    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f22446a0-98cc-4563-9e46-c28c3635174f-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:51:18.074400 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.074245    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdrlf\" (UniqueName: \"kubernetes.io/projected/f22446a0-98cc-4563-9e46-c28c3635174f-kube-api-access-cdrlf\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:51:18.618652 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.618615    2560 generic.go:356] "Generic (PLEG): container finished" podID="f22446a0-98cc-4563-9e46-c28c3635174f" containerID="cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824" exitCode=0
Jul 20 16:51:18.618831 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.618676    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"
Jul 20 16:51:18.618831 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.618687    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds" event={"ID":"f22446a0-98cc-4563-9e46-c28c3635174f","Type":"ContainerDied","Data":"cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824"}
Jul 20 16:51:18.618831 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.618758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds" event={"ID":"f22446a0-98cc-4563-9e46-c28c3635174f","Type":"ContainerDied","Data":"eaf3c6947e618d51c9abec66a9c97184c1a07302c72c0a4e06d65fdac2db9f10"}
Jul 20 16:51:18.618831 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.618780    2560 scope.go:117] "RemoveContainer" containerID="cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824"
Jul 20 16:51:18.628813 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.628792    2560 scope.go:117] "RemoveContainer" containerID="cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824"
Jul 20 16:51:18.629079 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:51:18.629057    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824\": container with ID starting with cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824 not found: ID does not exist" containerID="cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824"
Jul 20 16:51:18.629148 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.629087    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824"} err="failed to get container status \"cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824\": rpc error: code = NotFound desc = could not find container \"cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824\": container with ID starting with cea7dd73dd90618c529c985f623ebc9ebf60e3117a6b0b33e3496401cfa9e824 not found: ID does not exist"
Jul 20 16:51:18.641450 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.641425    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"]
Jul 20 16:51:18.643445 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:18.643426    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-59dc77-6cb44f7498-tmgds"]
Jul 20 16:51:19.850532 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:19.850496    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f22446a0-98cc-4563-9e46-c28c3635174f" path="/var/lib/kubelet/pods/f22446a0-98cc-4563-9e46-c28c3635174f/volumes"
Jul 20 16:51:20.582103 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:20.582069    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:51:22.328522 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:22.328488    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"]
Jul 20 16:51:22.331278 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:22.331252    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-59dc77-w2czq"]
Jul 20 16:51:23.850008 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:23.849968    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54bdcf06-11f8-4bff-b843-53238e488c8d" path="/var/lib/kubelet/pods/54bdcf06-11f8-4bff-b843-53238e488c8d/volumes"
Jul 20 16:51:32.893724 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.893694    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"]
Jul 20 16:51:32.894093 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.893980    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f22446a0-98cc-4563-9e46-c28c3635174f" containerName="maas-api"
Jul 20 16:51:32.894093 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.893990    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f22446a0-98cc-4563-9e46-c28c3635174f" containerName="maas-api"
Jul 20 16:51:32.894093 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.894006    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bdcf06-11f8-4bff-b843-53238e488c8d" containerName="revoke-keys"
Jul 20 16:51:32.894093 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.894011    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bdcf06-11f8-4bff-b843-53238e488c8d" containerName="revoke-keys"
Jul 20 16:51:32.894093 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.894064    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f22446a0-98cc-4563-9e46-c28c3635174f" containerName="maas-api"
Jul 20 16:51:32.894093 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.894072    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="54bdcf06-11f8-4bff-b843-53238e488c8d" containerName="revoke-keys"
Jul 20 16:51:32.898220 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.898202    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:32.900954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.900932    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\""
Jul 20 16:51:32.901078 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.901009    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7498b7-serving-cert\""
Jul 20 16:51:32.901687 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.901673    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 16:51:32.901740 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.901695    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 16:51:32.910579 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.910554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"]
Jul 20 16:51:32.992392 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.992363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng5g4\" (UniqueName: \"kubernetes.io/projected/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-kube-api-access-ng5g4\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:32.992526 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.992402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-openshift-service-ca\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:32.992526 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:32.992422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-maas-api-tls\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:33.093716 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:33.093687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng5g4\" (UniqueName: \"kubernetes.io/projected/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-kube-api-access-ng5g4\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:33.093822 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:33.093722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-openshift-service-ca\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:33.093822 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:33.093739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-maas-api-tls\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:33.093901 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:51:33.093837    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-serving-cert: secret "maas-api-e2e-api-a-7498b7-serving-cert" not found
Jul 20 16:51:33.093901 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:51:33.093899    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-maas-api-tls podName:73bd69c7-91f6-41e4-b7f9-018ceae81fa8 nodeName:}" failed. No retries permitted until 2026-07-20 16:51:33.593881281 +0000 UTC m=+2249.955581822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-maas-api-tls") pod "maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t" (UID: "73bd69c7-91f6-41e4-b7f9-018ceae81fa8") : secret "maas-api-e2e-api-a-7498b7-serving-cert" not found
Jul 20 16:51:33.094381 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:33.094363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-openshift-service-ca\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:33.103917 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:33.103892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng5g4\" (UniqueName: \"kubernetes.io/projected/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-kube-api-access-ng5g4\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:33.597485 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:33.597454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-maas-api-tls\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:33.599961 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:33.599937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-maas-api-tls\") pod \"maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:33.808322 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:33.808287    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:33.940568 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:33.940545    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"]
Jul 20 16:51:33.942730 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:51:33.942704    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bd69c7_91f6_41e4_b7f9_018ceae81fa8.slice/crio-460f653347c25b19c6bdad6adf5e9f5ca5fbc71517c04d855b4cb25a9dae6e6f WatchSource:0}: Error finding container 460f653347c25b19c6bdad6adf5e9f5ca5fbc71517c04d855b4cb25a9dae6e6f: Status 404 returned error can't find the container with id 460f653347c25b19c6bdad6adf5e9f5ca5fbc71517c04d855b4cb25a9dae6e6f
Jul 20 16:51:34.706761 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:34.706728    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t" event={"ID":"73bd69c7-91f6-41e4-b7f9-018ceae81fa8","Type":"ContainerStarted","Data":"850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4"}
Jul 20 16:51:34.706932 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:34.706779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t" event={"ID":"73bd69c7-91f6-41e4-b7f9-018ceae81fa8","Type":"ContainerStarted","Data":"460f653347c25b19c6bdad6adf5e9f5ca5fbc71517c04d855b4cb25a9dae6e6f"}
Jul 20 16:51:34.706932 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:34.706823    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:34.729251 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:34.729174    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t" podStartSLOduration=2.212510226 podStartE2EDuration="2.729159903s" totalImagesPullingTime="516.649677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:51:34.728667827 +0000 UTC m=+2251.090368402" watchObservedRunningTime="2026-07-20 16:51:34.729159903 +0000 UTC m=+2251.090860465"
Jul 20 16:51:39.185349 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:39.185318    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:51:40.718697 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:40.718664    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:51:41.049307 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.049270    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"]
Jul 20 16:51:41.053034 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.053003    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.055691 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.055664    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9f2d87-serving-cert\""
Jul 20 16:51:41.063664 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.063641    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"]
Jul 20 16:51:41.153523 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.153495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b60aa-e30b-4f62-8192-3f6dfdc49f87-openshift-service-ca\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.153662 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.153540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b60aa-e30b-4f62-8192-3f6dfdc49f87-maas-api-tls\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.153662 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.153632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w74g\" (UniqueName: \"kubernetes.io/projected/967b60aa-e30b-4f62-8192-3f6dfdc49f87-kube-api-access-8w74g\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.254988 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.254946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b60aa-e30b-4f62-8192-3f6dfdc49f87-maas-api-tls\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.255165 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.255017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w74g\" (UniqueName: \"kubernetes.io/projected/967b60aa-e30b-4f62-8192-3f6dfdc49f87-kube-api-access-8w74g\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.255165 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.255051    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b60aa-e30b-4f62-8192-3f6dfdc49f87-openshift-service-ca\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.255165 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:51:41.255091    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-serving-cert: secret "maas-api-e2e-api-b-9f2d87-serving-cert" not found
Jul 20 16:51:41.255283 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:51:41.255179    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967b60aa-e30b-4f62-8192-3f6dfdc49f87-maas-api-tls podName:967b60aa-e30b-4f62-8192-3f6dfdc49f87 nodeName:}" failed. No retries permitted until 2026-07-20 16:51:41.755162074 +0000 UTC m=+2258.116862616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/967b60aa-e30b-4f62-8192-3f6dfdc49f87-maas-api-tls") pod "maas-api-e2e-api-b-9f2d87-7989c446c4-769p9" (UID: "967b60aa-e30b-4f62-8192-3f6dfdc49f87") : secret "maas-api-e2e-api-b-9f2d87-serving-cert" not found
Jul 20 16:51:41.255653 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.255637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b60aa-e30b-4f62-8192-3f6dfdc49f87-openshift-service-ca\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.263954 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.263926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w74g\" (UniqueName: \"kubernetes.io/projected/967b60aa-e30b-4f62-8192-3f6dfdc49f87-kube-api-access-8w74g\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.758781 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.758749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b60aa-e30b-4f62-8192-3f6dfdc49f87-maas-api-tls\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.761095 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.761072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b60aa-e30b-4f62-8192-3f6dfdc49f87-maas-api-tls\") pod \"maas-api-e2e-api-b-9f2d87-7989c446c4-769p9\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:41.964948 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:41.964914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:42.093805 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:42.093781    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"]
Jul 20 16:51:42.095524 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:51:42.095495    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967b60aa_e30b_4f62_8192_3f6dfdc49f87.slice/crio-078032f25e2ae3077dffb42b273318f28c5793f615cc2ae281f5ce9ee1697e84 WatchSource:0}: Error finding container 078032f25e2ae3077dffb42b273318f28c5793f615cc2ae281f5ce9ee1697e84: Status 404 returned error can't find the container with id 078032f25e2ae3077dffb42b273318f28c5793f615cc2ae281f5ce9ee1697e84
Jul 20 16:51:42.752183 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:42.752092    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9" event={"ID":"967b60aa-e30b-4f62-8192-3f6dfdc49f87","Type":"ContainerStarted","Data":"1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216"}
Jul 20 16:51:42.752183 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:42.752178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9" event={"ID":"967b60aa-e30b-4f62-8192-3f6dfdc49f87","Type":"ContainerStarted","Data":"078032f25e2ae3077dffb42b273318f28c5793f615cc2ae281f5ce9ee1697e84"}
Jul 20 16:51:42.752364 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:42.752262    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:42.768089 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:42.768043    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9" podStartSLOduration=1.412821057 podStartE2EDuration="1.768026681s" totalImagesPullingTime="355.205624ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:51:42.76725263 +0000 UTC m=+2259.128953193" watchObservedRunningTime="2026-07-20 16:51:42.768026681 +0000 UTC m=+2259.129727245"
Jul 20 16:51:48.764474 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:48.764437    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:51:52.990685 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:52.990654    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:51:53.323902 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.323869    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"]
Jul 20 16:51:53.327487 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.327472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"
Jul 20 16:51:53.329675 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.329653    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:51:53.335177 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.334945    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"]
Jul 20 16:51:53.453397 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.453374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7498b7-6swj7\" (UID: \"e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"
Jul 20 16:51:53.554253 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.554224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7498b7-6swj7\" (UID: \"e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"
Jul 20 16:51:53.554778 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.554760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7498b7-6swj7\" (UID: \"e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"
Jul 20 16:51:53.639751 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.639690    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"
Jul 20 16:51:53.767932 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.767911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"]
Jul 20 16:51:53.769523 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:51:53.769501    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ac6ee5_7f47_4f35_9f07_d9b0fe04838c.slice/crio-0a7233aefb0ba30e30c179bf0836abb4459c6c7904735c71e561390656d4798f WatchSource:0}: Error finding container 0a7233aefb0ba30e30c179bf0836abb4459c6c7904735c71e561390656d4798f: Status 404 returned error can't find the container with id 0a7233aefb0ba30e30c179bf0836abb4459c6c7904735c71e561390656d4798f
Jul 20 16:51:53.812855 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:53.812827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7" event={"ID":"e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c","Type":"ContainerStarted","Data":"0a7233aefb0ba30e30c179bf0836abb4459c6c7904735c71e561390656d4798f"}
Jul 20 16:51:54.819193 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:54.819163    2560 generic.go:356] "Generic (PLEG): container finished" podID="e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c" containerID="dfc35759d0e4c5d94ef72036e235d39a115fb36319622c2be7f8c4060f93702c" exitCode=0
Jul 20 16:51:54.819579 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:54.819198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7" event={"ID":"e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c","Type":"ContainerDied","Data":"dfc35759d0e4c5d94ef72036e235d39a115fb36319622c2be7f8c4060f93702c"}
Jul 20 16:51:55.955026 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:55.955000    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"
Jul 20 16:51:56.072820 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:56.072797    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c-maas-api-service-ca\") pod \"e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c\" (UID: \"e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c\") "
Jul 20 16:51:56.073179 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:56.073158    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c" (UID: "e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:51:56.174060 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:56.174003    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:51:56.830373 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:56.830341    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"
Jul 20 16:51:56.830549 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:56.830378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7" event={"ID":"e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c","Type":"ContainerDied","Data":"0a7233aefb0ba30e30c179bf0836abb4459c6c7904735c71e561390656d4798f"}
Jul 20 16:51:56.830549 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:51:56.830423    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a7233aefb0ba30e30c179bf0836abb4459c6c7904735c71e561390656d4798f"
Jul 20 16:52:09.302167 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.302113    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"]
Jul 20 16:52:09.302698 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.302348    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t" podUID="73bd69c7-91f6-41e4-b7f9-018ceae81fa8" containerName="maas-api" containerID="cri-o://850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4" gracePeriod=30
Jul 20 16:52:09.550165 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.550113    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:52:09.690306 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.690247    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-maas-api-tls\") pod \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") "
Jul 20 16:52:09.690430 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.690322    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-openshift-service-ca\") pod \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") "
Jul 20 16:52:09.690430 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.690375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng5g4\" (UniqueName: \"kubernetes.io/projected/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-kube-api-access-ng5g4\") pod \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\" (UID: \"73bd69c7-91f6-41e4-b7f9-018ceae81fa8\") "
Jul 20 16:52:09.690700 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.690675    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "73bd69c7-91f6-41e4-b7f9-018ceae81fa8" (UID: "73bd69c7-91f6-41e4-b7f9-018ceae81fa8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:52:09.692259 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.692233    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "73bd69c7-91f6-41e4-b7f9-018ceae81fa8" (UID: "73bd69c7-91f6-41e4-b7f9-018ceae81fa8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:52:09.692383 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.692361    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-kube-api-access-ng5g4" (OuterVolumeSpecName: "kube-api-access-ng5g4") pod "73bd69c7-91f6-41e4-b7f9-018ceae81fa8" (UID: "73bd69c7-91f6-41e4-b7f9-018ceae81fa8"). InnerVolumeSpecName "kube-api-access-ng5g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:52:09.791096 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.791074    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:52:09.791201 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.791099    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:52:09.791201 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.791112    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng5g4\" (UniqueName: \"kubernetes.io/projected/73bd69c7-91f6-41e4-b7f9-018ceae81fa8-kube-api-access-ng5g4\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:52:09.901542 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.901507    2560 generic.go:356] "Generic (PLEG): container finished" podID="73bd69c7-91f6-41e4-b7f9-018ceae81fa8" containerID="850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4" exitCode=0
Jul 20 16:52:09.901687 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.901543    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"
Jul 20 16:52:09.901687 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.901596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t" event={"ID":"73bd69c7-91f6-41e4-b7f9-018ceae81fa8","Type":"ContainerDied","Data":"850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4"}
Jul 20 16:52:09.901687 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.901642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t" event={"ID":"73bd69c7-91f6-41e4-b7f9-018ceae81fa8","Type":"ContainerDied","Data":"460f653347c25b19c6bdad6adf5e9f5ca5fbc71517c04d855b4cb25a9dae6e6f"}
Jul 20 16:52:09.901687 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.901666    2560 scope.go:117] "RemoveContainer" containerID="850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4"
Jul 20 16:52:09.910441 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.910420    2560 scope.go:117] "RemoveContainer" containerID="850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4"
Jul 20 16:52:09.910679 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:52:09.910663    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4\": container with ID starting with 850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4 not found: ID does not exist" containerID="850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4"
Jul 20 16:52:09.910734 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.910687    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4"} err="failed to get container status \"850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4\": rpc error: code = NotFound desc = could not find container \"850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4\": container with ID starting with 850d89afe3fed9639ee3df9121f9f947672b83b80f9b3ceb0539da098b091fa4 not found: ID does not exist"
Jul 20 16:52:09.916849 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.916823    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"]
Jul 20 16:52:09.920601 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:09.920580    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7498b7-8587d4d8d8-cck9t"]
Jul 20 16:52:11.792672 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:11.792637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:52:11.850905 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:11.850872    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73bd69c7-91f6-41e4-b7f9-018ceae81fa8" path="/var/lib/kubelet/pods/73bd69c7-91f6-41e4-b7f9-018ceae81fa8/volumes"
Jul 20 16:52:13.407731 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:13.407696    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"]
Jul 20 16:52:13.410521 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:13.410497    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7498b7-6swj7"]
Jul 20 16:52:13.850681 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:13.850654    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c" path="/var/lib/kubelet/pods/e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c/volumes"
Jul 20 16:52:20.367207 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.367173    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"]
Jul 20 16:52:20.367616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.367484    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c" containerName="revoke-keys"
Jul 20 16:52:20.367616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.367494    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c" containerName="revoke-keys"
Jul 20 16:52:20.367616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.367511    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73bd69c7-91f6-41e4-b7f9-018ceae81fa8" containerName="maas-api"
Jul 20 16:52:20.367616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.367516    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="73bd69c7-91f6-41e4-b7f9-018ceae81fa8" containerName="maas-api"
Jul 20 16:52:20.367616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.367582    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4ac6ee5-7f47-4f35-9f07-d9b0fe04838c" containerName="revoke-keys"
Jul 20 16:52:20.367616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.367592    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="73bd69c7-91f6-41e4-b7f9-018ceae81fa8" containerName="maas-api"
Jul 20 16:52:20.372033 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.372015    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"
Jul 20 16:52:20.374425 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.374391    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:52:20.378650 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.378605    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"]
Jul 20 16:52:20.470100 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.470068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9459c43c-72f9-457e-a878-91057f8cabdf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs\" (UID: \"9459c43c-72f9-457e-a878-91057f8cabdf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"
Jul 20 16:52:20.570952 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.570925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9459c43c-72f9-457e-a878-91057f8cabdf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs\" (UID: \"9459c43c-72f9-457e-a878-91057f8cabdf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"
Jul 20 16:52:20.571491 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.571475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9459c43c-72f9-457e-a878-91057f8cabdf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs\" (UID: \"9459c43c-72f9-457e-a878-91057f8cabdf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"
Jul 20 16:52:20.683741 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.683684    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"
Jul 20 16:52:20.813270 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.813245    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"]
Jul 20 16:52:20.815092 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:52:20.815064    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9459c43c_72f9_457e_a878_91057f8cabdf.slice/crio-63fec0fbfa20718325c285f55b31269301af248bb006758e358c52441dff06fb WatchSource:0}: Error finding container 63fec0fbfa20718325c285f55b31269301af248bb006758e358c52441dff06fb: Status 404 returned error can't find the container with id 63fec0fbfa20718325c285f55b31269301af248bb006758e358c52441dff06fb
Jul 20 16:52:20.958390 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:20.958327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs" event={"ID":"9459c43c-72f9-457e-a878-91057f8cabdf","Type":"ContainerStarted","Data":"63fec0fbfa20718325c285f55b31269301af248bb006758e358c52441dff06fb"}
Jul 20 16:52:21.965205 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:21.965175    2560 generic.go:356] "Generic (PLEG): container finished" podID="9459c43c-72f9-457e-a878-91057f8cabdf" containerID="d6af1083cefab27f909a08b463c695e820da12e684dc9f0d64718af20b2e3bfb" exitCode=0
Jul 20 16:52:21.965610 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:21.965217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs" event={"ID":"9459c43c-72f9-457e-a878-91057f8cabdf","Type":"ContainerDied","Data":"d6af1083cefab27f909a08b463c695e820da12e684dc9f0d64718af20b2e3bfb"}
Jul 20 16:52:23.100807 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:23.100782    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"
Jul 20 16:52:23.292466 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:23.292441    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9459c43c-72f9-457e-a878-91057f8cabdf-maas-api-service-ca\") pod \"9459c43c-72f9-457e-a878-91057f8cabdf\" (UID: \"9459c43c-72f9-457e-a878-91057f8cabdf\") "
Jul 20 16:52:23.292778 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:23.292758    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9459c43c-72f9-457e-a878-91057f8cabdf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9459c43c-72f9-457e-a878-91057f8cabdf" (UID: "9459c43c-72f9-457e-a878-91057f8cabdf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:52:23.393196 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:23.393172    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9459c43c-72f9-457e-a878-91057f8cabdf-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:52:23.980173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:23.976835    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs" event={"ID":"9459c43c-72f9-457e-a878-91057f8cabdf","Type":"ContainerDied","Data":"63fec0fbfa20718325c285f55b31269301af248bb006758e358c52441dff06fb"}
Jul 20 16:52:23.980173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:23.976936    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63fec0fbfa20718325c285f55b31269301af248bb006758e358c52441dff06fb"
Jul 20 16:52:23.980173 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:23.977025    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"
Jul 20 16:52:36.000181 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.000141    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"]
Jul 20 16:52:36.000670 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.000390    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9" podUID="967b60aa-e30b-4f62-8192-3f6dfdc49f87" containerName="maas-api" containerID="cri-o://1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216" gracePeriod=30
Jul 20 16:52:36.242592 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.242569    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:52:36.283986 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.283962    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b60aa-e30b-4f62-8192-3f6dfdc49f87-maas-api-tls\") pod \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") "
Jul 20 16:52:36.284107 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.283998    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w74g\" (UniqueName: \"kubernetes.io/projected/967b60aa-e30b-4f62-8192-3f6dfdc49f87-kube-api-access-8w74g\") pod \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") "
Jul 20 16:52:36.284107 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.284060    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b60aa-e30b-4f62-8192-3f6dfdc49f87-openshift-service-ca\") pod \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\" (UID: \"967b60aa-e30b-4f62-8192-3f6dfdc49f87\") "
Jul 20 16:52:36.284442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.284420    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967b60aa-e30b-4f62-8192-3f6dfdc49f87-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "967b60aa-e30b-4f62-8192-3f6dfdc49f87" (UID: "967b60aa-e30b-4f62-8192-3f6dfdc49f87"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:52:36.285982 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.285957    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967b60aa-e30b-4f62-8192-3f6dfdc49f87-kube-api-access-8w74g" (OuterVolumeSpecName: "kube-api-access-8w74g") pod "967b60aa-e30b-4f62-8192-3f6dfdc49f87" (UID: "967b60aa-e30b-4f62-8192-3f6dfdc49f87"). InnerVolumeSpecName "kube-api-access-8w74g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:52:36.285982 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.285959    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/967b60aa-e30b-4f62-8192-3f6dfdc49f87-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "967b60aa-e30b-4f62-8192-3f6dfdc49f87" (UID: "967b60aa-e30b-4f62-8192-3f6dfdc49f87"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:52:36.385116 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.385079    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b60aa-e30b-4f62-8192-3f6dfdc49f87-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:52:36.385116 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.385113    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b60aa-e30b-4f62-8192-3f6dfdc49f87-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:52:36.385116 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:36.385150    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w74g\" (UniqueName: \"kubernetes.io/projected/967b60aa-e30b-4f62-8192-3f6dfdc49f87-kube-api-access-8w74g\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:52:37.046304 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.046269    2560 generic.go:356] "Generic (PLEG): container finished" podID="967b60aa-e30b-4f62-8192-3f6dfdc49f87" containerID="1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216" exitCode=0
Jul 20 16:52:37.046700 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.046316    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"
Jul 20 16:52:37.046700 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.046352    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9" event={"ID":"967b60aa-e30b-4f62-8192-3f6dfdc49f87","Type":"ContainerDied","Data":"1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216"}
Jul 20 16:52:37.046700 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.046405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9" event={"ID":"967b60aa-e30b-4f62-8192-3f6dfdc49f87","Type":"ContainerDied","Data":"078032f25e2ae3077dffb42b273318f28c5793f615cc2ae281f5ce9ee1697e84"}
Jul 20 16:52:37.046700 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.046428    2560 scope.go:117] "RemoveContainer" containerID="1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216"
Jul 20 16:52:37.055565 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.055547    2560 scope.go:117] "RemoveContainer" containerID="1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216"
Jul 20 16:52:37.055844 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:52:37.055826    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216\": container with ID starting with 1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216 not found: ID does not exist" containerID="1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216"
Jul 20 16:52:37.055915 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.055852    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216"} err="failed to get container status \"1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216\": rpc error: code = NotFound desc = could not find container \"1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216\": container with ID starting with 1190ea3060fb0420d941efc1a9b4162508eab5199d02cab0cfed251176659216 not found: ID does not exist"
Jul 20 16:52:37.067314 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.067292    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"]
Jul 20 16:52:37.071577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.071557    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9f2d87-7989c446c4-769p9"]
Jul 20 16:52:37.857096 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:37.857051    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="967b60aa-e30b-4f62-8192-3f6dfdc49f87" path="/var/lib/kubelet/pods/967b60aa-e30b-4f62-8192-3f6dfdc49f87/volumes"
Jul 20 16:52:40.290796 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:40.290756    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:52:40.486181 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:40.486149    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"]
Jul 20 16:52:40.488208 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:40.488183    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9f2d87-5rbzs"]
Jul 20 16:52:41.850993 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:41.850933    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9459c43c-72f9-457e-a878-91057f8cabdf" path="/var/lib/kubelet/pods/9459c43c-72f9-457e-a878-91057f8cabdf/volumes"
Jul 20 16:52:50.970946 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.970914    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"]
Jul 20 16:52:50.971428 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.971220    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967b60aa-e30b-4f62-8192-3f6dfdc49f87" containerName="maas-api"
Jul 20 16:52:50.971428 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.971230    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="967b60aa-e30b-4f62-8192-3f6dfdc49f87" containerName="maas-api"
Jul 20 16:52:50.971428 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.971247    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9459c43c-72f9-457e-a878-91057f8cabdf" containerName="revoke-keys"
Jul 20 16:52:50.971428 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.971252    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9459c43c-72f9-457e-a878-91057f8cabdf" containerName="revoke-keys"
Jul 20 16:52:50.971428 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.971304    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="967b60aa-e30b-4f62-8192-3f6dfdc49f87" containerName="maas-api"
Jul 20 16:52:50.971428 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.971311    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9459c43c-72f9-457e-a878-91057f8cabdf" containerName="revoke-keys"
Jul 20 16:52:50.974248 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.974232    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:50.976685 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.976658    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-42e123-serving-cert\""
Jul 20 16:52:50.980923 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.976755    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 16:52:50.980923 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.977454    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 16:52:50.980923 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.977731    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\""
Jul 20 16:52:50.985953 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:50.985930    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"]
Jul 20 16:52:51.092949 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.092921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c89464-405f-46b4-ab91-7051c3087929-maas-api-tls\") pod \"maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.093091 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.092980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzkmx\" (UniqueName: \"kubernetes.io/projected/27c89464-405f-46b4-ab91-7051c3087929-kube-api-access-dzkmx\") pod \"maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.093180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.093083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c89464-405f-46b4-ab91-7051c3087929-openshift-service-ca\") pod \"maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.193785 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.193758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c89464-405f-46b4-ab91-7051c3087929-openshift-service-ca\") pod \"maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.193894 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.193792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c89464-405f-46b4-ab91-7051c3087929-maas-api-tls\") pod \"maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.193894 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.193821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkmx\" (UniqueName: \"kubernetes.io/projected/27c89464-405f-46b4-ab91-7051c3087929-kube-api-access-dzkmx\") pod \"maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.194491 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.194466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c89464-405f-46b4-ab91-7051c3087929-openshift-service-ca\") pod \"maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.196177 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.196161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c89464-405f-46b4-ab91-7051c3087929-maas-api-tls\") pod \"maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.202539 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.202521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzkmx\" (UniqueName: \"kubernetes.io/projected/27c89464-405f-46b4-ab91-7051c3087929-kube-api-access-dzkmx\") pod \"maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.292541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.292518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:51.422475 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.422445    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"]
Jul 20 16:52:51.424390 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:52:51.424365    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c89464_405f_46b4_ab91_7051c3087929.slice/crio-cdeea7eb35b1d5721f9a399bde7909b7988cfad29ea61fd39bedf5ed0bd78c13 WatchSource:0}: Error finding container cdeea7eb35b1d5721f9a399bde7909b7988cfad29ea61fd39bedf5ed0bd78c13: Status 404 returned error can't find the container with id cdeea7eb35b1d5721f9a399bde7909b7988cfad29ea61fd39bedf5ed0bd78c13
Jul 20 16:52:51.426244 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:51.426225    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 16:52:52.125677 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:52.125641    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9" event={"ID":"27c89464-405f-46b4-ab91-7051c3087929","Type":"ContainerStarted","Data":"3bc0496ca83698bdf604957ce290233995578267fe9fcc58bd8674eb1db5e688"}
Jul 20 16:52:52.126064 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:52.125699    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9" event={"ID":"27c89464-405f-46b4-ab91-7051c3087929","Type":"ContainerStarted","Data":"cdeea7eb35b1d5721f9a399bde7909b7988cfad29ea61fd39bedf5ed0bd78c13"}
Jul 20 16:52:52.126064 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:52.125770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:52.144794 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:52.144748    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9" podStartSLOduration=1.666233745 podStartE2EDuration="2.144735456s" totalImagesPullingTime="478.501711ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:52:52.14341768 +0000 UTC m=+2328.505118245" watchObservedRunningTime="2026-07-20 16:52:52.144735456 +0000 UTC m=+2328.506436018"
Jul 20 16:52:58.135577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:58.135501    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:52:58.695435 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:58.695402    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:52:59.501406 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.501376    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"]
Jul 20 16:52:59.504993 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.504972    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:52:59.507337 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.507316    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-c5c3fb-serving-cert\""
Jul 20 16:52:59.518971 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.518948    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"]
Jul 20 16:52:59.561172 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.561152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63291311-8849-43af-aedd-6bb7bdc43219-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:52:59.561279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.561185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63291311-8849-43af-aedd-6bb7bdc43219-maas-api-tls\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:52:59.561279 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.561217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jbcc\" (UniqueName: \"kubernetes.io/projected/63291311-8849-43af-aedd-6bb7bdc43219-kube-api-access-5jbcc\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:52:59.662410 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.662384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63291311-8849-43af-aedd-6bb7bdc43219-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:52:59.662510 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.662430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63291311-8849-43af-aedd-6bb7bdc43219-maas-api-tls\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:52:59.662510 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.662475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jbcc\" (UniqueName: \"kubernetes.io/projected/63291311-8849-43af-aedd-6bb7bdc43219-kube-api-access-5jbcc\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:52:59.662638 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:52:59.662602    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-serving-cert: secret "maas-api-e2e-shared-b-c5c3fb-serving-cert" not found
Jul 20 16:52:59.662694 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:52:59.662661    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63291311-8849-43af-aedd-6bb7bdc43219-maas-api-tls podName:63291311-8849-43af-aedd-6bb7bdc43219 nodeName:}" failed. No retries permitted until 2026-07-20 16:53:00.162645824 +0000 UTC m=+2336.524346365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/63291311-8849-43af-aedd-6bb7bdc43219-maas-api-tls") pod "maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t" (UID: "63291311-8849-43af-aedd-6bb7bdc43219") : secret "maas-api-e2e-shared-b-c5c3fb-serving-cert" not found
Jul 20 16:52:59.663010 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.662992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63291311-8849-43af-aedd-6bb7bdc43219-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:52:59.672521 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:52:59.672494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jbcc\" (UniqueName: \"kubernetes.io/projected/63291311-8849-43af-aedd-6bb7bdc43219-kube-api-access-5jbcc\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:53:00.166899 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:00.166862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63291311-8849-43af-aedd-6bb7bdc43219-maas-api-tls\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:53:00.169238 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:00.169215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63291311-8849-43af-aedd-6bb7bdc43219-maas-api-tls\") pod \"maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:53:00.415650 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:00.415606    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:53:00.545784 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:00.545754    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"]
Jul 20 16:53:00.547074 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:53:00.547039    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63291311_8849_43af_aedd_6bb7bdc43219.slice/crio-4d1a170cac625be69f0e761271a38afa714102ef7c445cf8a9a35c50cf6938ff WatchSource:0}: Error finding container 4d1a170cac625be69f0e761271a38afa714102ef7c445cf8a9a35c50cf6938ff: Status 404 returned error can't find the container with id 4d1a170cac625be69f0e761271a38afa714102ef7c445cf8a9a35c50cf6938ff
Jul 20 16:53:01.172033 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:01.172004    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t" event={"ID":"63291311-8849-43af-aedd-6bb7bdc43219","Type":"ContainerStarted","Data":"8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5"}
Jul 20 16:53:01.172159 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:01.172070    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:53:01.172159 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:01.172088    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t" event={"ID":"63291311-8849-43af-aedd-6bb7bdc43219","Type":"ContainerStarted","Data":"4d1a170cac625be69f0e761271a38afa714102ef7c445cf8a9a35c50cf6938ff"}
Jul 20 16:53:01.192268 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:01.192225    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t" podStartSLOduration=1.649019293 podStartE2EDuration="2.192205576s" totalImagesPullingTime="543.186283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:53:01.19080818 +0000 UTC m=+2337.552508744" watchObservedRunningTime="2026-07-20 16:53:01.192205576 +0000 UTC m=+2337.553906135"
Jul 20 16:53:04.348231 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:04.348200    2560 scope.go:117] "RemoveContainer" containerID="04c3bcaa8400792add6013484e365e23b1cdc8849b36723db7d3317e85a74773"
Jul 20 16:53:07.183790 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:07.183760    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:53:12.291595 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:12.291564    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:53:15.620291 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.620260    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"]
Jul 20 16:53:15.623812 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.623792    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.627053 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.627029    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-42e123\"/\"openshift-service-ca.crt\""
Jul 20 16:53:15.627207 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.627069    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-42e123\"/\"default-dockercfg-lxjxv\""
Jul 20 16:53:15.627207 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.627038    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-42e123\"/\"kube-root-ca.crt\""
Jul 20 16:53:15.627207 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.627111    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-42e123\"/\"auth-test-model-42e123-kserve-self-signed-certs\""
Jul 20 16:53:15.634015 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.633988    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"]
Jul 20 16:53:15.689725 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.689693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-tmp-dir\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.689862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.689734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-home\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.689862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.689761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-dshm\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.689862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.689809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88gg8\" (UniqueName: \"kubernetes.io/projected/86da753b-ae70-44b4-b160-395669409158-kube-api-access-88gg8\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.689862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.689847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86da753b-ae70-44b4-b160-395669409158-tls-certs\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.690025 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.689894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-model-cache\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.790336 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.790312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-tmp-dir\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.790484 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.790344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-home\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.790484 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.790364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-dshm\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.790484 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.790381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88gg8\" (UniqueName: \"kubernetes.io/projected/86da753b-ae70-44b4-b160-395669409158-kube-api-access-88gg8\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.790484 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.790398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86da753b-ae70-44b4-b160-395669409158-tls-certs\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.790484 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.790434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-model-cache\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.790737 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.790710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-tmp-dir\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.790799 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.790745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-home\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.790799 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.790779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-model-cache\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.792465 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.792445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-dshm\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.792800 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.792783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86da753b-ae70-44b4-b160-395669409158-tls-certs\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.797945 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.797925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88gg8\" (UniqueName: \"kubernetes.io/projected/86da753b-ae70-44b4-b160-395669409158-kube-api-access-88gg8\") pod \"auth-test-model-42e123-kserve-847556cfcf-6f9r2\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") " pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:15.932709 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:15.932657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:16.061583 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:16.061553    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"]
Jul 20 16:53:16.063454 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:53:16.063420    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86da753b_ae70_44b4_b160_395669409158.slice/crio-9282bad48624966cac4b95c0ddaa34150eb5cd77342c97713bb3f9aff5c9ca44 WatchSource:0}: Error finding container 9282bad48624966cac4b95c0ddaa34150eb5cd77342c97713bb3f9aff5c9ca44: Status 404 returned error can't find the container with id 9282bad48624966cac4b95c0ddaa34150eb5cd77342c97713bb3f9aff5c9ca44
Jul 20 16:53:16.252862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:16.252789    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2" event={"ID":"86da753b-ae70-44b4-b160-395669409158","Type":"ContainerStarted","Data":"286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12"}
Jul 20 16:53:16.252862 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:16.252827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2" event={"ID":"86da753b-ae70-44b4-b160-395669409158","Type":"ContainerStarted","Data":"9282bad48624966cac4b95c0ddaa34150eb5cd77342c97713bb3f9aff5c9ca44"}
Jul 20 16:53:16.269660 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:16.269611    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2" podStartSLOduration=1.269596226 podStartE2EDuration="1.269596226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:53:16.268334001 +0000 UTC m=+2352.630034570" watchObservedRunningTime="2026-07-20 16:53:16.269596226 +0000 UTC m=+2352.631296789"
Jul 20 16:53:19.996542 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:19.996509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:53:25.933192 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:25.933159    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:25.933709 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:25.933206    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:25.945491 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:25.945459    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:26.314838 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:26.314810    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:53:35.001109 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.001078    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"]
Jul 20 16:53:35.005635 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.005616    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.008614 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.008593    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c5c3fb\"/\"openshift-service-ca.crt\""
Jul 20 16:53:35.009466 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.009452    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c5c3fb\"/\"kube-root-ca.crt\""
Jul 20 16:53:35.009799 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.009786    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c5c3fb\"/\"auth-test-model-c5c3fb-kserve-self-signed-certs\""
Jul 20 16:53:35.009837 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.009805    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c5c3fb\"/\"default-dockercfg-nk5nc\""
Jul 20 16:53:35.015044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.015023    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"]
Jul 20 16:53:35.137004 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.136975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f21e9b-ffab-4370-8b08-adf122d65624-tls-certs\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.137169 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.137005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc958\" (UniqueName: \"kubernetes.io/projected/88f21e9b-ffab-4370-8b08-adf122d65624-kube-api-access-nc958\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.137169 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.137048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-tmp-dir\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.137169 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.137085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-model-cache\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.137169 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.137120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-dshm\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.137346 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.137230    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-home\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.238552 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.238529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc958\" (UniqueName: \"kubernetes.io/projected/88f21e9b-ffab-4370-8b08-adf122d65624-kube-api-access-nc958\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.238705 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.238588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-tmp-dir\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.238705 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.238616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-model-cache\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.238705 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.238639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-dshm\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.238876 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.238732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-home\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.238876 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.238790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f21e9b-ffab-4370-8b08-adf122d65624-tls-certs\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.239061 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.239037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-tmp-dir\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.239146 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.239085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-model-cache\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.239146 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.239103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-home\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.241034 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.240999    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-dshm\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.241240 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.241224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f21e9b-ffab-4370-8b08-adf122d65624-tls-certs\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.246685 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.246660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc958\" (UniqueName: \"kubernetes.io/projected/88f21e9b-ffab-4370-8b08-adf122d65624-kube-api-access-nc958\") pod \"auth-test-model-c5c3fb-kserve-86798bb459-tn6td\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") " pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.315669 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.315643    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:35.444479 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:35.444456    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"]
Jul 20 16:53:35.446115 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:53:35.446089    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88f21e9b_ffab_4370_8b08_adf122d65624.slice/crio-9136be8c44bb68fa3d80a66a6eb26cf80d5357a644ae40021df9317ffff71735 WatchSource:0}: Error finding container 9136be8c44bb68fa3d80a66a6eb26cf80d5357a644ae40021df9317ffff71735: Status 404 returned error can't find the container with id 9136be8c44bb68fa3d80a66a6eb26cf80d5357a644ae40021df9317ffff71735
Jul 20 16:53:36.356907 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:36.356876    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td" event={"ID":"88f21e9b-ffab-4370-8b08-adf122d65624","Type":"ContainerStarted","Data":"449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7"}
Jul 20 16:53:36.356907 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:36.356914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td" event={"ID":"88f21e9b-ffab-4370-8b08-adf122d65624","Type":"ContainerStarted","Data":"9136be8c44bb68fa3d80a66a6eb26cf80d5357a644ae40021df9317ffff71735"}
Jul 20 16:53:36.375361 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:36.375316    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td" podStartSLOduration=2.375300208 podStartE2EDuration="2.375300208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:53:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:53:36.374291801 +0000 UTC m=+2372.735992369" watchObservedRunningTime="2026-07-20 16:53:36.375300208 +0000 UTC m=+2372.737000771"
Jul 20 16:53:38.309852 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:38.309818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:53:45.316301 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:45.316269    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:45.316723 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:45.316506    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:45.328842 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:45.328817    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:53:45.414369 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:53:45.414345    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:54:04.377079 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:54:04.377049    2560 scope.go:117] "RemoveContainer" containerID="0dfd49878c7487e858d2f1b1e30f3b9e7260dd301eaa8e7154da8055a5970b3f"
Jul 20 16:54:06.096006 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:54:06.095973    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:54:24.193913 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:54:24.193883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:54:37.985535 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:54:37.985499    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:54:58.186001 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:54:58.185969    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:55:16.787691 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:55:16.787657    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:55:39.087152 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:55:39.087086    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:55:54.493144 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:55:54.493102    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"]
Jul 20 16:55:55.397064 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:55:55.397032    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"]
Jul 20 16:55:58.098262 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:55:58.098178    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:56:09.512832 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.512771    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2" podUID="86da753b-ae70-44b4-b160-395669409158" containerName="main" containerID="cri-o://286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12" gracePeriod=45
Jul 20 16:56:09.773095 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.773036    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:56:09.935074 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935043    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-tmp-dir\") pod \"86da753b-ae70-44b4-b160-395669409158\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") "
Jul 20 16:56:09.935223 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935095    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86da753b-ae70-44b4-b160-395669409158-tls-certs\") pod \"86da753b-ae70-44b4-b160-395669409158\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") "
Jul 20 16:56:09.935223 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935157    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-home\") pod \"86da753b-ae70-44b4-b160-395669409158\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") "
Jul 20 16:56:09.935223 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935179    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-dshm\") pod \"86da753b-ae70-44b4-b160-395669409158\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") "
Jul 20 16:56:09.935345 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935301    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "86da753b-ae70-44b4-b160-395669409158" (UID: "86da753b-ae70-44b4-b160-395669409158"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:56:09.935345 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935327    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-model-cache\") pod \"86da753b-ae70-44b4-b160-395669409158\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") "
Jul 20 16:56:09.935424 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88gg8\" (UniqueName: \"kubernetes.io/projected/86da753b-ae70-44b4-b160-395669409158-kube-api-access-88gg8\") pod \"86da753b-ae70-44b4-b160-395669409158\" (UID: \"86da753b-ae70-44b4-b160-395669409158\") "
Jul 20 16:56:09.935476 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935458    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-home" (OuterVolumeSpecName: "home") pod "86da753b-ae70-44b4-b160-395669409158" (UID: "86da753b-ae70-44b4-b160-395669409158"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:56:09.935538 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935519    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-model-cache" (OuterVolumeSpecName: "model-cache") pod "86da753b-ae70-44b4-b160-395669409158" (UID: "86da753b-ae70-44b4-b160-395669409158"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:56:09.935652 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935636    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-home\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:09.935725 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935655    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-model-cache\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:09.935725 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.935665    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-tmp-dir\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:09.937415 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.937393    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-dshm" (OuterVolumeSpecName: "dshm") pod "86da753b-ae70-44b4-b160-395669409158" (UID: "86da753b-ae70-44b4-b160-395669409158"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:56:09.937507 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.937444    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86da753b-ae70-44b4-b160-395669409158-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "86da753b-ae70-44b4-b160-395669409158" (UID: "86da753b-ae70-44b4-b160-395669409158"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:56:09.937550 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:09.937526    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86da753b-ae70-44b4-b160-395669409158-kube-api-access-88gg8" (OuterVolumeSpecName: "kube-api-access-88gg8") pod "86da753b-ae70-44b4-b160-395669409158" (UID: "86da753b-ae70-44b4-b160-395669409158"). InnerVolumeSpecName "kube-api-access-88gg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:56:10.036792 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.036770    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86da753b-ae70-44b4-b160-395669409158-dshm\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:10.036792 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.036791    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88gg8\" (UniqueName: \"kubernetes.io/projected/86da753b-ae70-44b4-b160-395669409158-kube-api-access-88gg8\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:10.036929 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.036802    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86da753b-ae70-44b4-b160-395669409158-tls-certs\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:10.165283 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.165259    2560 generic.go:356] "Generic (PLEG): container finished" podID="86da753b-ae70-44b4-b160-395669409158" containerID="286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12" exitCode=0
Jul 20 16:56:10.165467 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.165297    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"
Jul 20 16:56:10.165467 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.165311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2" event={"ID":"86da753b-ae70-44b4-b160-395669409158","Type":"ContainerDied","Data":"286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12"}
Jul 20 16:56:10.165467 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.165342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2" event={"ID":"86da753b-ae70-44b4-b160-395669409158","Type":"ContainerDied","Data":"9282bad48624966cac4b95c0ddaa34150eb5cd77342c97713bb3f9aff5c9ca44"}
Jul 20 16:56:10.165467 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.165359    2560 scope.go:117] "RemoveContainer" containerID="286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12"
Jul 20 16:56:10.175332 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.175315    2560 scope.go:117] "RemoveContainer" containerID="286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12"
Jul 20 16:56:10.175601 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:56:10.175583    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12\": container with ID starting with 286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12 not found: ID does not exist" containerID="286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12"
Jul 20 16:56:10.175676 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.175608    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12"} err="failed to get container status \"286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12\": rpc error: code = NotFound desc = could not find container \"286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12\": container with ID starting with 286f1a64a6fd738f6d8106e85d73494d415b2c8e38eb691c7c17755df27b8e12 not found: ID does not exist"
Jul 20 16:56:10.189866 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.189840    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"]
Jul 20 16:56:10.194026 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.194008    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/auth-test-model-42e123-kserve-847556cfcf-6f9r2"]
Jul 20 16:56:10.417109 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.417019    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td" podUID="88f21e9b-ffab-4370-8b08-adf122d65624" containerName="main" containerID="cri-o://449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7" gracePeriod=45
Jul 20 16:56:10.664025 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.664004    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:56:10.741548 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.741496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-home\") pod \"88f21e9b-ffab-4370-8b08-adf122d65624\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") "
Jul 20 16:56:10.741548 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.741538    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-tmp-dir\") pod \"88f21e9b-ffab-4370-8b08-adf122d65624\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") "
Jul 20 16:56:10.741747 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.741572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc958\" (UniqueName: \"kubernetes.io/projected/88f21e9b-ffab-4370-8b08-adf122d65624-kube-api-access-nc958\") pod \"88f21e9b-ffab-4370-8b08-adf122d65624\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") "
Jul 20 16:56:10.741747 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.741592    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f21e9b-ffab-4370-8b08-adf122d65624-tls-certs\") pod \"88f21e9b-ffab-4370-8b08-adf122d65624\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") "
Jul 20 16:56:10.741747 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.741617    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-model-cache\") pod \"88f21e9b-ffab-4370-8b08-adf122d65624\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") "
Jul 20 16:56:10.741747 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.741654    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-dshm\") pod \"88f21e9b-ffab-4370-8b08-adf122d65624\" (UID: \"88f21e9b-ffab-4370-8b08-adf122d65624\") "
Jul 20 16:56:10.741915 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.741773    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-home" (OuterVolumeSpecName: "home") pod "88f21e9b-ffab-4370-8b08-adf122d65624" (UID: "88f21e9b-ffab-4370-8b08-adf122d65624"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:56:10.741915 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.741883    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88f21e9b-ffab-4370-8b08-adf122d65624" (UID: "88f21e9b-ffab-4370-8b08-adf122d65624"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:56:10.741915 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.741893    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-model-cache" (OuterVolumeSpecName: "model-cache") pod "88f21e9b-ffab-4370-8b08-adf122d65624" (UID: "88f21e9b-ffab-4370-8b08-adf122d65624"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:56:10.743876 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.743850    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f21e9b-ffab-4370-8b08-adf122d65624-kube-api-access-nc958" (OuterVolumeSpecName: "kube-api-access-nc958") pod "88f21e9b-ffab-4370-8b08-adf122d65624" (UID: "88f21e9b-ffab-4370-8b08-adf122d65624"). InnerVolumeSpecName "kube-api-access-nc958". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:56:10.743973 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.743899    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f21e9b-ffab-4370-8b08-adf122d65624-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88f21e9b-ffab-4370-8b08-adf122d65624" (UID: "88f21e9b-ffab-4370-8b08-adf122d65624"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:56:10.743973 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.743899    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-dshm" (OuterVolumeSpecName: "dshm") pod "88f21e9b-ffab-4370-8b08-adf122d65624" (UID: "88f21e9b-ffab-4370-8b08-adf122d65624"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:56:10.842408 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.842384    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-dshm\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:10.842408 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.842406    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-home\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:10.842552 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.842414    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-tmp-dir\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:10.842552 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.842424    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc958\" (UniqueName: \"kubernetes.io/projected/88f21e9b-ffab-4370-8b08-adf122d65624-kube-api-access-nc958\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:10.842552 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.842434    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f21e9b-ffab-4370-8b08-adf122d65624-tls-certs\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:10.842552 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.842443    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f21e9b-ffab-4370-8b08-adf122d65624-model-cache\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:56:10.989350 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:10.989327    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:56:11.173105 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.173075    2560 generic.go:356] "Generic (PLEG): container finished" podID="88f21e9b-ffab-4370-8b08-adf122d65624" containerID="449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7" exitCode=0
Jul 20 16:56:11.173268 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.173118    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"
Jul 20 16:56:11.173268 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.173118    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td" event={"ID":"88f21e9b-ffab-4370-8b08-adf122d65624","Type":"ContainerDied","Data":"449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7"}
Jul 20 16:56:11.173268 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.173180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td" event={"ID":"88f21e9b-ffab-4370-8b08-adf122d65624","Type":"ContainerDied","Data":"9136be8c44bb68fa3d80a66a6eb26cf80d5357a644ae40021df9317ffff71735"}
Jul 20 16:56:11.173268 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.173203    2560 scope.go:117] "RemoveContainer" containerID="449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7"
Jul 20 16:56:11.182422 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.182407    2560 scope.go:117] "RemoveContainer" containerID="449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7"
Jul 20 16:56:11.182660 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:56:11.182642    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7\": container with ID starting with 449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7 not found: ID does not exist" containerID="449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7"
Jul 20 16:56:11.182720 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.182670    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7"} err="failed to get container status \"449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7\": rpc error: code = NotFound desc = could not find container \"449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7\": container with ID starting with 449d25985e7171e3cccb41a9cc2cd0ba5847b45be98185438e96b613624572e7 not found: ID does not exist"
Jul 20 16:56:11.195061 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.195032    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"]
Jul 20 16:56:11.198541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.198523    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/auth-test-model-c5c3fb-kserve-86798bb459-tn6td"]
Jul 20 16:56:11.849928 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.849891    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86da753b-ae70-44b4-b160-395669409158" path="/var/lib/kubelet/pods/86da753b-ae70-44b4-b160-395669409158/volumes"
Jul 20 16:56:11.850439 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:11.850417    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88f21e9b-ffab-4370-8b08-adf122d65624" path="/var/lib/kubelet/pods/88f21e9b-ffab-4370-8b08-adf122d65624/volumes"
Jul 20 16:56:33.017941 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.017907    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"]
Jul 20 16:56:33.018406 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.018390    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f21e9b-ffab-4370-8b08-adf122d65624" containerName="main"
Jul 20 16:56:33.018460 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.018409    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f21e9b-ffab-4370-8b08-adf122d65624" containerName="main"
Jul 20 16:56:33.018460 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.018429    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86da753b-ae70-44b4-b160-395669409158" containerName="main"
Jul 20 16:56:33.018460 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.018438    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86da753b-ae70-44b4-b160-395669409158" containerName="main"
Jul 20 16:56:33.018559 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.018523    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="86da753b-ae70-44b4-b160-395669409158" containerName="main"
Jul 20 16:56:33.018559 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.018538    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f21e9b-ffab-4370-8b08-adf122d65624" containerName="main"
Jul 20 16:56:33.023246 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.023230    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.026782 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.026756    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c5c3fb\"/\"openshift-service-ca.crt\""
Jul 20 16:56:33.026915 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.026808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c5c3fb\"/\"default-dockercfg-nk5nc\""
Jul 20 16:56:33.026915 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.026759    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c5c3fb\"/\"kube-root-ca.crt\""
Jul 20 16:56:33.027052 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.027037    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c5c3fb\"/\"sub-test-model-c5c3fb-kserve-self-signed-certs\""
Jul 20 16:56:33.029834 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.029791    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"]
Jul 20 16:56:33.099750 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.099721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tmp-dir\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.099874 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.099782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-model-cache\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.099874 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.099830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-home\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.099874 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.099869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tch46\" (UniqueName: \"kubernetes.io/projected/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-kube-api-access-tch46\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.100001 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.099899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-dshm\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.100001 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.099934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tls-certs\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.201247 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.201222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tch46\" (UniqueName: \"kubernetes.io/projected/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-kube-api-access-tch46\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.201350 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.201256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-dshm\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.201350 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.201286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tls-certs\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.201350 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.201310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tmp-dir\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.201350 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.201346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-model-cache\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.201575 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.201364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-home\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.201704 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.201682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tmp-dir\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.201759 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.201732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-model-cache\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.201799 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.201786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-home\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.203593 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.203574    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-dshm\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.203911 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.203888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tls-certs\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.210239 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.210219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tch46\" (UniqueName: \"kubernetes.io/projected/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-kube-api-access-tch46\") pod \"sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") " pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.333391 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.333369    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:33.462541 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:33.462514    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"]
Jul 20 16:56:33.464476 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:56:33.464449    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1520253_42ba_4fea_abaf_8ed0c8e0c2d5.slice/crio-8454ae389cc83db14bd670622e8d46dac90914e6fe60d1bf35469a0a1ba6f032 WatchSource:0}: Error finding container 8454ae389cc83db14bd670622e8d46dac90914e6fe60d1bf35469a0a1ba6f032: Status 404 returned error can't find the container with id 8454ae389cc83db14bd670622e8d46dac90914e6fe60d1bf35469a0a1ba6f032
Jul 20 16:56:34.290542 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:34.290498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz" event={"ID":"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5","Type":"ContainerStarted","Data":"5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823"}
Jul 20 16:56:34.290921 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:34.290557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz" event={"ID":"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5","Type":"ContainerStarted","Data":"8454ae389cc83db14bd670622e8d46dac90914e6fe60d1bf35469a0a1ba6f032"}
Jul 20 16:56:34.310975 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:34.310928    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz" podStartSLOduration=2.310914602 podStartE2EDuration="2.310914602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:56:34.30884434 +0000 UTC m=+2550.670544905" watchObservedRunningTime="2026-07-20 16:56:34.310914602 +0000 UTC m=+2550.672615165"
Jul 20 16:56:36.589442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:36.589408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:56:43.333850 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:43.333803    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:43.333850 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:43.333868    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:43.347597 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:43.347571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:56:44.354774 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:56:44.354744    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:57:04.414224 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:04.414194    2560 scope.go:117] "RemoveContainer" containerID="fe89d4a8fce4ed2233d5da0e7e96c363d99f8b9c5c1ff1a7e193253eb9974399"
Jul 20 16:57:10.489841 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:10.489807    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:57:24.189650 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:24.189616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:57:31.312319 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:31.312241    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"]
Jul 20 16:57:39.674366 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.674335    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"]
Jul 20 16:57:39.677881 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.677861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.682183 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.682164    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-42e123\"/\"openshift-service-ca.crt\""
Jul 20 16:57:39.682923 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.682902    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-42e123\"/\"rate-test-model-42e123-kserve-self-signed-certs\""
Jul 20 16:57:39.683090 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.683033    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-42e123\"/\"default-dockercfg-lxjxv\""
Jul 20 16:57:39.690938 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.690922    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-42e123\"/\"kube-root-ca.crt\""
Jul 20 16:57:39.712796 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.712777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"]
Jul 20 16:57:39.724377 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.724356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-dshm\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.724479 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.724385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tmp-dir\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.724479 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.724406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r88r\" (UniqueName: \"kubernetes.io/projected/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-kube-api-access-8r88r\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.724568 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.724486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-model-cache\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.724568 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.724550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-home\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.724685 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.724570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tls-certs\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.824927 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.824903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-dshm\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.825042 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.824933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tmp-dir\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.825042 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.824954    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r88r\" (UniqueName: \"kubernetes.io/projected/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-kube-api-access-8r88r\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.825042 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.824984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-model-cache\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.825251 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.825057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-home\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.825251 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.825080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tls-certs\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.825427 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.825400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tmp-dir\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.825545 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.825445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-model-cache\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.825545 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.825466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-home\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.827103 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.827076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-dshm\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.827423 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.827407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tls-certs\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.838867 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.838847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r88r\" (UniqueName: \"kubernetes.io/projected/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-kube-api-access-8r88r\") pod \"rate-test-model-42e123-kserve-784c786cbc-sghwn\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") " pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:39.987293 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:39.987216    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:40.116053 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:40.116021    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"]
Jul 20 16:57:40.118845 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:57:40.118817    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f9b94a9_708e_4f7b_add6_a912b0ef7afa.slice/crio-0a3ec090769fdba01a6c6c5f8d15cba6a457498a2dd8cde46efe831e306df3bd WatchSource:0}: Error finding container 0a3ec090769fdba01a6c6c5f8d15cba6a457498a2dd8cde46efe831e306df3bd: Status 404 returned error can't find the container with id 0a3ec090769fdba01a6c6c5f8d15cba6a457498a2dd8cde46efe831e306df3bd
Jul 20 16:57:40.646401 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:40.646363    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn" event={"ID":"4f9b94a9-708e-4f7b-add6-a912b0ef7afa","Type":"ContainerStarted","Data":"6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe"}
Jul 20 16:57:40.646609 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:40.646414    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn" event={"ID":"4f9b94a9-708e-4f7b-add6-a912b0ef7afa","Type":"ContainerStarted","Data":"0a3ec090769fdba01a6c6c5f8d15cba6a457498a2dd8cde46efe831e306df3bd"}
Jul 20 16:57:40.666278 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:40.666229    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn" podStartSLOduration=1.6662130529999999 podStartE2EDuration="1.666213053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:57:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:57:40.66425276 +0000 UTC m=+2617.025953323" watchObservedRunningTime="2026-07-20 16:57:40.666213053 +0000 UTC m=+2617.027913616"
Jul 20 16:57:42.390058 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:42.390019    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:57:46.332208 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.332168    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz" podUID="b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" containerName="main" containerID="cri-o://5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823" gracePeriod=45
Jul 20 16:57:46.570565 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.570539    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:57:46.674985 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.674918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tch46\" (UniqueName: \"kubernetes.io/projected/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-kube-api-access-tch46\") pod \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") "
Jul 20 16:57:46.674985 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.674978    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tmp-dir\") pod \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") "
Jul 20 16:57:46.675203 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.674996    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-home\") pod \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") "
Jul 20 16:57:46.675203 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.675046    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-dshm\") pod \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") "
Jul 20 16:57:46.675203 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.675063    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tls-certs\") pod \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") "
Jul 20 16:57:46.675203 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.675156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-model-cache\") pod \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\" (UID: \"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5\") "
Jul 20 16:57:46.675427 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.675215    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" (UID: "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:57:46.675427 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.675336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-home" (OuterVolumeSpecName: "home") pod "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" (UID: "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:57:46.675427 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.675404    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tmp-dir\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:57:46.675581 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.675424    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-home\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:57:46.675581 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.675462    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" (UID: "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:57:46.677403 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.677378    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" (UID: "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:57:46.677655 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.677622    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-kube-api-access-tch46" (OuterVolumeSpecName: "kube-api-access-tch46") pod "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" (UID: "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5"). InnerVolumeSpecName "kube-api-access-tch46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:57:46.677655 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.677640    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-dshm" (OuterVolumeSpecName: "dshm") pod "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" (UID: "b1520253-42ba-4fea-abaf-8ed0c8e0c2d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:57:46.677840 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.677737    2560 generic.go:356] "Generic (PLEG): container finished" podID="b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" containerID="5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823" exitCode=0
Jul 20 16:57:46.677840 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.677789    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"
Jul 20 16:57:46.677840 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.677819    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz" event={"ID":"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5","Type":"ContainerDied","Data":"5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823"}
Jul 20 16:57:46.677997 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.677868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz" event={"ID":"b1520253-42ba-4fea-abaf-8ed0c8e0c2d5","Type":"ContainerDied","Data":"8454ae389cc83db14bd670622e8d46dac90914e6fe60d1bf35469a0a1ba6f032"}
Jul 20 16:57:46.677997 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.677887    2560 scope.go:117] "RemoveContainer" containerID="5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823"
Jul 20 16:57:46.694017 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.694000    2560 scope.go:117] "RemoveContainer" containerID="5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823"
Jul 20 16:57:46.694370 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:57:46.694351    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823\": container with ID starting with 5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823 not found: ID does not exist" containerID="5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823"
Jul 20 16:57:46.694446 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.694377    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823"} err="failed to get container status \"5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823\": rpc error: code = NotFound desc = could not find container \"5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823\": container with ID starting with 5bf17b03967aad9802581dfa06dfa4437aea7eb8d6630aa86feff36f147cc823 not found: ID does not exist"
Jul 20 16:57:46.704478 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.704456    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"]
Jul 20 16:57:46.707943 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.707922    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c5c3fb/sub-test-model-c5c3fb-kserve-7b9fd44d99-vcwmz"]
Jul 20 16:57:46.776663 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.776643    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-dshm\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:57:46.776663 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.776661    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-tls-certs\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:57:46.776784 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.776671    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-model-cache\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:57:46.776784 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:46.776680    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tch46\" (UniqueName: \"kubernetes.io/projected/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5-kube-api-access-tch46\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:57:47.850660 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:47.850629    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" path="/var/lib/kubelet/pods/b1520253-42ba-4fea-abaf-8ed0c8e0c2d5/volumes"
Jul 20 16:57:49.987364 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:49.987331    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:49.987843 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:49.987383    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:49.999707 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:49.999685    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:57:50.711303 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:57:50.711278    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:58:04.443335 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:04.443304    2560 scope.go:117] "RemoveContainer" containerID="db83a57f6004592ac396400ca87e6ba0d74db6386fda2a73f3a6751fc4e1e52e"
Jul 20 16:58:04.451393 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:04.451324    2560 scope.go:117] "RemoveContainer" containerID="dfc35759d0e4c5d94ef72036e235d39a115fb36319622c2be7f8c4060f93702c"
Jul 20 16:58:12.000360 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:12.000327    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:58:31.294332 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:31.294301    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:58:44.792408 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:44.792371    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:58:52.141918 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:52.141883    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"]
Jul 20 16:58:57.484445 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.484371    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7456-140034189045168"]
Jul 20 16:58:57.484802 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.484671    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" containerName="main"
Jul 20 16:58:57.484802 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.484681    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" containerName="main"
Jul 20 16:58:57.484802 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.484747    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1520253-42ba-4fea-abaf-8ed0c8e0c2d5" containerName="main"
Jul 20 16:58:57.487658 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.487642    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189045168"
Jul 20 16:58:57.489892 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.489871    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ktqkz\""
Jul 20 16:58:57.494867 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.494617    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189045168"]
Jul 20 16:58:57.508236 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.508216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw7wq\" (UniqueName: \"kubernetes.io/projected/de0acbf4-87ad-4eb1-803d-606b1b6e139e-kube-api-access-bw7wq\") pod \"test-curl-7456-140034189045168\" (UID: \"de0acbf4-87ad-4eb1-803d-606b1b6e139e\") " pod="opendatahub/test-curl-7456-140034189045168"
Jul 20 16:58:57.609577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.609553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw7wq\" (UniqueName: \"kubernetes.io/projected/de0acbf4-87ad-4eb1-803d-606b1b6e139e-kube-api-access-bw7wq\") pod \"test-curl-7456-140034189045168\" (UID: \"de0acbf4-87ad-4eb1-803d-606b1b6e139e\") " pod="opendatahub/test-curl-7456-140034189045168"
Jul 20 16:58:57.617222 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.617199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw7wq\" (UniqueName: \"kubernetes.io/projected/de0acbf4-87ad-4eb1-803d-606b1b6e139e-kube-api-access-bw7wq\") pod \"test-curl-7456-140034189045168\" (UID: \"de0acbf4-87ad-4eb1-803d-606b1b6e139e\") " pod="opendatahub/test-curl-7456-140034189045168"
Jul 20 16:58:57.797675 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:57.797646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189045168"
Jul 20 16:58:58.130829 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:58.130802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189045168"]
Jul 20 16:58:58.132720 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:58:58.132688    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde0acbf4_87ad_4eb1_803d_606b1b6e139e.slice/crio-c6f01b728f4dd9c8c15970ea90b235ea5b3c562ef959a166300b97bf020219b1 WatchSource:0}: Error finding container c6f01b728f4dd9c8c15970ea90b235ea5b3c562ef959a166300b97bf020219b1: Status 404 returned error can't find the container with id c6f01b728f4dd9c8c15970ea90b235ea5b3c562ef959a166300b97bf020219b1
Jul 20 16:58:58.133971 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:58.133951    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 16:58:59.045553 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:59.045520    2560 generic.go:356] "Generic (PLEG): container finished" podID="de0acbf4-87ad-4eb1-803d-606b1b6e139e" containerID="dae2546c7d76b5b14cc59868b1a4391ad2761203f089229423f847bad3581f3c" exitCode=0
Jul 20 16:58:59.045843 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:59.045579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189045168" event={"ID":"de0acbf4-87ad-4eb1-803d-606b1b6e139e","Type":"ContainerDied","Data":"dae2546c7d76b5b14cc59868b1a4391ad2761203f089229423f847bad3581f3c"}
Jul 20 16:58:59.045843 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:58:59.045607    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189045168" event={"ID":"de0acbf4-87ad-4eb1-803d-606b1b6e139e","Type":"ContainerStarted","Data":"c6f01b728f4dd9c8c15970ea90b235ea5b3c562ef959a166300b97bf020219b1"}
Jul 20 16:59:00.180829 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:00.180806    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189045168"
Jul 20 16:59:00.218238 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:00.218217    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7456-140034189045168_de0acbf4-87ad-4eb1-803d-606b1b6e139e/test-curl-7456-140034189045168/0.log"
Jul 20 16:59:00.230446 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:00.230420    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw7wq\" (UniqueName: \"kubernetes.io/projected/de0acbf4-87ad-4eb1-803d-606b1b6e139e-kube-api-access-bw7wq\") pod \"de0acbf4-87ad-4eb1-803d-606b1b6e139e\" (UID: \"de0acbf4-87ad-4eb1-803d-606b1b6e139e\") "
Jul 20 16:59:00.232647 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:00.232626    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de0acbf4-87ad-4eb1-803d-606b1b6e139e-kube-api-access-bw7wq" (OuterVolumeSpecName: "kube-api-access-bw7wq") pod "de0acbf4-87ad-4eb1-803d-606b1b6e139e" (UID: "de0acbf4-87ad-4eb1-803d-606b1b6e139e"). InnerVolumeSpecName "kube-api-access-bw7wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:59:00.242834 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:00.242812    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7456-140034189045168"]
Jul 20 16:59:00.246580 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:00.246561    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7456-140034189045168"]
Jul 20 16:59:00.331987 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:00.331930    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw7wq\" (UniqueName: \"kubernetes.io/projected/de0acbf4-87ad-4eb1-803d-606b1b6e139e-kube-api-access-bw7wq\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:01.056044 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:01.056017    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6f01b728f4dd9c8c15970ea90b235ea5b3c562ef959a166300b97bf020219b1"
Jul 20 16:59:01.056241 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:01.056059    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189045168"
Jul 20 16:59:01.067824 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:59:01.067799    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-140034189045168\" is forbidden: User \"system:node:ip-10-0-135-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-221.ec2.internal' and this object" podUID="de0acbf4-87ad-4eb1-803d-606b1b6e139e" pod="opendatahub/test-curl-7456-140034189045168"
Jul 20 16:59:01.850452 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:01.850417    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de0acbf4-87ad-4eb1-803d-606b1b6e139e" path="/var/lib/kubelet/pods/de0acbf4-87ad-4eb1-803d-606b1b6e139e/volumes"
Jul 20 16:59:04.476406 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:04.476381    2560 scope.go:117] "RemoveContainer" containerID="d6af1083cefab27f909a08b463c695e820da12e684dc9f0d64718af20b2e3bfb"
Jul 20 16:59:04.889313 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:04.889279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:59:06.563479 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.563448    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:06.563883 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.563756    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de0acbf4-87ad-4eb1-803d-606b1b6e139e" containerName="test-curl-7456-140034189045168"
Jul 20 16:59:06.563883 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.563769    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="de0acbf4-87ad-4eb1-803d-606b1b6e139e" containerName="test-curl-7456-140034189045168"
Jul 20 16:59:06.563883 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.563859    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="de0acbf4-87ad-4eb1-803d-606b1b6e139e" containerName="test-curl-7456-140034189045168"
Jul 20 16:59:06.568491 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.568464    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:06.570821 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.570800    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ktqkz\""
Jul 20 16:59:06.571754 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.571728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:06.680788 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.680754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6s4w\" (UniqueName: \"kubernetes.io/projected/1f95b8c1-6b5e-4790-b099-39baa632391b-kube-api-access-p6s4w\") pod \"test-curl-7456-140034189195424\" (UID: \"1f95b8c1-6b5e-4790-b099-39baa632391b\") " pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:06.781605 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.781580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6s4w\" (UniqueName: \"kubernetes.io/projected/1f95b8c1-6b5e-4790-b099-39baa632391b-kube-api-access-p6s4w\") pod \"test-curl-7456-140034189195424\" (UID: \"1f95b8c1-6b5e-4790-b099-39baa632391b\") " pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:06.790095 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.790075    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6s4w\" (UniqueName: \"kubernetes.io/projected/1f95b8c1-6b5e-4790-b099-39baa632391b-kube-api-access-p6s4w\") pod \"test-curl-7456-140034189195424\" (UID: \"1f95b8c1-6b5e-4790-b099-39baa632391b\") " pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:06.879006 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:06.878953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:07.008110 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.008088    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:07.009648 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:59:07.009615    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f95b8c1_6b5e_4790_b099_39baa632391b.slice/crio-e2ee8c9fa1933c98a7fb590af4edbc08a36c3e5fea3588ee03ac7f2986a0e05c WatchSource:0}: Error finding container e2ee8c9fa1933c98a7fb590af4edbc08a36c3e5fea3588ee03ac7f2986a0e05c: Status 404 returned error can't find the container with id e2ee8c9fa1933c98a7fb590af4edbc08a36c3e5fea3588ee03ac7f2986a0e05c
Jul 20 16:59:07.088005 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.087975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189195424" event={"ID":"1f95b8c1-6b5e-4790-b099-39baa632391b","Type":"ContainerStarted","Data":"e2ee8c9fa1933c98a7fb590af4edbc08a36c3e5fea3588ee03ac7f2986a0e05c"}
Jul 20 16:59:07.160985 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.160927    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn" podUID="4f9b94a9-708e-4f7b-add6-a912b0ef7afa" containerName="main" containerID="cri-o://6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe" gracePeriod=45
Jul 20 16:59:07.390358 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.390334    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:59:07.488116 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488082    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-home\") pod \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") "
Jul 20 16:59:07.488270 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488170    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tmp-dir\") pod \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") "
Jul 20 16:59:07.488270 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488220    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-dshm\") pod \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") "
Jul 20 16:59:07.488270 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r88r\" (UniqueName: \"kubernetes.io/projected/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-kube-api-access-8r88r\") pod \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") "
Jul 20 16:59:07.488442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488311    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-model-cache\") pod \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") "
Jul 20 16:59:07.488442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488350    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-home" (OuterVolumeSpecName: "home") pod "4f9b94a9-708e-4f7b-add6-a912b0ef7afa" (UID: "4f9b94a9-708e-4f7b-add6-a912b0ef7afa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:59:07.488442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488357    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tls-certs\") pod \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\" (UID: \"4f9b94a9-708e-4f7b-add6-a912b0ef7afa\") "
Jul 20 16:59:07.488442 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488399    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4f9b94a9-708e-4f7b-add6-a912b0ef7afa" (UID: "4f9b94a9-708e-4f7b-add6-a912b0ef7afa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:59:07.488646 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488570    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-model-cache" (OuterVolumeSpecName: "model-cache") pod "4f9b94a9-708e-4f7b-add6-a912b0ef7afa" (UID: "4f9b94a9-708e-4f7b-add6-a912b0ef7afa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:59:07.488646 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488617    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-home\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:07.488646 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488630    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tmp-dir\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:07.488646 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.488644    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-model-cache\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:07.490360 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.490335    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4f9b94a9-708e-4f7b-add6-a912b0ef7afa" (UID: "4f9b94a9-708e-4f7b-add6-a912b0ef7afa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:59:07.490437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.490357    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-dshm" (OuterVolumeSpecName: "dshm") pod "4f9b94a9-708e-4f7b-add6-a912b0ef7afa" (UID: "4f9b94a9-708e-4f7b-add6-a912b0ef7afa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:59:07.490437 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.490372    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-kube-api-access-8r88r" (OuterVolumeSpecName: "kube-api-access-8r88r") pod "4f9b94a9-708e-4f7b-add6-a912b0ef7afa" (UID: "4f9b94a9-708e-4f7b-add6-a912b0ef7afa"). InnerVolumeSpecName "kube-api-access-8r88r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:59:07.589574 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.589553    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-dshm\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:07.589574 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.589572    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r88r\" (UniqueName: \"kubernetes.io/projected/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-kube-api-access-8r88r\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:07.589899 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:07.589583    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9b94a9-708e-4f7b-add6-a912b0ef7afa-tls-certs\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:08.093892 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.093809    2560 generic.go:356] "Generic (PLEG): container finished" podID="4f9b94a9-708e-4f7b-add6-a912b0ef7afa" containerID="6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe" exitCode=0
Jul 20 16:59:08.093892 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.093841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn" event={"ID":"4f9b94a9-708e-4f7b-add6-a912b0ef7afa","Type":"ContainerDied","Data":"6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe"}
Jul 20 16:59:08.093892 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.093873    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"
Jul 20 16:59:08.093892 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.093881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn" event={"ID":"4f9b94a9-708e-4f7b-add6-a912b0ef7afa","Type":"ContainerDied","Data":"0a3ec090769fdba01a6c6c5f8d15cba6a457498a2dd8cde46efe831e306df3bd"}
Jul 20 16:59:08.094214 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.093898    2560 scope.go:117] "RemoveContainer" containerID="6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe"
Jul 20 16:59:08.095800 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.095724    2560 generic.go:356] "Generic (PLEG): container finished" podID="1f95b8c1-6b5e-4790-b099-39baa632391b" containerID="563c5bba8b3428fca64cd58260d054bc6e93b29183a6266c8cc739bf7b2b8874" exitCode=0
Jul 20 16:59:08.095800 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.095766    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189195424" event={"ID":"1f95b8c1-6b5e-4790-b099-39baa632391b","Type":"ContainerDied","Data":"563c5bba8b3428fca64cd58260d054bc6e93b29183a6266c8cc739bf7b2b8874"}
Jul 20 16:59:08.102451 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.102434    2560 scope.go:117] "RemoveContainer" containerID="6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe"
Jul 20 16:59:08.102696 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:59:08.102675    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe\": container with ID starting with 6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe not found: ID does not exist" containerID="6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe"
Jul 20 16:59:08.102764 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.102707    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe"} err="failed to get container status \"6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe\": rpc error: code = NotFound desc = could not find container \"6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe\": container with ID starting with 6739a6bec4619fbe5da384977c7020533872d7d87e825baf1f99ee29f3b9debe not found: ID does not exist"
Jul 20 16:59:08.128800 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.128777    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"]
Jul 20 16:59:08.132731 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:08.132703    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-42e123/rate-test-model-42e123-kserve-784c786cbc-sghwn"]
Jul 20 16:59:09.238087 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.238064    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:09.257763 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.257728    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7456-140034189195424_1f95b8c1-6b5e-4790-b099-39baa632391b/test-curl-7456-140034189195424/0.log"
Jul 20 16:59:09.280700 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.280666    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:09.284559 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.284538    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:09.302827 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.302808    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6s4w\" (UniqueName: \"kubernetes.io/projected/1f95b8c1-6b5e-4790-b099-39baa632391b-kube-api-access-p6s4w\") pod \"1f95b8c1-6b5e-4790-b099-39baa632391b\" (UID: \"1f95b8c1-6b5e-4790-b099-39baa632391b\") "
Jul 20 16:59:09.304776 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.304757    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f95b8c1-6b5e-4790-b099-39baa632391b-kube-api-access-p6s4w" (OuterVolumeSpecName: "kube-api-access-p6s4w") pod "1f95b8c1-6b5e-4790-b099-39baa632391b" (UID: "1f95b8c1-6b5e-4790-b099-39baa632391b"). InnerVolumeSpecName "kube-api-access-p6s4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:59:09.404020 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.403964    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6s4w\" (UniqueName: \"kubernetes.io/projected/1f95b8c1-6b5e-4790-b099-39baa632391b-kube-api-access-p6s4w\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:09.409432 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.409410    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:09.409713 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.409701    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f9b94a9-708e-4f7b-add6-a912b0ef7afa" containerName="main"
Jul 20 16:59:09.409758 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.409715    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f9b94a9-708e-4f7b-add6-a912b0ef7afa" containerName="main"
Jul 20 16:59:09.409758 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.409729    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f95b8c1-6b5e-4790-b099-39baa632391b" containerName="test-curl-7456-140034189195424"
Jul 20 16:59:09.409758 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.409735    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f95b8c1-6b5e-4790-b099-39baa632391b" containerName="test-curl-7456-140034189195424"
Jul 20 16:59:09.409854 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.409791    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f95b8c1-6b5e-4790-b099-39baa632391b" containerName="test-curl-7456-140034189195424"
Jul 20 16:59:09.409854 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.409798    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f9b94a9-708e-4f7b-add6-a912b0ef7afa" containerName="main"
Jul 20 16:59:09.412876 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.412862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:09.420500 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.420485    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:09.504891 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.504868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqq2m\" (UniqueName: \"kubernetes.io/projected/97e5621a-3eff-4c25-bc74-a8ea45ac544c-kube-api-access-tqq2m\") pod \"test-curl-7456-140034189195424\" (UID: \"97e5621a-3eff-4c25-bc74-a8ea45ac544c\") " pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:09.606180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.606156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqq2m\" (UniqueName: \"kubernetes.io/projected/97e5621a-3eff-4c25-bc74-a8ea45ac544c-kube-api-access-tqq2m\") pod \"test-curl-7456-140034189195424\" (UID: \"97e5621a-3eff-4c25-bc74-a8ea45ac544c\") " pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:09.615448 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.615426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqq2m\" (UniqueName: \"kubernetes.io/projected/97e5621a-3eff-4c25-bc74-a8ea45ac544c-kube-api-access-tqq2m\") pod \"test-curl-7456-140034189195424\" (UID: \"97e5621a-3eff-4c25-bc74-a8ea45ac544c\") " pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:09.722622 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.722572    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:09.850053 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:59:09.850020    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97e5621a_3eff_4c25_bc74_a8ea45ac544c.slice/crio-c1b69fdeeb2f0fde7bb6355707ad1168fbf897d0e4f4ef41aa9a3c5f19b4866c WatchSource:0}: Error finding container c1b69fdeeb2f0fde7bb6355707ad1168fbf897d0e4f4ef41aa9a3c5f19b4866c: Status 404 returned error can't find the container with id c1b69fdeeb2f0fde7bb6355707ad1168fbf897d0e4f4ef41aa9a3c5f19b4866c
Jul 20 16:59:09.852235 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.852211    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f95b8c1-6b5e-4790-b099-39baa632391b" path="/var/lib/kubelet/pods/1f95b8c1-6b5e-4790-b099-39baa632391b/volumes"
Jul 20 16:59:09.852638 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.852624    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f9b94a9-708e-4f7b-add6-a912b0ef7afa" path="/var/lib/kubelet/pods/4f9b94a9-708e-4f7b-add6-a912b0ef7afa/volumes"
Jul 20 16:59:09.852964 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:09.852945    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:10.108496 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:10.108475    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:10.108630 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:10.108531    2560 scope.go:117] "RemoveContainer" containerID="563c5bba8b3428fca64cd58260d054bc6e93b29183a6266c8cc739bf7b2b8874"
Jul 20 16:59:10.109728 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:10.109669    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189195424" event={"ID":"97e5621a-3eff-4c25-bc74-a8ea45ac544c","Type":"ContainerStarted","Data":"c1b69fdeeb2f0fde7bb6355707ad1168fbf897d0e4f4ef41aa9a3c5f19b4866c"}
Jul 20 16:59:11.115632 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:11.115600    2560 generic.go:356] "Generic (PLEG): container finished" podID="97e5621a-3eff-4c25-bc74-a8ea45ac544c" containerID="17f8008020e88e5d51f1a0034548e51a4756189a2e1d09dde49cdef55f7d559e" exitCode=0
Jul 20 16:59:11.116017 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:11.115685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189195424" event={"ID":"97e5621a-3eff-4c25-bc74-a8ea45ac544c","Type":"ContainerDied","Data":"17f8008020e88e5d51f1a0034548e51a4756189a2e1d09dde49cdef55f7d559e"}
Jul 20 16:59:12.251826 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.251805    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:12.277824 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.277806    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7456-140034189195424_97e5621a-3eff-4c25-bc74-a8ea45ac544c/test-curl-7456-140034189195424/0.log"
Jul 20 16:59:12.305526 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.305503    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:12.311822 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.311801    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7456-140034189195424"]
Jul 20 16:59:12.328082 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.328060    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqq2m\" (UniqueName: \"kubernetes.io/projected/97e5621a-3eff-4c25-bc74-a8ea45ac544c-kube-api-access-tqq2m\") pod \"97e5621a-3eff-4c25-bc74-a8ea45ac544c\" (UID: \"97e5621a-3eff-4c25-bc74-a8ea45ac544c\") "
Jul 20 16:59:12.330153 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.330097    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e5621a-3eff-4c25-bc74-a8ea45ac544c-kube-api-access-tqq2m" (OuterVolumeSpecName: "kube-api-access-tqq2m") pod "97e5621a-3eff-4c25-bc74-a8ea45ac544c" (UID: "97e5621a-3eff-4c25-bc74-a8ea45ac544c"). InnerVolumeSpecName "kube-api-access-tqq2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:59:12.429491 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.429439    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqq2m\" (UniqueName: \"kubernetes.io/projected/97e5621a-3eff-4c25-bc74-a8ea45ac544c-kube-api-access-tqq2m\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:12.484076 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.484052    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"]
Jul 20 16:59:12.484421 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.484408    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e5621a-3eff-4c25-bc74-a8ea45ac544c" containerName="test-curl-7456-140034189195424"
Jul 20 16:59:12.484468 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.484424    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e5621a-3eff-4c25-bc74-a8ea45ac544c" containerName="test-curl-7456-140034189195424"
Jul 20 16:59:12.484510 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.484489    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e5621a-3eff-4c25-bc74-a8ea45ac544c" containerName="test-curl-7456-140034189195424"
Jul 20 16:59:12.487276 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.487262    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"
Jul 20 16:59:12.489849 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.489833    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:59:12.496292 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.496274    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"]
Jul 20 16:59:12.530366 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.530338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdf3109-aa1d-4d5c-9827-9235bf3bfd52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c\" (UID: \"2fdf3109-aa1d-4d5c-9827-9235bf3bfd52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"
Jul 20 16:59:12.631231 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.631205    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdf3109-aa1d-4d5c-9827-9235bf3bfd52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c\" (UID: \"2fdf3109-aa1d-4d5c-9827-9235bf3bfd52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"
Jul 20 16:59:12.631781 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.631762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdf3109-aa1d-4d5c-9827-9235bf3bfd52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c\" (UID: \"2fdf3109-aa1d-4d5c-9827-9235bf3bfd52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"
Jul 20 16:59:12.798065 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.798042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"
Jul 20 16:59:12.931885 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:12.931862    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"]
Jul 20 16:59:12.933380 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:59:12.933347    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdf3109_aa1d_4d5c_9827_9235bf3bfd52.slice/crio-c45a0f36bc37082e578f22be9f5ab82a84faf4dc164546fd06cb49e9389e0931 WatchSource:0}: Error finding container c45a0f36bc37082e578f22be9f5ab82a84faf4dc164546fd06cb49e9389e0931: Status 404 returned error can't find the container with id c45a0f36bc37082e578f22be9f5ab82a84faf4dc164546fd06cb49e9389e0931
Jul 20 16:59:13.127997 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:13.127977    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1b69fdeeb2f0fde7bb6355707ad1168fbf897d0e4f4ef41aa9a3c5f19b4866c"
Jul 20 16:59:13.127997 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:13.127986    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:13.129550 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:13.129522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c" event={"ID":"2fdf3109-aa1d-4d5c-9827-9235bf3bfd52","Type":"ContainerStarted","Data":"e598d99726a3001e45959939f684c349141ccbea8e14723b8ec5d64b0ec9ba71"}
Jul 20 16:59:13.129634 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:13.129575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c" event={"ID":"2fdf3109-aa1d-4d5c-9827-9235bf3bfd52","Type":"ContainerStarted","Data":"c45a0f36bc37082e578f22be9f5ab82a84faf4dc164546fd06cb49e9389e0931"}
Jul 20 16:59:13.147258 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:59:13.147232    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-140034189195424\" is forbidden: User \"system:node:ip-10-0-135-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-221.ec2.internal' and this object" podUID="97e5621a-3eff-4c25-bc74-a8ea45ac544c" pod="opendatahub/test-curl-7456-140034189195424"
Jul 20 16:59:13.147967 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:13.147932    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c" podStartSLOduration=1.147918165 podStartE2EDuration="1.147918165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:59:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:59:13.145152572 +0000 UTC m=+2709.506853134" watchObservedRunningTime="2026-07-20 16:59:13.147918165 +0000 UTC m=+2709.509618754"
Jul 20 16:59:13.852276 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:13.852250    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97e5621a-3eff-4c25-bc74-a8ea45ac544c" path="/var/lib/kubelet/pods/97e5621a-3eff-4c25-bc74-a8ea45ac544c/volumes"
Jul 20 16:59:14.135972 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:14.135903    2560 generic.go:356] "Generic (PLEG): container finished" podID="2fdf3109-aa1d-4d5c-9827-9235bf3bfd52" containerID="e598d99726a3001e45959939f684c349141ccbea8e14723b8ec5d64b0ec9ba71" exitCode=0
Jul 20 16:59:14.136090 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:14.135984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c" event={"ID":"2fdf3109-aa1d-4d5c-9827-9235bf3bfd52","Type":"ContainerDied","Data":"e598d99726a3001e45959939f684c349141ccbea8e14723b8ec5d64b0ec9ba71"}
Jul 20 16:59:15.264698 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:15.264675    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"
Jul 20 16:59:15.354058 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:15.354032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdf3109-aa1d-4d5c-9827-9235bf3bfd52-maas-api-service-ca\") pod \"2fdf3109-aa1d-4d5c-9827-9235bf3bfd52\" (UID: \"2fdf3109-aa1d-4d5c-9827-9235bf3bfd52\") "
Jul 20 16:59:15.354375 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:15.354355    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdf3109-aa1d-4d5c-9827-9235bf3bfd52-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2fdf3109-aa1d-4d5c-9827-9235bf3bfd52" (UID: "2fdf3109-aa1d-4d5c-9827-9235bf3bfd52"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:59:15.455171 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:15.455096    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdf3109-aa1d-4d5c-9827-9235bf3bfd52-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:16.147273 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:16.147211    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"
Jul 20 16:59:16.147273 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:16.147258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c" event={"ID":"2fdf3109-aa1d-4d5c-9827-9235bf3bfd52","Type":"ContainerDied","Data":"c45a0f36bc37082e578f22be9f5ab82a84faf4dc164546fd06cb49e9389e0931"}
Jul 20 16:59:16.147434 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:16.147300    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c45a0f36bc37082e578f22be9f5ab82a84faf4dc164546fd06cb49e9389e0931"
Jul 20 16:59:22.952493 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:22.952453    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"]
Jul 20 16:59:22.952999 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:22.952700    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9" podUID="27c89464-405f-46b4-ab91-7051c3087929" containerName="maas-api" containerID="cri-o://3bc0496ca83698bdf604957ce290233995578267fe9fcc58bd8674eb1db5e688" gracePeriod=30
Jul 20 16:59:23.185680 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.185645    2560 generic.go:356] "Generic (PLEG): container finished" podID="27c89464-405f-46b4-ab91-7051c3087929" containerID="3bc0496ca83698bdf604957ce290233995578267fe9fcc58bd8674eb1db5e688" exitCode=0
Jul 20 16:59:23.185825 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.185688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9" event={"ID":"27c89464-405f-46b4-ab91-7051c3087929","Type":"ContainerDied","Data":"3bc0496ca83698bdf604957ce290233995578267fe9fcc58bd8674eb1db5e688"}
Jul 20 16:59:23.200195 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.200178    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:59:23.315026 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.315002    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c89464-405f-46b4-ab91-7051c3087929-openshift-service-ca\") pod \"27c89464-405f-46b4-ab91-7051c3087929\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") "
Jul 20 16:59:23.315180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.315043    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzkmx\" (UniqueName: \"kubernetes.io/projected/27c89464-405f-46b4-ab91-7051c3087929-kube-api-access-dzkmx\") pod \"27c89464-405f-46b4-ab91-7051c3087929\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") "
Jul 20 16:59:23.315180 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.315106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c89464-405f-46b4-ab91-7051c3087929-maas-api-tls\") pod \"27c89464-405f-46b4-ab91-7051c3087929\" (UID: \"27c89464-405f-46b4-ab91-7051c3087929\") "
Jul 20 16:59:23.315369 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.315346    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c89464-405f-46b4-ab91-7051c3087929-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27c89464-405f-46b4-ab91-7051c3087929" (UID: "27c89464-405f-46b4-ab91-7051c3087929"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:59:23.317140 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.317109    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c89464-405f-46b4-ab91-7051c3087929-kube-api-access-dzkmx" (OuterVolumeSpecName: "kube-api-access-dzkmx") pod "27c89464-405f-46b4-ab91-7051c3087929" (UID: "27c89464-405f-46b4-ab91-7051c3087929"). InnerVolumeSpecName "kube-api-access-dzkmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:59:23.317229 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.317149    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27c89464-405f-46b4-ab91-7051c3087929-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27c89464-405f-46b4-ab91-7051c3087929" (UID: "27c89464-405f-46b4-ab91-7051c3087929"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:59:23.415904 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.415880    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27c89464-405f-46b4-ab91-7051c3087929-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:23.415904 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.415901    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c89464-405f-46b4-ab91-7051c3087929-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:23.416050 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:23.415911    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzkmx\" (UniqueName: \"kubernetes.io/projected/27c89464-405f-46b4-ab91-7051c3087929-kube-api-access-dzkmx\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:24.191429 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:24.191354    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"
Jul 20 16:59:24.191809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:24.191353    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9" event={"ID":"27c89464-405f-46b4-ab91-7051c3087929","Type":"ContainerDied","Data":"cdeea7eb35b1d5721f9a399bde7909b7988cfad29ea61fd39bedf5ed0bd78c13"}
Jul 20 16:59:24.191809 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:24.191520    2560 scope.go:117] "RemoveContainer" containerID="3bc0496ca83698bdf604957ce290233995578267fe9fcc58bd8674eb1db5e688"
Jul 20 16:59:24.208895 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:24.208874    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"]
Jul 20 16:59:24.214829 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:24.214805    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9"]
Jul 20 16:59:25.851937 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:25.851893    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27c89464-405f-46b4-ab91-7051c3087929" path="/var/lib/kubelet/pods/27c89464-405f-46b4-ab91-7051c3087929/volumes"
Jul 20 16:59:25.884295 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:25.884253    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:59:26.131994 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:26.131905    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-42e123-5bb494c57c-vv7x9" podUID="27c89464-405f-46b4-ab91-7051c3087929" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.56:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 20 16:59:27.589096 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:27.589066    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"]
Jul 20 16:59:27.591662 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:27.591637    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-42e123-j7b8c"]
Jul 20 16:59:27.851225 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:27.851141    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fdf3109-aa1d-4d5c-9827-9235bf3bfd52" path="/var/lib/kubelet/pods/2fdf3109-aa1d-4d5c-9827-9235bf3bfd52/volumes"
Jul 20 16:59:34.594490 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.594458    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"]
Jul 20 16:59:34.594860 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.594752    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c89464-405f-46b4-ab91-7051c3087929" containerName="maas-api"
Jul 20 16:59:34.594860 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.594763    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c89464-405f-46b4-ab91-7051c3087929" containerName="maas-api"
Jul 20 16:59:34.594860 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.594783    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fdf3109-aa1d-4d5c-9827-9235bf3bfd52" containerName="revoke-keys"
Jul 20 16:59:34.594860 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.594789    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fdf3109-aa1d-4d5c-9827-9235bf3bfd52" containerName="revoke-keys"
Jul 20 16:59:34.594860 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.594838    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fdf3109-aa1d-4d5c-9827-9235bf3bfd52" containerName="revoke-keys"
Jul 20 16:59:34.594860 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.594848    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="27c89464-405f-46b4-ab91-7051c3087929" containerName="maas-api"
Jul 20 16:59:34.599893 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.599875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"
Jul 20 16:59:34.602684 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.602662    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 16:59:34.607469 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.607448    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"]
Jul 20 16:59:34.703108 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.703079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a04f26-3631-4a8b-90e8-287c002dc438-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx\" (UID: \"b2a04f26-3631-4a8b-90e8-287c002dc438\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"
Jul 20 16:59:34.803976 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.803948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a04f26-3631-4a8b-90e8-287c002dc438-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx\" (UID: \"b2a04f26-3631-4a8b-90e8-287c002dc438\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"
Jul 20 16:59:34.804519 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.804503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a04f26-3631-4a8b-90e8-287c002dc438-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx\" (UID: \"b2a04f26-3631-4a8b-90e8-287c002dc438\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"
Jul 20 16:59:34.910577 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:34.910521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"
Jul 20 16:59:35.064682 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:35.064655    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"]
Jul 20 16:59:35.066652 ip-10-0-135-221 kubenswrapper[2560]: W0720 16:59:35.066625    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a04f26_3631_4a8b_90e8_287c002dc438.slice/crio-d66ecbda7706a50b07ef0bd4f8893360466df93e79b876fbd71cb9d0c0a898f1 WatchSource:0}: Error finding container d66ecbda7706a50b07ef0bd4f8893360466df93e79b876fbd71cb9d0c0a898f1: Status 404 returned error can't find the container with id d66ecbda7706a50b07ef0bd4f8893360466df93e79b876fbd71cb9d0c0a898f1
Jul 20 16:59:35.247636 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:35.247572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx" event={"ID":"b2a04f26-3631-4a8b-90e8-287c002dc438","Type":"ContainerStarted","Data":"d66ecbda7706a50b07ef0bd4f8893360466df93e79b876fbd71cb9d0c0a898f1"}
Jul 20 16:59:36.253276 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:36.253244    2560 generic.go:356] "Generic (PLEG): container finished" podID="b2a04f26-3631-4a8b-90e8-287c002dc438" containerID="13a0393b6692b143584b2e33f915b922dbadddcab960662c78aec0d6d5a0ee87" exitCode=0
Jul 20 16:59:36.253648 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:36.253326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx" event={"ID":"b2a04f26-3631-4a8b-90e8-287c002dc438","Type":"ContainerDied","Data":"13a0393b6692b143584b2e33f915b922dbadddcab960662c78aec0d6d5a0ee87"}
Jul 20 16:59:37.384965 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:37.384943    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"
Jul 20 16:59:37.525698 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:37.525675    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a04f26-3631-4a8b-90e8-287c002dc438-maas-api-service-ca\") pod \"b2a04f26-3631-4a8b-90e8-287c002dc438\" (UID: \"b2a04f26-3631-4a8b-90e8-287c002dc438\") "
Jul 20 16:59:37.526026 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:37.526006    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2a04f26-3631-4a8b-90e8-287c002dc438-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b2a04f26-3631-4a8b-90e8-287c002dc438" (UID: "b2a04f26-3631-4a8b-90e8-287c002dc438"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:59:37.626911 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:37.626881    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a04f26-3631-4a8b-90e8-287c002dc438-maas-api-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:38.264728 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:38.264656    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"
Jul 20 16:59:38.264728 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:38.264704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx" event={"ID":"b2a04f26-3631-4a8b-90e8-287c002dc438","Type":"ContainerDied","Data":"d66ecbda7706a50b07ef0bd4f8893360466df93e79b876fbd71cb9d0c0a898f1"}
Jul 20 16:59:38.264920 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:38.264748    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d66ecbda7706a50b07ef0bd4f8893360466df93e79b876fbd71cb9d0c0a898f1"
Jul 20 16:59:45.296605 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.296569    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"]
Jul 20 16:59:45.303568 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.303532    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t" podUID="63291311-8849-43af-aedd-6bb7bdc43219" containerName="maas-api" containerID="cri-o://8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5" gracePeriod=30
Jul 20 16:59:45.545821 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.545799    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:59:45.691220 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.691155    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63291311-8849-43af-aedd-6bb7bdc43219-maas-api-tls\") pod \"63291311-8849-43af-aedd-6bb7bdc43219\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") "
Jul 20 16:59:45.691339 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.691227    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jbcc\" (UniqueName: \"kubernetes.io/projected/63291311-8849-43af-aedd-6bb7bdc43219-kube-api-access-5jbcc\") pod \"63291311-8849-43af-aedd-6bb7bdc43219\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") "
Jul 20 16:59:45.691339 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.691248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63291311-8849-43af-aedd-6bb7bdc43219-openshift-service-ca\") pod \"63291311-8849-43af-aedd-6bb7bdc43219\" (UID: \"63291311-8849-43af-aedd-6bb7bdc43219\") "
Jul 20 16:59:45.691659 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.691628    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63291311-8849-43af-aedd-6bb7bdc43219-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63291311-8849-43af-aedd-6bb7bdc43219" (UID: "63291311-8849-43af-aedd-6bb7bdc43219"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:59:45.693079 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.693058    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63291311-8849-43af-aedd-6bb7bdc43219-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63291311-8849-43af-aedd-6bb7bdc43219" (UID: "63291311-8849-43af-aedd-6bb7bdc43219"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:59:45.693263 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.693244    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63291311-8849-43af-aedd-6bb7bdc43219-kube-api-access-5jbcc" (OuterVolumeSpecName: "kube-api-access-5jbcc") pod "63291311-8849-43af-aedd-6bb7bdc43219" (UID: "63291311-8849-43af-aedd-6bb7bdc43219"). InnerVolumeSpecName "kube-api-access-5jbcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:59:45.791881 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.791858    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jbcc\" (UniqueName: \"kubernetes.io/projected/63291311-8849-43af-aedd-6bb7bdc43219-kube-api-access-5jbcc\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:45.791881 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.791880    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63291311-8849-43af-aedd-6bb7bdc43219-openshift-service-ca\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:45.792006 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:45.791890    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63291311-8849-43af-aedd-6bb7bdc43219-maas-api-tls\") on node \"ip-10-0-135-221.ec2.internal\" DevicePath \"\""
Jul 20 16:59:46.309112 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:46.309071    2560 generic.go:356] "Generic (PLEG): container finished" podID="63291311-8849-43af-aedd-6bb7bdc43219" containerID="8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5" exitCode=0
Jul 20 16:59:46.309616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:46.309115    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"
Jul 20 16:59:46.309616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:46.309156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t" event={"ID":"63291311-8849-43af-aedd-6bb7bdc43219","Type":"ContainerDied","Data":"8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5"}
Jul 20 16:59:46.309616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:46.309210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t" event={"ID":"63291311-8849-43af-aedd-6bb7bdc43219","Type":"ContainerDied","Data":"4d1a170cac625be69f0e761271a38afa714102ef7c445cf8a9a35c50cf6938ff"}
Jul 20 16:59:46.309616 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:46.309235    2560 scope.go:117] "RemoveContainer" containerID="8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5"
Jul 20 16:59:46.318156 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:46.318121    2560 scope.go:117] "RemoveContainer" containerID="8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5"
Jul 20 16:59:46.318401 ip-10-0-135-221 kubenswrapper[2560]: E0720 16:59:46.318384    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5\": container with ID starting with 8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5 not found: ID does not exist" containerID="8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5"
Jul 20 16:59:46.318448 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:46.318409    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5"} err="failed to get container status \"8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5\": rpc error: code = NotFound desc = could not find container \"8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5\": container with ID starting with 8cbe6ac68b5a9e70e664ebd8b330268274876fd8b2a1a0a45d03a9fadc3609d5 not found: ID does not exist"
Jul 20 16:59:46.329386 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:46.329363    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"]
Jul 20 16:59:46.333262 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:46.333243    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c5c3fb-84c5c86d87-nqb6t"]
Jul 20 16:59:47.850588 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:47.850543    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63291311-8849-43af-aedd-6bb7bdc43219" path="/var/lib/kubelet/pods/63291311-8849-43af-aedd-6bb7bdc43219/volumes"
Jul 20 16:59:48.217411 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:48.217335    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sdwj2"]
Jul 20 16:59:49.686084 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:49.686055    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"]
Jul 20 16:59:49.689419 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:49.689392    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c5c3fb-zlxvx"]
Jul 20 16:59:49.850481 ip-10-0-135-221 kubenswrapper[2560]: I0720 16:59:49.850444    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2a04f26-3631-4a8b-90e8-287c002dc438" path="/var/lib/kubelet/pods/b2a04f26-3631-4a8b-90e8-287c002dc438/volumes"
Jul 20 17:00:00.142007 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.141971    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx"]
Jul 20 17:00:00.142485 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.142315    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63291311-8849-43af-aedd-6bb7bdc43219" containerName="maas-api"
Jul 20 17:00:00.142485 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.142327    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63291311-8849-43af-aedd-6bb7bdc43219" containerName="maas-api"
Jul 20 17:00:00.142485 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.142338    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2a04f26-3631-4a8b-90e8-287c002dc438" containerName="revoke-keys"
Jul 20 17:00:00.142485 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.142343    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2a04f26-3631-4a8b-90e8-287c002dc438" containerName="revoke-keys"
Jul 20 17:00:00.142485 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.142408    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2a04f26-3631-4a8b-90e8-287c002dc438" containerName="revoke-keys"
Jul 20 17:00:00.142485 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.142416    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63291311-8849-43af-aedd-6bb7bdc43219" containerName="maas-api"
Jul 20 17:00:00.146409 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.146394    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx"
Jul 20 17:00:00.149028 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.149000    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\""
Jul 20 17:00:00.154743 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.154717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx"]
Jul 20 17:00:00.157160 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.157115    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx"
Jul 20 17:00:00.287890 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.287868    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx"]
Jul 20 17:00:00.289962 ip-10-0-135-221 kubenswrapper[2560]: W0720 17:00:00.289936    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0c1c06_8b9f_49c2_9343_95bf012d2a2c.slice/crio-30cc68371df45891711a57a0aba82ee907fdb334418d16d7206490833dabef6d WatchSource:0}: Error finding container 30cc68371df45891711a57a0aba82ee907fdb334418d16d7206490833dabef6d: Status 404 returned error can't find the container with id 30cc68371df45891711a57a0aba82ee907fdb334418d16d7206490833dabef6d
Jul 20 17:00:00.385999 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:00.385973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx" event={"ID":"6a0c1c06-8b9f-49c2-9343-95bf012d2a2c","Type":"ContainerStarted","Data":"30cc68371df45891711a57a0aba82ee907fdb334418d16d7206490833dabef6d"}
Jul 20 17:00:01.393999 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:01.393963    2560 generic.go:356] "Generic (PLEG): container finished" podID="6a0c1c06-8b9f-49c2-9343-95bf012d2a2c" containerID="c6912f4680ea85bf28f49a44c748e69e888f7c4678889ec9a725c7be1a1d2ed0" exitCode=0
Jul 20 17:00:01.394440 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:01.394054    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx" event={"ID":"6a0c1c06-8b9f-49c2-9343-95bf012d2a2c","Type":"ContainerDied","Data":"c6912f4680ea85bf28f49a44c748e69e888f7c4678889ec9a725c7be1a1d2ed0"}
Jul 20 17:00:02.528313 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:02.528284    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx"
Jul 20 17:00:02.703245 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:02.703168    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bbb748554-4ph5k_fa2ad733-3093-4e94-b6c7-4743804b7ab7/copy-manifests/0.log"
Jul 20 17:00:02.711021 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:02.710994    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bbb748554-4ph5k_fa2ad733-3093-4e94-b6c7-4743804b7ab7/manager/0.log"
Jul 20 17:00:03.405727 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:03.405697    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx"
Jul 20 17:00:03.405926 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:03.405735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-2xlnx" event={"ID":"6a0c1c06-8b9f-49c2-9343-95bf012d2a2c","Type":"ContainerDied","Data":"30cc68371df45891711a57a0aba82ee907fdb334418d16d7206490833dabef6d"}
Jul 20 17:00:03.405926 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:03.405778    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30cc68371df45891711a57a0aba82ee907fdb334418d16d7206490833dabef6d"
Jul 20 17:00:03.514194 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:03.514170    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742765-h82l5_c4e144ca-1630-4ee3-9f6d-8fb08824b01a/cleanup/0.log"
Jul 20 17:00:03.623378 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:03.623355    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742780-2xlnx_6a0c1c06-8b9f-49c2-9343-95bf012d2a2c/cleanup/0.log"
Jul 20 17:00:04.504010 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.503982    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5_94fb34cd-7926-46ff-9c62-c86d9dd3a775/util/0.log"
Jul 20 17:00:04.512797 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.512772    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5_94fb34cd-7926-46ff-9c62-c86d9dd3a775/pull/0.log"
Jul 20 17:00:04.519310 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.519289    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5_94fb34cd-7926-46ff-9c62-c86d9dd3a775/extract/0.log"
Jul 20 17:00:04.633023 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.632986    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd_21fdd515-674a-465c-baac-dabbde144bcb/util/0.log"
Jul 20 17:00:04.640045 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.640022    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd_21fdd515-674a-465c-baac-dabbde144bcb/pull/0.log"
Jul 20 17:00:04.646625 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.646605    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd_21fdd515-674a-465c-baac-dabbde144bcb/extract/0.log"
Jul 20 17:00:04.757184 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.757083    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2_36b97d55-8e41-43e9-8204-c4baca9d3e98/util/0.log"
Jul 20 17:00:04.764656 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.764635    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2_36b97d55-8e41-43e9-8204-c4baca9d3e98/pull/0.log"
Jul 20 17:00:04.772282 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.772266    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2_36b97d55-8e41-43e9-8204-c4baca9d3e98/extract/0.log"
Jul 20 17:00:04.884614 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.884590    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv_e4c58a20-5650-4300-8b23-737afb523913/util/0.log"
Jul 20 17:00:04.891898 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.891878    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv_e4c58a20-5650-4300-8b23-737afb523913/pull/0.log"
Jul 20 17:00:04.898507 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:04.898487    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv_e4c58a20-5650-4300-8b23-737afb523913/extract/0.log"
Jul 20 17:00:05.697774 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:05.697741    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-sdwj2_b17735e3-b255-48b0-bc35-bbbf44c74d2c/limitador/0.log"
Jul 20 17:00:06.281712 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:06.281679    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-x5hpt_f4be2a34-6dcf-4e89-ae7c-549d08cae6e7/discovery/0.log"
Jul 20 17:00:07.644438 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:07.644413    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6z9z8_0979d5a6-8514-4268-a842-90499d8a4d2a/main/0.log"
Jul 20 17:00:13.492617 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.492584    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6xq7b/must-gather-8w59b"]
Jul 20 17:00:13.492999 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.492900    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a0c1c06-8b9f-49c2-9343-95bf012d2a2c" containerName="cleanup"
Jul 20 17:00:13.492999 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.492912    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a0c1c06-8b9f-49c2-9343-95bf012d2a2c" containerName="cleanup"
Jul 20 17:00:13.492999 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.492995    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a0c1c06-8b9f-49c2-9343-95bf012d2a2c" containerName="cleanup"
Jul 20 17:00:13.496164 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.496121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xq7b/must-gather-8w59b"
Jul 20 17:00:13.498683 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.498663    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6xq7b\"/\"default-dockercfg-gflxw\""
Jul 20 17:00:13.499140 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.499113    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6xq7b\"/\"openshift-service-ca.crt\""
Jul 20 17:00:13.499563 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.499547    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6xq7b\"/\"kube-root-ca.crt\""
Jul 20 17:00:13.506357 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.506331    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xq7b/must-gather-8w59b"]
Jul 20 17:00:13.597505 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.597476    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64t5\" (UniqueName: \"kubernetes.io/projected/8de5f73c-5209-433d-9db8-869cdf54d809-kube-api-access-s64t5\") pod \"must-gather-8w59b\" (UID: \"8de5f73c-5209-433d-9db8-869cdf54d809\") " pod="openshift-must-gather-6xq7b/must-gather-8w59b"
Jul 20 17:00:13.597640 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.597527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8de5f73c-5209-433d-9db8-869cdf54d809-must-gather-output\") pod \"must-gather-8w59b\" (UID: \"8de5f73c-5209-433d-9db8-869cdf54d809\") " pod="openshift-must-gather-6xq7b/must-gather-8w59b"
Jul 20 17:00:13.698189 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.698160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64t5\" (UniqueName: \"kubernetes.io/projected/8de5f73c-5209-433d-9db8-869cdf54d809-kube-api-access-s64t5\") pod \"must-gather-8w59b\" (UID: \"8de5f73c-5209-433d-9db8-869cdf54d809\") " pod="openshift-must-gather-6xq7b/must-gather-8w59b"
Jul 20 17:00:13.698336 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.698216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8de5f73c-5209-433d-9db8-869cdf54d809-must-gather-output\") pod \"must-gather-8w59b\" (UID: \"8de5f73c-5209-433d-9db8-869cdf54d809\") " pod="openshift-must-gather-6xq7b/must-gather-8w59b"
Jul 20 17:00:13.698548 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.698528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8de5f73c-5209-433d-9db8-869cdf54d809-must-gather-output\") pod \"must-gather-8w59b\" (UID: \"8de5f73c-5209-433d-9db8-869cdf54d809\") " pod="openshift-must-gather-6xq7b/must-gather-8w59b"
Jul 20 17:00:13.719734 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.719706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64t5\" (UniqueName: \"kubernetes.io/projected/8de5f73c-5209-433d-9db8-869cdf54d809-kube-api-access-s64t5\") pod \"must-gather-8w59b\" (UID: \"8de5f73c-5209-433d-9db8-869cdf54d809\") " pod="openshift-must-gather-6xq7b/must-gather-8w59b"
Jul 20 17:00:13.805158 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.805120    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xq7b/must-gather-8w59b"
Jul 20 17:00:13.934905 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:13.934883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xq7b/must-gather-8w59b"]
Jul 20 17:00:13.937192 ip-10-0-135-221 kubenswrapper[2560]: W0720 17:00:13.937165    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8de5f73c_5209_433d_9db8_869cdf54d809.slice/crio-5a3cec98455bfebaf8c67dc2041fbd87d55f88a68d464359b8dcf6dc8aa2ddae WatchSource:0}: Error finding container 5a3cec98455bfebaf8c67dc2041fbd87d55f88a68d464359b8dcf6dc8aa2ddae: Status 404 returned error can't find the container with id 5a3cec98455bfebaf8c67dc2041fbd87d55f88a68d464359b8dcf6dc8aa2ddae
Jul 20 17:00:14.461002 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:14.460968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xq7b/must-gather-8w59b" event={"ID":"8de5f73c-5209-433d-9db8-869cdf54d809","Type":"ContainerStarted","Data":"5a3cec98455bfebaf8c67dc2041fbd87d55f88a68d464359b8dcf6dc8aa2ddae"}
Jul 20 17:00:15.470143 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:15.470085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xq7b/must-gather-8w59b" event={"ID":"8de5f73c-5209-433d-9db8-869cdf54d809","Type":"ContainerStarted","Data":"05323e943a319b0f77670bb9fd0cbad540006e59acb821bb7b9fac5db754e45e"}
Jul 20 17:00:15.470664 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:15.470156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xq7b/must-gather-8w59b" event={"ID":"8de5f73c-5209-433d-9db8-869cdf54d809","Type":"ContainerStarted","Data":"4da9c3fca4f813075d4981bdfcb3bb54d9a9b42b3bcdac61dc0833b9e17d9488"}
Jul 20 17:00:15.488197 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:15.488107    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6xq7b/must-gather-8w59b" podStartSLOduration=1.610056828 podStartE2EDuration="2.488086529s" totalImagesPullingTime="878.029701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:00:15.484706022 +0000 UTC m=+2771.846406599" watchObservedRunningTime="2026-07-20 17:00:15.488086529 +0000 UTC m=+2771.849787093"
Jul 20 17:00:16.370748 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:16.370722    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bt6fv_64760793-780a-46dd-83ac-76ca56fe3bfa/global-pull-secret-syncer/0.log"
Jul 20 17:00:16.546468 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:16.546435    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n6642_920b13dc-1b99-43d9-88ea-04439a42386e/konnectivity-agent/0.log"
Jul 20 17:00:16.625282 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:16.625203    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-221.ec2.internal_0bc8024318ae1efb05d8dcf7cc6a8e0e/haproxy/0.log"
Jul 20 17:00:20.957768 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:20.957700    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5_94fb34cd-7926-46ff-9c62-c86d9dd3a775/extract/0.log"
Jul 20 17:00:20.985867 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:20.985839    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5_94fb34cd-7926-46ff-9c62-c86d9dd3a775/util/0.log"
Jul 20 17:00:21.012654 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.012631    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d6kh5_94fb34cd-7926-46ff-9c62-c86d9dd3a775/pull/0.log"
Jul 20 17:00:21.042788 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.042752    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd_21fdd515-674a-465c-baac-dabbde144bcb/extract/0.log"
Jul 20 17:00:21.071062 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.071033    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd_21fdd515-674a-465c-baac-dabbde144bcb/util/0.log"
Jul 20 17:00:21.091187 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.091091    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgxkd_21fdd515-674a-465c-baac-dabbde144bcb/pull/0.log"
Jul 20 17:00:21.125411 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.125385    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2_36b97d55-8e41-43e9-8204-c4baca9d3e98/extract/0.log"
Jul 20 17:00:21.151698 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.151613    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2_36b97d55-8e41-43e9-8204-c4baca9d3e98/util/0.log"
Jul 20 17:00:21.177943 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.177914    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zjwg2_36b97d55-8e41-43e9-8204-c4baca9d3e98/pull/0.log"
Jul 20 17:00:21.222418 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.222340    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv_e4c58a20-5650-4300-8b23-737afb523913/extract/0.log"
Jul 20 17:00:21.245904 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.245879    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv_e4c58a20-5650-4300-8b23-737afb523913/util/0.log"
Jul 20 17:00:21.273934 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.273890    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15z9vv_e4c58a20-5650-4300-8b23-737afb523913/pull/0.log"
Jul 20 17:00:21.928241 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:21.928212    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-sdwj2_b17735e3-b255-48b0-bc35-bbbf44c74d2c/limitador/0.log"
Jul 20 17:00:24.044405 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.044325    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2zph2_6eb85424-778d-4bb2-b1f7-a3ca634791e5/kube-state-metrics/0.log"
Jul 20 17:00:24.070205 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.070183    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2zph2_6eb85424-778d-4bb2-b1f7-a3ca634791e5/kube-rbac-proxy-main/0.log"
Jul 20 17:00:24.092185 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.092118    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2zph2_6eb85424-778d-4bb2-b1f7-a3ca634791e5/kube-rbac-proxy-self/0.log"
Jul 20 17:00:24.124789 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.124731    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67fdd5d8d5-wrj7v_f3254732-c7c8-4e3d-896b-59d8fc14cb2c/metrics-server/0.log"
Jul 20 17:00:24.152350 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.152319    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-5gpvj_f32ada3e-3a44-4a27-8086-52691a66f497/monitoring-plugin/0.log"
Jul 20 17:00:24.348778 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.348706    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptdbn_9867a617-889d-4616-936c-68635a1d91e3/node-exporter/0.log"
Jul 20 17:00:24.372099 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.372077    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptdbn_9867a617-889d-4616-936c-68635a1d91e3/kube-rbac-proxy/0.log"
Jul 20 17:00:24.398940 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.398914    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptdbn_9867a617-889d-4616-936c-68635a1d91e3/init-textfile/0.log"
Jul 20 17:00:24.750180 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.750076    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-hc6kn_2536c51c-bc5c-403d-8a50-5c69ff7723fc/prometheus-operator/0.log"
Jul 20 17:00:24.787580 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.787553    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-hc6kn_2536c51c-bc5c-403d-8a50-5c69ff7723fc/kube-rbac-proxy/0.log"
Jul 20 17:00:24.840116 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.840072    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8775b8679-c9ptp_1f6cd08d-b6f3-4b77-ac87-15f8ed907785/telemeter-client/0.log"
Jul 20 17:00:24.874821 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.874790    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8775b8679-c9ptp_1f6cd08d-b6f3-4b77-ac87-15f8ed907785/reload/0.log"
Jul 20 17:00:24.899093 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:24.899060    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8775b8679-c9ptp_1f6cd08d-b6f3-4b77-ac87-15f8ed907785/kube-rbac-proxy/0.log"
Jul 20 17:00:26.307414 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.307332    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"]
Jul 20 17:00:26.315102 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.315069    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.322014 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.321981    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"]
Jul 20 17:00:26.425564 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.425519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-podres\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.425760 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.425578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-proc\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.425760 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.425617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpm8s\" (UniqueName: \"kubernetes.io/projected/628c7c30-79cf-4a1f-928f-3b5944c919e8-kube-api-access-dpm8s\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.425760 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.425699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-sys\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.425760 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.425752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-lib-modules\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.526615 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.526582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-podres\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.526615 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.526619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-proc\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.526828 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.526643    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpm8s\" (UniqueName: \"kubernetes.io/projected/628c7c30-79cf-4a1f-928f-3b5944c919e8-kube-api-access-dpm8s\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.526828 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.526712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-sys\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.526828 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.526717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-proc\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.526828 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.526755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-podres\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.526828 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.526774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-sys\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.526828 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.526779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-lib-modules\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.527036 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.526896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/628c7c30-79cf-4a1f-928f-3b5944c919e8-lib-modules\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.535704 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.535669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpm8s\" (UniqueName: \"kubernetes.io/projected/628c7c30-79cf-4a1f-928f-3b5944c919e8-kube-api-access-dpm8s\") pod \"perf-node-gather-daemonset-xrhdl\" (UID: \"628c7c30-79cf-4a1f-928f-3b5944c919e8\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.629093 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.629002    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:26.819176 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:26.819121    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"]
Jul 20 17:00:26.820179 ip-10-0-135-221 kubenswrapper[2560]: W0720 17:00:26.820147    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod628c7c30_79cf_4a1f_928f_3b5944c919e8.slice/crio-34dc053ae1154fe52087ad7cf599b2196ec49fbfbebe9e584e648f2a557f2708 WatchSource:0}: Error finding container 34dc053ae1154fe52087ad7cf599b2196ec49fbfbebe9e584e648f2a557f2708: Status 404 returned error can't find the container with id 34dc053ae1154fe52087ad7cf599b2196ec49fbfbebe9e584e648f2a557f2708
Jul 20 17:00:27.374393 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:27.374365    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-njlxk_d7f9d3d5-5936-468d-ae8d-3b1c751f7e15/download-server/0.log"
Jul 20 17:00:27.559973 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:27.559935    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl" event={"ID":"628c7c30-79cf-4a1f-928f-3b5944c919e8","Type":"ContainerStarted","Data":"8c55c1cb1d189da2bbf7fbd2d819240efaef46e2f765fee35fcbac5ecbd48770"}
Jul 20 17:00:27.560197 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:27.559998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl" event={"ID":"628c7c30-79cf-4a1f-928f-3b5944c919e8","Type":"ContainerStarted","Data":"34dc053ae1154fe52087ad7cf599b2196ec49fbfbebe9e584e648f2a557f2708"}
Jul 20 17:00:27.560197 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:27.560067    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:27.579318 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:27.579265    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl" podStartSLOduration=1.579246006 podStartE2EDuration="1.579246006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:00:27.576960916 +0000 UTC m=+2783.938661481" watchObservedRunningTime="2026-07-20 17:00:27.579246006 +0000 UTC m=+2783.940946569"
Jul 20 17:00:29.055090 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:29.055050    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hhmn_2d5eec58-f764-477e-b445-3b8e0693cae6/dns/0.log"
Jul 20 17:00:29.077115 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:29.077092    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hhmn_2d5eec58-f764-477e-b445-3b8e0693cae6/kube-rbac-proxy/0.log"
Jul 20 17:00:29.252104 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:29.252066    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kdfth_4066ff24-14d6-48f0-9ad7-475139d26a2b/dns-node-resolver/0.log"
Jul 20 17:00:29.851501 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:29.851473    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6967845579-2twff_af44366f-43a8-4878-9e0f-533fc77bbfc0/registry/0.log"
Jul 20 17:00:29.932812 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:29.932782    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wnlrc_afacfe63-56db-459b-8afd-b319a4718193/node-ca/0.log"
Jul 20 17:00:31.101043 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:31.101008    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-x5hpt_f4be2a34-6dcf-4e89-ae7c-549d08cae6e7/discovery/0.log"
Jul 20 17:00:32.011163 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:32.011122    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwbb7_618e95bc-7a2b-44ee-9bd1-be8d45503d90/serve-healthcheck-canary/0.log"
Jul 20 17:00:32.771512 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:32.771483    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kvcwr_62da6629-81ac-4d72-a682-e07236578bcb/kube-rbac-proxy/0.log"
Jul 20 17:00:32.793923 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:32.793879    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kvcwr_62da6629-81ac-4d72-a682-e07236578bcb/exporter/0.log"
Jul 20 17:00:32.817677 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:32.817641    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kvcwr_62da6629-81ac-4d72-a682-e07236578bcb/extractor/0.log"
Jul 20 17:00:33.578896 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:33.578870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-xrhdl"
Jul 20 17:00:35.438626 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:35.438593    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bbb748554-4ph5k_fa2ad733-3093-4e94-b6c7-4743804b7ab7/manager/0.log"
Jul 20 17:00:35.461430 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:35.461349    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bbb748554-4ph5k_fa2ad733-3093-4e94-b6c7-4743804b7ab7/copy-manifests/0.log"
Jul 20 17:00:36.851865 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:36.851830    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-x5hpt_f4be2a34-6dcf-4e89-ae7c-549d08cae6e7/discovery/0.log"
Jul 20 17:00:36.984862 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:36.984820    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7797c4479d-xg69d_ac120eb3-d205-4bff-8366-72e06a0dbdf9/manager/0.log"
Jul 20 17:00:37.018622 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:37.018590    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-njn6r_3a0d8f26-03d4-4581-ab29-6c352faf0518/openshift-lws-operator/0.log"
Jul 20 17:00:38.539427 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:38.539391    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-x5hpt_f4be2a34-6dcf-4e89-ae7c-549d08cae6e7/discovery/0.log"
Jul 20 17:00:43.408095 ip-10-0-135-221 kubenswrapper[2560]: I0720 17:00:43.408062    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4kb4h_ad2c1187-2e62-4948-b833-1928f46e625d/kube-multus/0.log"