Jul 20 21:00:25.363022 ip-10-0-136-242 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 21:00:25.363038 ip-10-0-136-242 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 21:00:25.363048 ip-10-0-136-242 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 21:00:25.363465 ip-10-0-136-242 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 21:00:35.530195 ip-10-0-136-242 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 21:00:35.530218 ip-10-0-136-242 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 37502d197b764477b3aabf9aa3f93c58 --
Jul 20 21:02:20.128345 ip-10-0-136-242 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.539509    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545488    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545499    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545503    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545506    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545509    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545514    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545517    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 21:02:20.572298 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545519    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545522    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545525    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545527    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545530    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545533    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545539    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545542    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545544    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545547    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545551    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545555    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545559    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545564    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545567    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545570    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545573    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545576    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545579    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 21:02:20.873003 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545582    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 21:02:20.616930 ip-10-0-136-242 systemd[1]: Started Kubernetes Kubelet.
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545585    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545587    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545590    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545594    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545596    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545599    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545602    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545604    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545607    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545617    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545621    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545624    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545627    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545630    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545632    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545635    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545638    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545640    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 21:02:20.882571 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545643    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545646    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545649    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545651    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545654    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545657    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545659    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545662    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545665    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545668    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545670    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545673    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545675    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545679    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545682    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545685    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545688    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545690    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545693    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 21:02:20.883369 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545696    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545698    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545701    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545704    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545707    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545710    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545712    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545715    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545717    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545720    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545722    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545727    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545729    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545732    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545735    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545737    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545740    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545742    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545745    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545747    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 21:02:20.884438 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545752    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545754    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545757    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545760    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545762    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545765    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545767    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545770    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545773    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545775    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545777    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545780    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545783    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545786    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.545788    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546484    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546490    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546492    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546495    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546498    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 21:02:20.885058 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546501    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546503    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546506    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546508    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546511    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546513    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546516    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546519    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546522    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546525    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546527    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546530    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546534    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546537    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546541    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546545    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546548    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546550    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546553    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 21:02:20.885911 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546556    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546559    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546562    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546564    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546567    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546570    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546573    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546576    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546578    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546581    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546583    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546586    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546589    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546591    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546593    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546596    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546599    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546602    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546606    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 21:02:20.886598 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546608    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546611    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546621    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546624    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546626    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546629    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546633    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546636    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546639    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546641    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546644    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546646    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546649    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546651    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546654    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546656    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546660    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546664    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546667    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 21:02:20.887386 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546670    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546673    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546677    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546681    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546683    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546686    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546689    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546692    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546696    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546699    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546702    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546705    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546708    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546710    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546713    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546716    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546719    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546721    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546724    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546728    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 21:02:20.888016 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546733    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546735    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546738    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546740    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546743    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546746    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546748    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546750    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546753    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546755    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546758    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546760    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546763    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546765    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546768    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546770    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.546773    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547133    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547138    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547141    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 21:02:20.888829 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547143    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547146    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547149    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547151    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547154    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547157    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547159    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547162    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547165    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547168    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547171    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547175    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547179    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547182    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547184    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547187    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547189    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547192    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547195    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 21:02:20.889483 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547197    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547200    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547203    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547205    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547207    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547210    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547213    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547216    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547218    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547221    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547223    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547226    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547228    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547231    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547233    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547236    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547238    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547241    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547244    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547246    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 21:02:20.890100 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547249    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547251    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547254    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547257    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547261    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547264    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547267    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547271    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547274    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547276    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547279    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547281    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547284    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547286    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547289    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547291    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547294    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547296    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547299    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547301    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 21:02:20.890727 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547304    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547306    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547309    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547311    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547314    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547316    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547319    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547321    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547325    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547328    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547331    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547334    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547336    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547339    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547341    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547344    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547349    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547352    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547355    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 21:02:20.891371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547358    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547360    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547363    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547365    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547368    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547370    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547374    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547376    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547380    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547384    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547387    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547389    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547392    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547395    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547398    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547402    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547405    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.547408    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547478    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547485    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 21:02:20.891994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547490    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547495    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547499    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547502    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547506    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547510    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547513    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547516    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547520    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547525    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547529    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547532    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547535    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547538    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547541    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547545    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547549    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547552    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547555    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547558    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547561    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547565    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547568    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 21:02:20.892588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547571    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547574    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547577    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547580    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547583    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547586    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547589    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547593    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547596    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547598    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547601    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547604    2573 flags.go:64] FLAG: --enable-server="true"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547607    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547611    2573 flags.go:64] FLAG: --event-burst="100"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547614    2573 flags.go:64] FLAG: --event-qps="50"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547617    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547630    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547634    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547639    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547643    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547647    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547650    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547652    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547655    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547658    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 21:02:20.893200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547662    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547665    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547667    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547670    2573 flags.go:64] FLAG: --feature-gates=""
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547674    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547676    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547679    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547682    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547685    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547688    2573 flags.go:64] FLAG: --help="false"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547691    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-136-242.ec2.internal"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547694    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547697    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547700    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547703    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547706    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547709    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547712    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547714    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547717    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547720    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547723    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547725    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547728    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 21:02:20.893952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547731    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547736    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547740    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547743    2573 flags.go:64] FLAG: --lock-file=""
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547746    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547753    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547756    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547761    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547764    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547767    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547770    2573 flags.go:64] FLAG: --logging-format="text"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547772    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547776    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547779    2573 flags.go:64] FLAG: --manifest-url=""
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547781    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547786    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547789    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547793    2573 flags.go:64] FLAG: --max-pods="110"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547796    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547799    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547802    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547805    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547808    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547811    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547813    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 21:02:20.894605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547820    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547823    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547826    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547829    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547831    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547837    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547839    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547842    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547845    2573 flags.go:64] FLAG: --port="10250"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547852    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547855    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04611a633cec18c77"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547858    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547861    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547864    2573 flags.go:64] FLAG: --register-node="true"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547867    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547871    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547873    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547876    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547879    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547882    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547885    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547888    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547891    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547894    2573 flags.go:64] FLAG: --runonce="false"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547897    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 21:02:20.895362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547900    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547902    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547905    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547908    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547911    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547914    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547917    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547920    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547923    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547925    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547928    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547931    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547934    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547936    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547942    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547945    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547952    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547956    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547959    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547962    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547965    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547968    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547971    2573 flags.go:64] FLAG: --v="2"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547974    2573 flags.go:64] FLAG: --version="false"
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547978    2573 flags.go:64] FLAG: --vmodule=""
Jul 20 21:02:20.896320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547982    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.547985    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548128    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548132    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548135    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548140    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548143    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548147    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548149    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548152    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548155    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548157    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548160    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548163    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548165    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548168    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548170    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548173    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548175    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 21:02:20.897020 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548178    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548180    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548183    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548186    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548190    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548193    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548196    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548198    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548202    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548204    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548207    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548210    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548212    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548214    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548217    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548219    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548222    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548224    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548227    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548230    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 21:02:20.971863 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548232    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548234    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548237    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548240    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548242    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548245    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548247    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548250    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548252    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548255    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548257    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548260    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548263    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548266    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548269    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548273    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548277    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548280    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548283    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548285    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 21:02:20.972703 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548288    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548292    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548295    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548297    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548300    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548302    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548305    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548308    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548310    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548313    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548315    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548318    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548320    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548323    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548325    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548328    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548330    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548333    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548335    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548338    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 21:02:20.973326 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548340    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548343    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548345    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548348    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548350    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548353    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548355    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548358    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548363    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548365    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548368    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548370    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548373    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548375    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548378    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548381    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548385    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548388    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548391    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548394    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 21:02:20.973952 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548397    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.548400    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.548405    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.561657    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.561673    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.562540    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.562548    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562603    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562608    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562611    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562613    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562616    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562619    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562622    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 21:02:20.974586 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562624    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562627    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562630    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562633    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562635    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562638    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562641    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562644    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562647    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562649    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562652    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562655    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562657    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562660    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562662    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562666    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562670    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562673    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562676    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562678    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 21:02:20.975018 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562682    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562686    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562689    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562692    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562695    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562697    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562700    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562702    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562705    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562708    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562710    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562713    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562716    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562719    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562721    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562724    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562727    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562731    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562734    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 21:02:20.975657 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562737    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562740    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562743    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562745    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562748    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562750    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562753    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562756    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562758    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562761    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562763    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562766    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562768    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562771    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562774    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562777    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562779    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562782    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562784    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562787    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 21:02:20.976289 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562789    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562792    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562794    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562797    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562800    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562802    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562805    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562807    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562810    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562812    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562817    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562820    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562822    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562826    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562828    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562831    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562834    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562837    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562839    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562842    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 21:02:20.976922 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562846    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562850    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562853    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562857    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562860    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562863    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562866    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562869    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562871    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562874    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562877    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562880    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562882    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.562887    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 21:02:20.977560 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.562997    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563003    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563007    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563010    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563013    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563016    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563018    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563022    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563025    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563030    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563033    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563035    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563039    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563042    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563044    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563047    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563050    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563052    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563055    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563058    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563060    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 21:02:20.977985 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563062    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563065    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563068    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563086    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563091    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563095    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563099    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563104    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563125    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563132    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563135    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563138    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563141    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563143    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563146    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563149    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563152    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563154    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563157    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563160    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 21:02:20.978622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563162    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563165    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563167    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563170    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563174    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563177    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563179    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563182    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563186    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563190    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563193    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563196    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563199    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563204    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563207    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563210    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563213    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563216    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563218    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563221    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 21:02:20.979261 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563224    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563226    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563229    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563233    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563237    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563240    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563243    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563246    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563248    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563251    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563254    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563256    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563259    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563261    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563264    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563266    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563269    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563273    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563275    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 21:02:20.979872 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563278    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563280    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563284    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563287    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563289    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563292    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563296    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563298    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563301    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563304    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563307    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563309    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563312    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563314    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563317    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563319    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563322    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563325    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 21:02:20.980391 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:20.563327    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.563332    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.563467    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.566367    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.567665    2573 server.go:1019] "Starting client certificate rotation"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.567763    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.567794    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.570406    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.571924    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.582116    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.584628    2573 log.go:25] "Validated CRI v1 image API"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.586339    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 21:02:20.980898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.588995    2573 fs.go:135] Filesystem UUIDs: map[367b6f1f-a080-4591-94e7-89cb578dd2ce:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bf9146f4-5665-4eea-8055-a52fb2d0d869:/dev/nvme0n1p3]
Jul 20 21:02:20.981258 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.589016    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 21:02:20.981395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.593807    2573 manager.go:216] Machine: {Timestamp:2026-07-20 21:02:20.593330688 +0000 UTC m=+0.346053401 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091554 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28106f6492a4372d74bc0d4194f685 SystemUUID:ec28106f-6492-a437-2d74-bc0d4194f685 BootID:37502d19-7b76-4477-b3aa-bf9aa3f93c58 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:55:de:4e:12:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:55:de:4e:12:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:4b:ff:60:9a:40 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 21:02:20.981395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.593902    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 21:02:20.981395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.593968    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 21:02:20.981395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.596315    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 21:02:20.981395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.596334    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 21:02:20.981395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.596984    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 21:02:20.981395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.596994    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 21:02:20.981395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.597005    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.597919    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.599488    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.599842    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.605440    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.605562    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.605594    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.605612    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.605624    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.605633    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.605642    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.605991    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.606006    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.608101    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.610056    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.610098    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611244    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611266    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611273    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611278    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611287    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611293    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611300    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611305    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611312    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611321    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611333    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.611339    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.613124    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.613134    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.616207    2573 server.go:1268] "Started kubelet"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.616293    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.616363    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.616856    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.618558    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.619627    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.620144    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.620044    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-242.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.620284    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 21:02:20.981679 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.622517    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.624963    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.624974    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.625034    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.625534    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.625549    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.625550    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.625629    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.625639    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.624681    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-242.ec2.internal.18c41b463037bbba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-242.ec2.internal,UID:ip-10-0-136-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-242.ec2.internal,},FirstTimestamp:2026-07-20 21:02:20.616178618 +0000 UTC m=+0.368901332,LastTimestamp:2026-07-20 21:02:20.616178618 +0000 UTC m=+0.368901332,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-242.ec2.internal,}"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.625870    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.625880    2573 factory.go:55] Registering systemd factory
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.625889    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.626110    2573 factory.go:153] Registering CRI-O factory
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.626128    2573 factory.go:223] Registration of the crio container factory successfully
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.626167    2573 factory.go:103] Registering Raw factory
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.626187    2573 manager.go:1196] Started watching for new ooms in manager
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.626517    2573 manager.go:349] Starting recovery of all containers
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.631573    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.631684    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.638887    2573 manager.go:354] Recovery completed
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.642579    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.644355    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.644382    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.644392    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.644953    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.644969    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.644987    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.644970    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.646196    2573 policy_none.go:49] "None policy: Start"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.646370    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.646384    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 21:02:20.982710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.646614    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.646870    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-242.ec2.internal.18c41b4631e5e372  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-242.ec2.internal,UID:ip-10-0-136-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-242.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-242.ec2.internal,},FirstTimestamp:2026-07-20 21:02:20.644369266 +0000 UTC m=+0.397091980,LastTimestamp:2026-07-20 21:02:20.644369266 +0000 UTC m=+0.397091980,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-242.ec2.internal,}"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.647049    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.647064    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.647784    2573 policy_none.go:47] "Start"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.654461    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hnkkh"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.657888    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-242.ec2.internal.18c41b4631e6293b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-242.ec2.internal,UID:ip-10-0-136-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-242.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-242.ec2.internal,},FirstTimestamp:2026-07-20 21:02:20.644387131 +0000 UTC m=+0.397109846,LastTimestamp:2026-07-20 21:02:20.644387131 +0000 UTC m=+0.397109846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-242.ec2.internal,}"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.662880    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hnkkh"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.668103    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-242.ec2.internal.18c41b4631e64dec  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-242.ec2.internal,UID:ip-10-0-136-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-242.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-242.ec2.internal,},FirstTimestamp:2026-07-20 21:02:20.644396524 +0000 UTC m=+0.397119239,LastTimestamp:2026-07-20 21:02:20.644396524 +0000 UTC m=+0.397119239,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-242.ec2.internal,}"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.722577    2573 manager.go:337] "Starting Device Plugin manager"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.722601    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.722609    2573 server.go:87] "Starting device plugin registration server"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.722813    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.722826    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.722931    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.723059    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.723069    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.723500    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.723553    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 20 21:02:20.983872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.761829    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.763216    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.763257    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.763277    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.763312    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.765644    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.823637    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.824476    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.824501    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.824511    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.824532    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-242.ec2.internal"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.831542    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-242.ec2.internal"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.831563    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-242.ec2.internal\": node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.857692    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.863765    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"]
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.863933    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.865187    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.865211    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.865221    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.868397    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.868495    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.868523    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.869389    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.869407    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.869426    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.870580    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.870603    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.870622    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.871004    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.871026    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.871888    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.871911    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.871925    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeHasSufficientPID"
Jul 20 21:02:20.984452 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.910790    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-242.ec2.internal\" not found" node="ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.915345    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-242.ec2.internal\" not found" node="ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.926993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ecdc9466b19439a9a3bd8f65ab19d6a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-242.ec2.internal\" (UID: \"2ecdc9466b19439a9a3bd8f65ab19d6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.927013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02dc06bbe211fea0e45d5ad3a8ef1fa8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"02dc06bbe211fea0e45d5ad3a8ef1fa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:20.927031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02dc06bbe211fea0e45d5ad3a8ef1fa8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"02dc06bbe211fea0e45d5ad3a8ef1fa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:20.958587    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.027400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02dc06bbe211fea0e45d5ad3a8ef1fa8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"02dc06bbe211fea0e45d5ad3a8ef1fa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.027424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02dc06bbe211fea0e45d5ad3a8ef1fa8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"02dc06bbe211fea0e45d5ad3a8ef1fa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.027442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ecdc9466b19439a9a3bd8f65ab19d6a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-242.ec2.internal\" (UID: \"2ecdc9466b19439a9a3bd8f65ab19d6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.027478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ecdc9466b19439a9a3bd8f65ab19d6a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-242.ec2.internal\" (UID: \"2ecdc9466b19439a9a3bd8f65ab19d6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.027502    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02dc06bbe211fea0e45d5ad3a8ef1fa8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"02dc06bbe211fea0e45d5ad3a8ef1fa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.027505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02dc06bbe211fea0e45d5ad3a8ef1fa8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal\" (UID: \"02dc06bbe211fea0e45d5ad3a8ef1fa8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.082525 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.059495    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 20 21:02:21.171221 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.160216    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 20 21:02:21.255373 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.214315    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.255373 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.218194    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.360857 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.260671    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 20 21:02:21.361173 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.361111    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-242.ec2.internal\" not found"
Jul 20 21:02:21.463778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.444864    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 21:02:21.570310 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.525649    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.570310 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.539806    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 21:02:21.570310 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.542198    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal"
Jul 20 21:02:21.570310 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.552270    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 21:02:21.570310 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.567308    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 21:02:21.570310 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.567426    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 21:02:21.570310 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.567464    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.605831    2573 apiserver.go:52] "Watching apiserver"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.605932    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.615152    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.615505    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-frz2v","openshift-multus/multus-additional-cni-plugins-vsb6d","openshift-multus/multus-hm9zz","kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal","openshift-multus/network-metrics-daemon-8l2tg","openshift-network-diagnostics/network-check-target-x87l8","openshift-network-operator/iptables-alerter-7c57j","openshift-ovn-kubernetes/ovnkube-node-zt8xd","kube-system/global-pull-secret-syncer-7s52p","kube-system/konnectivity-agent-fs9kl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v","openshift-cluster-node-tuning-operator/tuned-rd8x8","openshift-dns/node-resolver-zw96k"]
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.617102    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.617169    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.618991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.620253    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.623676    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.623906    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-55fdk\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.624054    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.624414    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.624637    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.624782    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.624955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2jzwn\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.625181    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.625361    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.625978    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.626693    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.626750    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.627058    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.628027    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.628279    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q44wf\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.628442    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.628490    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.628720    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.658324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.629340    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630037    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccbdeae7-d204-44c7-bd07-bf3c91742105-kubelet-config\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630313    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9sl8\" (UniqueName: \"kubernetes.io/projected/e9ec5099-bccf-40fd-bc3e-d4c386061cff-kube-api-access-q9sl8\") pod \"node-ca-frz2v\" (UID: \"e9ec5099-bccf-40fd-bc3e-d4c386061cff\") " pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630330    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mh44d\""
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630289    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630494    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73354489-004c-4429-9ba9-2cadd2eec8ff-tmp-dir\") pod \"node-resolver-zw96k\" (UID: \"73354489-004c-4429-9ba9-2cadd2eec8ff\") " pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630854    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-run-ovn-kubernetes\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ebfe27c-db36-403d-855a-e757efa8d930-env-overrides\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.630987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-cni-dir\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-os-release\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9ec5099-bccf-40fd-bc3e-d4c386061cff-serviceca\") pod \"node-ca-frz2v\" (UID: \"e9ec5099-bccf-40fd-bc3e-d4c386061cff\") " pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-systemd-units\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccbdeae7-d204-44c7-bd07-bf3c91742105-dbus\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:21.659708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631097    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l96bp\" (UniqueName: \"kubernetes.io/projected/100b8d7c-f6d3-4620-b24d-6ea809073333-kube-api-access-l96bp\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01-host-slash\") pod \"iptables-alerter-7c57j\" (UID: \"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01\") " pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73354489-004c-4429-9ba9-2cadd2eec8ff-hosts-file\") pod \"node-resolver-zw96k\" (UID: \"73354489-004c-4429-9ba9-2cadd2eec8ff\") " pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631202    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmrw8\" (UniqueName: \"kubernetes.io/projected/73354489-004c-4429-9ba9-2cadd2eec8ff-kube-api-access-mmrw8\") pod \"node-resolver-zw96k\" (UID: \"73354489-004c-4429-9ba9-2cadd2eec8ff\") " pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-host\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-socket-dir-parent\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-conf-dir\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01-iptables-alerter-script\") pod \"iptables-alerter-7c57j\" (UID: \"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01\") " pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631320    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-sysctl-d\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-lib-modules\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-tuned\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-var-lib-cni-bin\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631490    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.661108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-kubelet\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631537    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-kubernetes\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-sysctl-conf\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-var-lib-kubelet\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-etc-kubernetes\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrw72\" (UniqueName: \"kubernetes.io/projected/5782c222-9fed-498a-836d-de45e2e35c12-kube-api-access-jrw72\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-run-openvswitch\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vnt9\" (UniqueName: \"kubernetes.io/projected/7ebfe27c-db36-403d-855a-e757efa8d930-kube-api-access-8vnt9\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631683    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631858    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631682    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77hjk\" (UniqueName: \"kubernetes.io/projected/cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01-kube-api-access-77hjk\") pod \"iptables-alerter-7c57j\" (UID: \"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01\") " pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-var-lib-kubelet\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-run-multus-certs\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.631992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5782c222-9fed-498a-836d-de45e2e35c12-cni-binary-copy\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9ec5099-bccf-40fd-bc3e-d4c386061cff-host\") pod \"node-ca-frz2v\" (UID: \"e9ec5099-bccf-40fd-bc3e-d4c386061cff\") " pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.661776 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjt7m\" (UniqueName: \"kubernetes.io/projected/23c795c0-0e1a-4ff5-8fef-723de361d42f-kube-api-access-rjt7m\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-cni-bin\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-sys\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/335d465f-e796-4de5-a149-0a728bab41a6-agent-certs\") pod \"konnectivity-agent-fs9kl\" (UID: \"335d465f-e796-4de5-a149-0a728bab41a6\") " pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-run-k8s-cni-cncf-io\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5782c222-9fed-498a-836d-de45e2e35c12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632240    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632238    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-var-lib-openvswitch\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.632288    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef29cde3-febc-44f2-a4b7-0916de63c5c2-tmp\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5782c222-9fed-498a-836d-de45e2e35c12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-cni-netd\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ebfe27c-db36-403d-855a-e757efa8d930-ovnkube-script-lib\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632460    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 21:02:21.662456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632469    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/335d465f-e796-4de5-a149-0a728bab41a6-konnectivity-ca\") pod \"konnectivity-agent-fs9kl\" (UID: \"335d465f-e796-4de5-a149-0a728bab41a6\") " pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-cnibin\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-os-release\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632537    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ebfe27c-db36-403d-855a-e757efa8d930-ovn-node-metrics-cert\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-sysconfig\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-run\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-hostroot\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-daemon-config\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-slash\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-modprobe-d\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-systemd\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-var-lib-cni-multus\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632748    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632760    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-run-systemd\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.664529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.632790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-cnibin\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.644023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/100b8d7c-f6d3-4620-b24d-6ea809073333-cni-binary-copy\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.644198    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.644323    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wxbll\""
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.644745    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.644919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-system-cni-dir\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.644964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-log-socket\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.645189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.645227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ebfe27c-db36-403d-855a-e757efa8d930-ovnkube-config\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.645261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-run-netns\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.645580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-system-cni-dir\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.645644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-run-netns\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.645776    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-etc-openvswitch\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.645900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-run-ovn\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.646043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-node-log\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.646116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmc8p\" (UniqueName: \"kubernetes.io/projected/ef29cde3-febc-44f2-a4b7-0916de63c5c2-kube-api-access-vmc8p\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.665430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.646291    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z22ms\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.646438    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.646561    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.646718    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f45bk\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.646767    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.646859    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.646853    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.647102    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.647105    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.647868    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bcnwv\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.647932    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.648608    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.648725    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.648808    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wkfpt\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.649294    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.650041    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.654800    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 21:02:21.667537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.663699    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d588x"
Jul 20 21:02:21.670324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.669956    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 20:57:21 +0000 UTC" deadline="2027-12-20 23:13:37.394343839 +0000 UTC"
Jul 20 21:02:21.670324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.669989    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12434h11m15.724356761s"
Jul 20 21:02:21.674461 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.672343    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d588x"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.726011    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747133    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-cni-dir\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-os-release\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9ec5099-bccf-40fd-bc3e-d4c386061cff-serviceca\") pod \"node-ca-frz2v\" (UID: \"e9ec5099-bccf-40fd-bc3e-d4c386061cff\") " pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-systemd-units\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccbdeae7-d204-44c7-bd07-bf3c91742105-dbus\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l96bp\" (UniqueName: \"kubernetes.io/projected/100b8d7c-f6d3-4620-b24d-6ea809073333-kube-api-access-l96bp\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01-host-slash\") pod \"iptables-alerter-7c57j\" (UID: \"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01\") " pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73354489-004c-4429-9ba9-2cadd2eec8ff-hosts-file\") pod \"node-resolver-zw96k\" (UID: \"73354489-004c-4429-9ba9-2cadd2eec8ff\") " pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747303    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-systemd-units\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747336    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73354489-004c-4429-9ba9-2cadd2eec8ff-hosts-file\") pod \"node-resolver-zw96k\" (UID: \"73354489-004c-4429-9ba9-2cadd2eec8ff\") " pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01-host-slash\") pod \"iptables-alerter-7c57j\" (UID: \"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01\") " pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747393    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccbdeae7-d204-44c7-bd07-bf3c91742105-dbus\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-os-release\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747435    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-cni-dir\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.763689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmrw8\" (UniqueName: \"kubernetes.io/projected/73354489-004c-4429-9ba9-2cadd2eec8ff-kube-api-access-mmrw8\") pod \"node-resolver-zw96k\" (UID: \"73354489-004c-4429-9ba9-2cadd2eec8ff\") " pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-host\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-socket-dir-parent\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-conf-dir\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01-iptables-alerter-script\") pod \"iptables-alerter-7c57j\" (UID: \"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01\") " pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747595    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-socket-dir-parent\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747587    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-host\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-sysctl-d\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-lib-modules\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-tuned\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.747694    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747705    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-sysctl-d\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.747785    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:02:22.247756281 +0000 UTC m=+2.000478999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:21.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-lib-modules\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747695    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-socket-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-var-lib-cni-bin\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-kubelet\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-conf-dir\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.747978    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-var-lib-cni-bin\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.748100    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.748121    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-kubernetes\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.751543    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9ec5099-bccf-40fd-bc3e-d4c386061cff-serviceca\") pod \"node-ca-frz2v\" (UID: \"e9ec5099-bccf-40fd-bc3e-d4c386061cff\") " pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.766794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.765964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01-iptables-alerter-script\") pod \"iptables-alerter-7c57j\" (UID: \"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01\") " pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.767695 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.765793    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 21:02:21.767695 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-kubernetes\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.767695 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-sysctl-conf\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.767695 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-var-lib-kubelet\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-etc-kubernetes\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrw72\" (UniqueName: \"kubernetes.io/projected/5782c222-9fed-498a-836d-de45e2e35c12-kube-api-access-jrw72\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-run-openvswitch\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767794    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-sysctl-conf\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vnt9\" (UniqueName: \"kubernetes.io/projected/7ebfe27c-db36-403d-855a-e757efa8d930-kube-api-access-8vnt9\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767834    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-etc-kubernetes\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77hjk\" (UniqueName: \"kubernetes.io/projected/cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01-kube-api-access-77hjk\") pod \"iptables-alerter-7c57j\" (UID: \"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01\") " pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-var-lib-kubelet\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-run-multus-certs\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5782c222-9fed-498a-836d-de45e2e35c12-cni-binary-copy\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767970    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9ec5099-bccf-40fd-bc3e-d4c386061cff-host\") pod \"node-ca-frz2v\" (UID: \"e9ec5099-bccf-40fd-bc3e-d4c386061cff\") " pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjt7m\" (UniqueName: \"kubernetes.io/projected/23c795c0-0e1a-4ff5-8fef-723de361d42f-kube-api-access-rjt7m\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768014    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-cni-bin\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.768191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-sys\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/335d465f-e796-4de5-a149-0a728bab41a6-agent-certs\") pod \"konnectivity-agent-fs9kl\" (UID: \"335d465f-e796-4de5-a149-0a728bab41a6\") " pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768079    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-run-k8s-cni-cncf-io\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768099    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-run-multus-certs\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-kubelet\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5782c222-9fed-498a-836d-de45e2e35c12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-var-lib-openvswitch\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768161    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-var-lib-kubelet\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef29cde3-febc-44f2-a4b7-0916de63c5c2-tmp\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768227    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5782c222-9fed-498a-836d-de45e2e35c12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-registration-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-cni-netd\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ebfe27c-db36-403d-855a-e757efa8d930-ovnkube-script-lib\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768378    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-run-openvswitch\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.769297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/335d465f-e796-4de5-a149-0a728bab41a6-konnectivity-ca\") pod \"konnectivity-agent-fs9kl\" (UID: \"335d465f-e796-4de5-a149-0a728bab41a6\") " pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.767825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-var-lib-kubelet\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-cnibin\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768493    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-cni-bin\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-os-release\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-os-release\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ebfe27c-db36-403d-855a-e757efa8d930-ovn-node-metrics-cert\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-sysconfig\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-run\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-hostroot\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-daemon-config\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-slash\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-modprobe-d\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-systemd\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.770339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-device-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-var-lib-cni-multus\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-run-systemd\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-sys-fs\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.768663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-run-k8s-cni-cncf-io\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-cnibin\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-cnibin\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769100    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/100b8d7c-f6d3-4620-b24d-6ea809073333-cni-binary-copy\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769127    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ebfe27c-db36-403d-855a-e757efa8d930-ovnkube-script-lib\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-cnibin\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769223    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-modprobe-d\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.771306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-system-cni-dir\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-log-socket\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769403    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-cni-netd\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ebfe27c-db36-403d-855a-e757efa8d930-ovnkube-config\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-run-systemd\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjghz\" (UniqueName: \"kubernetes.io/projected/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-kube-api-access-sjghz\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769489    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-var-lib-cni-multus\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-run-netns\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769564    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-system-cni-dir\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-run-netns\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-etc-openvswitch\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769675    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-run-ovn\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.769766    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9ec5099-bccf-40fd-bc3e-d4c386061cff-host\") pod \"node-ca-frz2v\" (UID: \"e9ec5099-bccf-40fd-bc3e-d4c386061cff\") " pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-slash\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.774802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770114    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-run\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770142    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5782c222-9fed-498a-836d-de45e2e35c12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770210    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-sys\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-hostroot\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770276    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-system-cni-dir\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770322    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-systemd\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770363    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5782c222-9fed-498a-836d-de45e2e35c12-cni-binary-copy\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/100b8d7c-f6d3-4620-b24d-6ea809073333-multus-daemon-config\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5782c222-9fed-498a-836d-de45e2e35c12-system-cni-dir\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770860    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-run-ovn\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770866    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-run-netns\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/100b8d7c-f6d3-4620-b24d-6ea809073333-host-run-netns\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770909    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-sysconfig\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-etc-openvswitch\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.775971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.770991    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-var-lib-openvswitch\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771549    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/335d465f-e796-4de5-a149-0a728bab41a6-konnectivity-ca\") pod \"konnectivity-agent-fs9kl\" (UID: \"335d465f-e796-4de5-a149-0a728bab41a6\") " pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771566    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/100b8d7c-f6d3-4620-b24d-6ea809073333-cni-binary-copy\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771592    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-node-log\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-log-socket\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771610    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ebfe27c-db36-403d-855a-e757efa8d930-ovnkube-config\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771690    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-node-log\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771694    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmc8p\" (UniqueName: \"kubernetes.io/projected/ef29cde3-febc-44f2-a4b7-0916de63c5c2-kube-api-access-vmc8p\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccbdeae7-d204-44c7-bd07-bf3c91742105-kubelet-config\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771780    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9sl8\" (UniqueName: \"kubernetes.io/projected/e9ec5099-bccf-40fd-bc3e-d4c386061cff-kube-api-access-q9sl8\") pod \"node-ca-frz2v\" (UID: \"e9ec5099-bccf-40fd-bc3e-d4c386061cff\") " pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771788    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccbdeae7-d204-44c7-bd07-bf3c91742105-kubelet-config\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771830    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73354489-004c-4429-9ba9-2cadd2eec8ff-tmp-dir\") pod \"node-resolver-zw96k\" (UID: \"73354489-004c-4429-9ba9-2cadd2eec8ff\") " pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771966    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-run-ovn-kubernetes\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.771999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ebfe27c-db36-403d-855a-e757efa8d930-env-overrides\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.772009    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5782c222-9fed-498a-836d-de45e2e35c12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.777748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.772031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/335d465f-e796-4de5-a149-0a728bab41a6-agent-certs\") pod \"konnectivity-agent-fs9kl\" (UID: \"335d465f-e796-4de5-a149-0a728bab41a6\") " pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.772044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.772051    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebfe27c-db36-403d-855a-e757efa8d930-host-run-ovn-kubernetes\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.772176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef29cde3-febc-44f2-a4b7-0916de63c5c2-etc-tuned\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.772367    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.772426    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret podName:ccbdeae7-d204-44c7-bd07-bf3c91742105 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:22.27240845 +0000 UTC m=+2.025131160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret") pod "global-pull-secret-syncer-7s52p" (UID: "ccbdeae7-d204-44c7-bd07-bf3c91742105") : object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.772424    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ebfe27c-db36-403d-855a-e757efa8d930-env-overrides\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.772441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l96bp\" (UniqueName: \"kubernetes.io/projected/100b8d7c-f6d3-4620-b24d-6ea809073333-kube-api-access-l96bp\") pod \"multus-hm9zz\" (UID: \"100b8d7c-f6d3-4620-b24d-6ea809073333\") " pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.772445    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73354489-004c-4429-9ba9-2cadd2eec8ff-tmp-dir\") pod \"node-resolver-zw96k\" (UID: \"73354489-004c-4429-9ba9-2cadd2eec8ff\") " pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.773888    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef29cde3-febc-44f2-a4b7-0916de63c5c2-tmp\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.775668    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77hjk\" (UniqueName: \"kubernetes.io/projected/cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01-kube-api-access-77hjk\") pod \"iptables-alerter-7c57j\" (UID: \"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01\") " pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:21.778702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.778444    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjt7m\" (UniqueName: \"kubernetes.io/projected/23c795c0-0e1a-4ff5-8fef-723de361d42f-kube-api-access-rjt7m\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:21.867398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.786938    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmc8p\" (UniqueName: \"kubernetes.io/projected/ef29cde3-febc-44f2-a4b7-0916de63c5c2-kube-api-access-vmc8p\") pod \"tuned-rd8x8\" (UID: \"ef29cde3-febc-44f2-a4b7-0916de63c5c2\") " pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.867398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.811244    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vnt9\" (UniqueName: \"kubernetes.io/projected/7ebfe27c-db36-403d-855a-e757efa8d930-kube-api-access-8vnt9\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.867398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.812562    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ebfe27c-db36-403d-855a-e757efa8d930-ovn-node-metrics-cert\") pod \"ovnkube-node-zt8xd\" (UID: \"7ebfe27c-db36-403d-855a-e757efa8d930\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.867398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.813184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9sl8\" (UniqueName: \"kubernetes.io/projected/e9ec5099-bccf-40fd-bc3e-d4c386061cff-kube-api-access-q9sl8\") pod \"node-ca-frz2v\" (UID: \"e9ec5099-bccf-40fd-bc3e-d4c386061cff\") " pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.867398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.815443    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmrw8\" (UniqueName: \"kubernetes.io/projected/73354489-004c-4429-9ba9-2cadd2eec8ff-kube-api-access-mmrw8\") pod \"node-resolver-zw96k\" (UID: \"73354489-004c-4429-9ba9-2cadd2eec8ff\") " pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:21.867398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.815967    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrw72\" (UniqueName: \"kubernetes.io/projected/5782c222-9fed-498a-836d-de45e2e35c12-kube-api-access-jrw72\") pod \"multus-additional-cni-plugins-vsb6d\" (UID: \"5782c222-9fed-498a-836d-de45e2e35c12\") " pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.867398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.829456    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:21.867398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.849781    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rd8x8"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-sys-fs\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjghz\" (UniqueName: \"kubernetes.io/projected/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-kube-api-access-sjghz\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872567    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-sys-fs\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872584    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-socket-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-registration-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872692    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-socket-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-device-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872749    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-registration-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872796    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872839    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-device-dir\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.984098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.872881    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.879370    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.879387    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.879398    2573 projected.go:196] Error preparing data for projected volume kube-api-access-mrqhb for pod openshift-network-diagnostics/network-check-target-x87l8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:21.879462    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb podName:04af2ea7-3401-4b85-9108-19c5b9049de4 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:22.379447492 +0000 UTC m=+2.132170216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mrqhb" (UniqueName: "kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb") pod "network-check-target-x87l8" (UID: "04af2ea7-3401-4b85-9108-19c5b9049de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.882334    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjghz\" (UniqueName: \"kubernetes.io/projected/d654e5f2-9cf4-46d7-99ac-d619ebb5c32c-kube-api-access-sjghz\") pod \"aws-ebs-csi-driver-node-9bc5v\" (UID: \"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.887012    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vsb6d"
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:21.892292    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecdc9466b19439a9a3bd8f65ab19d6a.slice/crio-be6595710a9021360b6d41919f04bcd7c63717ca4dbdb1634b14de84a20ae97f WatchSource:0}: Error finding container be6595710a9021360b6d41919f04bcd7c63717ca4dbdb1634b14de84a20ae97f: Status 404 returned error can't find the container with id be6595710a9021360b6d41919f04bcd7c63717ca4dbdb1634b14de84a20ae97f
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.895813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-frz2v"
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:21.896772    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02dc06bbe211fea0e45d5ad3a8ef1fa8.slice/crio-983b4c61f5c4ac631d47919fe8ec775444a760df04d3b35d2e9eccb20b2d6879 WatchSource:0}: Error finding container 983b4c61f5c4ac631d47919fe8ec775444a760df04d3b35d2e9eccb20b2d6879: Status 404 returned error can't find the container with id 983b4c61f5c4ac631d47919fe8ec775444a760df04d3b35d2e9eccb20b2d6879
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:21.900258    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5782c222_9fed_498a_836d_de45e2e35c12.slice/crio-f2dc1da8ce7b4e6297a0de29d4e9f1178760c534bf4dcde20c8659197c3b59ec WatchSource:0}: Error finding container f2dc1da8ce7b4e6297a0de29d4e9f1178760c534bf4dcde20c8659197c3b59ec: Status 404 returned error can't find the container with id f2dc1da8ce7b4e6297a0de29d4e9f1178760c534bf4dcde20c8659197c3b59ec
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.901851    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v"
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:21.905387    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ec5099_bccf_40fd_bc3e_d4c386061cff.slice/crio-c7adef02e011bd2806a2c248c2c4da6247d108b483a11952125ffc1193a430d4 WatchSource:0}: Error finding container c7adef02e011bd2806a2c248c2c4da6247d108b483a11952125ffc1193a430d4: Status 404 returned error can't find the container with id c7adef02e011bd2806a2c248c2c4da6247d108b483a11952125ffc1193a430d4
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.909536    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 21:02:21.986111 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:21.911546    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd654e5f2_9cf4_46d7_99ac_d619ebb5c32c.slice/crio-cbd4ddf4fddb1b80eb36987a97c328e0188d5b02fd3d923367e9f37a1c498aa0 WatchSource:0}: Error finding container cbd4ddf4fddb1b80eb36987a97c328e0188d5b02fd3d923367e9f37a1c498aa0: Status 404 returned error can't find the container with id cbd4ddf4fddb1b80eb36987a97c328e0188d5b02fd3d923367e9f37a1c498aa0
Jul 20 21:02:21.993068 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:21.992568    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:22.114680 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.014855    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hm9zz"
Jul 20 21:02:22.114680 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:22.022041    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100b8d7c_f6d3_4620_b24d_6ea809073333.slice/crio-0cfa1f28b95f048231db2caad3a87037308053a9f24e4acfa5ccf5f746e02310 WatchSource:0}: Error finding container 0cfa1f28b95f048231db2caad3a87037308053a9f24e4acfa5ccf5f746e02310: Status 404 returned error can't find the container with id 0cfa1f28b95f048231db2caad3a87037308053a9f24e4acfa5ccf5f746e02310
Jul 20 21:02:22.114680 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.023569    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zw96k"
Jul 20 21:02:22.114680 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:22.031395    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73354489_004c_4429_9ba9_2cadd2eec8ff.slice/crio-7dd6deb7b56540937168da5cf3b9d8bf613feb10a681f00184b2b486525e308b WatchSource:0}: Error finding container 7dd6deb7b56540937168da5cf3b9d8bf613feb10a681f00184b2b486525e308b: Status 404 returned error can't find the container with id 7dd6deb7b56540937168da5cf3b9d8bf613feb10a681f00184b2b486525e308b
Jul 20 21:02:22.114680 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.044264    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7c57j"
Jul 20 21:02:22.114680 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:22.051087    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc7cf7a_3a3c_4c3a_b098_e46322aa9a01.slice/crio-2e1dfb1d3ea6b1c125defdb45a8f8b0842e7ca9f3116117a8646a8947faaa2db WatchSource:0}: Error finding container 2e1dfb1d3ea6b1c125defdb45a8f8b0842e7ca9f3116117a8646a8947faaa2db: Status 404 returned error can't find the container with id 2e1dfb1d3ea6b1c125defdb45a8f8b0842e7ca9f3116117a8646a8947faaa2db
Jul 20 21:02:22.376159 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.280091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:22.376159 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.280149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:22.376159 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:22.280229    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:22.376159 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:22.280250    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:22.376159 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:22.280288    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret podName:ccbdeae7-d204-44c7-bd07-bf3c91742105 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:23.280268572 +0000 UTC m=+3.032991274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret") pod "global-pull-secret-syncer-7s52p" (UID: "ccbdeae7-d204-44c7-bd07-bf3c91742105") : object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:22.376159 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:22.280307    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:02:23.280297802 +0000 UTC m=+3.033020509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:22.503376 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.380844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:22.503376 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:22.380961    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 21:02:22.503376 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:22.380979    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 21:02:22.503376 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:22.380988    2573 projected.go:196] Error preparing data for projected volume kube-api-access-mrqhb for pod openshift-network-diagnostics/network-check-target-x87l8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:22.503376 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:22.381041    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb podName:04af2ea7-3401-4b85-9108-19c5b9049de4 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:23.381022099 +0000 UTC m=+3.133744801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mrqhb" (UniqueName: "kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb") pod "network-check-target-x87l8" (UID: "04af2ea7-3401-4b85-9108-19c5b9049de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:22.631619 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.631564    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 21:02:22.657435 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:22.657375    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebfe27c_db36_403d_855a_e757efa8d930.slice/crio-409c77c21f4c632e0748eee9bf09ad5cd072a3dc726eb49ee0db75bf62da592a WatchSource:0}: Error finding container 409c77c21f4c632e0748eee9bf09ad5cd072a3dc726eb49ee0db75bf62da592a: Status 404 returned error can't find the container with id 409c77c21f4c632e0748eee9bf09ad5cd072a3dc726eb49ee0db75bf62da592a
Jul 20 21:02:22.678352 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.678240    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 20:57:22 +0000 UTC" deadline="2028-01-29 06:12:03.27147379 +0000 UTC"
Jul 20 21:02:22.678352 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.678297    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13377h9m40.593182263s"
Jul 20 21:02:22.778709 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.778649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-frz2v" event={"ID":"e9ec5099-bccf-40fd-bc3e-d4c386061cff","Type":"ContainerStarted","Data":"c7adef02e011bd2806a2c248c2c4da6247d108b483a11952125ffc1193a430d4"}
Jul 20 21:02:22.781760 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.781643    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerStarted","Data":"409c77c21f4c632e0748eee9bf09ad5cd072a3dc726eb49ee0db75bf62da592a"}
Jul 20 21:02:22.783753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.783686    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rd8x8" event={"ID":"ef29cde3-febc-44f2-a4b7-0916de63c5c2","Type":"ContainerStarted","Data":"bcac88ed6955dc9c79e4db97ab9d8bfa5d0d877e4bde45344ea434d5c9b7dc0d"}
Jul 20 21:02:22.786174 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.786080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zw96k" event={"ID":"73354489-004c-4429-9ba9-2cadd2eec8ff","Type":"ContainerStarted","Data":"7dd6deb7b56540937168da5cf3b9d8bf613feb10a681f00184b2b486525e308b"}
Jul 20 21:02:22.789005 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.788934    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fs9kl" event={"ID":"335d465f-e796-4de5-a149-0a728bab41a6","Type":"ContainerStarted","Data":"2ee2a241c4b8182fbb187d077f9adf5a6450bd774a3c556417809dc9dbf8813b"}
Jul 20 21:02:22.792283 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.792158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" event={"ID":"5782c222-9fed-498a-836d-de45e2e35c12","Type":"ContainerStarted","Data":"f2dc1da8ce7b4e6297a0de29d4e9f1178760c534bf4dcde20c8659197c3b59ec"}
Jul 20 21:02:22.794824 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.794747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" event={"ID":"02dc06bbe211fea0e45d5ad3a8ef1fa8","Type":"ContainerStarted","Data":"983b4c61f5c4ac631d47919fe8ec775444a760df04d3b35d2e9eccb20b2d6879"}
Jul 20 21:02:22.801926 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.801900    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal" event={"ID":"2ecdc9466b19439a9a3bd8f65ab19d6a","Type":"ContainerStarted","Data":"be6595710a9021360b6d41919f04bcd7c63717ca4dbdb1634b14de84a20ae97f"}
Jul 20 21:02:22.803765 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.803722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7c57j" event={"ID":"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01","Type":"ContainerStarted","Data":"2e1dfb1d3ea6b1c125defdb45a8f8b0842e7ca9f3116117a8646a8947faaa2db"}
Jul 20 21:02:22.808897 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.808871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hm9zz" event={"ID":"100b8d7c-f6d3-4620-b24d-6ea809073333","Type":"ContainerStarted","Data":"0cfa1f28b95f048231db2caad3a87037308053a9f24e4acfa5ccf5f746e02310"}
Jul 20 21:02:22.813167 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:22.813123    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v" event={"ID":"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c","Type":"ContainerStarted","Data":"cbd4ddf4fddb1b80eb36987a97c328e0188d5b02fd3d923367e9f37a1c498aa0"}
Jul 20 21:02:23.293161 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:23.293115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:23.293362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:23.293173    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:23.293362 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.293285    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:23.293362 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.293287    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:23.293362 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.293346    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:02:25.29332765 +0000 UTC m=+5.046050359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:23.293362 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.293365    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret podName:ccbdeae7-d204-44c7-bd07-bf3c91742105 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:25.293355965 +0000 UTC m=+5.046078668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret") pod "global-pull-secret-syncer-7s52p" (UID: "ccbdeae7-d204-44c7-bd07-bf3c91742105") : object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:23.393752 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:23.393711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:23.393949 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.393886    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 21:02:23.393949 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.393910    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 21:02:23.393949 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.393922    2573 projected.go:196] Error preparing data for projected volume kube-api-access-mrqhb for pod openshift-network-diagnostics/network-check-target-x87l8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:23.394131 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.393987    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb podName:04af2ea7-3401-4b85-9108-19c5b9049de4 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:25.393964792 +0000 UTC m=+5.146687503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mrqhb" (UniqueName: "kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb") pod "network-check-target-x87l8" (UID: "04af2ea7-3401-4b85-9108-19c5b9049de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:23.447760 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:23.447729    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 21:02:23.679436 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:23.679108    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 20:57:22 +0000 UTC" deadline="2028-03-21 02:19:46.163844716 +0000 UTC"
Jul 20 21:02:23.679436 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:23.679145    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14621h17m22.484704736s"
Jul 20 21:02:23.764662 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:23.764011    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:23.764662 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.764162    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:23.764662 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:23.764513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:23.764662 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.764630    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:23.764662 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:23.764660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:23.765075 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:23.764721    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:25.310443 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:25.310341    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:25.310443 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:25.310407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:25.310985 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.310557    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:25.310985 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.310619    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:02:29.310598543 +0000 UTC m=+9.063321249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:25.311243 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.311055    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:25.311243 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.311104    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret podName:ccbdeae7-d204-44c7-bd07-bf3c91742105 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:29.311089024 +0000 UTC m=+9.063811733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret") pod "global-pull-secret-syncer-7s52p" (UID: "ccbdeae7-d204-44c7-bd07-bf3c91742105") : object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:25.411828 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:25.411789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:25.412047 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.412029    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 21:02:25.412113 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.412055    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 21:02:25.412113 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.412068    2573 projected.go:196] Error preparing data for projected volume kube-api-access-mrqhb for pod openshift-network-diagnostics/network-check-target-x87l8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:25.412253 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.412142    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb podName:04af2ea7-3401-4b85-9108-19c5b9049de4 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:29.412107088 +0000 UTC m=+9.164829797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mrqhb" (UniqueName: "kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb") pod "network-check-target-x87l8" (UID: "04af2ea7-3401-4b85-9108-19c5b9049de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:25.764540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:25.764455    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:25.764717 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.764601    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:25.765087 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:25.765062    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:25.765406 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.765218    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:25.765406 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:25.765286    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:25.765406 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:25.765362    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:27.764385 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:27.764351    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:27.764926 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:27.764519    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:27.764926 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:27.764733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:27.764926 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:27.764766    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:27.764926 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:27.764860    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:27.765257 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:27.764930    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:29.346047 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:29.344470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:29.346047 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:29.344551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:29.346047 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.344730    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:29.346047 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.344806    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:02:37.344778922 +0000 UTC m=+17.097501641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:29.346047 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.345338    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:29.346047 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.345397    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret podName:ccbdeae7-d204-44c7-bd07-bf3c91742105 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:37.345381166 +0000 UTC m=+17.098103883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret") pod "global-pull-secret-syncer-7s52p" (UID: "ccbdeae7-d204-44c7-bd07-bf3c91742105") : object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:29.445930 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:29.445885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:29.446145 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.446093    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 21:02:29.446217 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.446152    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 21:02:29.446217 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.446166    2573 projected.go:196] Error preparing data for projected volume kube-api-access-mrqhb for pod openshift-network-diagnostics/network-check-target-x87l8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:29.446323 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.446226    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb podName:04af2ea7-3401-4b85-9108-19c5b9049de4 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:37.446211576 +0000 UTC m=+17.198934281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mrqhb" (UniqueName: "kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb") pod "network-check-target-x87l8" (UID: "04af2ea7-3401-4b85-9108-19c5b9049de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:29.764472 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:29.764395    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:29.764611 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:29.764503    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:29.764611 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.764515    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:29.764611 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:29.764531    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:29.764765 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.764619    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:29.764765 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:29.764713    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:31.763696 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:31.763583    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:31.763696 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:31.763602    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:31.763696 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:31.763583    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:31.764279 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:31.763723    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:31.764279 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:31.764192    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:31.764391 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:31.764282    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:33.764252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:33.764149    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:33.764252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:33.764189    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:33.764252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:33.764187    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:33.764765 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:33.764279    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:33.764765 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:33.764426    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:33.764765 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:33.764568    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:34.850183 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:34.849635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal" event={"ID":"2ecdc9466b19439a9a3bd8f65ab19d6a","Type":"ContainerStarted","Data":"2c5d014e61ba70ea2462ff9c6c611e1e5b53252f9b8be773fbc8dc781bd0464f"}
Jul 20 21:02:34.853032 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:34.852872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rd8x8" event={"ID":"ef29cde3-febc-44f2-a4b7-0916de63c5c2","Type":"ContainerStarted","Data":"9235aa40d7fdde905c8d0d6b8b2ad39d7f67e7d4113ecb35d3fb1c2d8116f5af"}
Jul 20 21:02:34.866383 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:34.866333    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-242.ec2.internal" podStartSLOduration=12.866315882 podStartE2EDuration="12.866315882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:34.866099417 +0000 UTC m=+14.618822153" watchObservedRunningTime="2026-07-20 21:02:34.866315882 +0000 UTC m=+14.619038608"
Jul 20 21:02:34.888123 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:34.887729    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rd8x8" podStartSLOduration=1.983819317 podStartE2EDuration="13.887713118s" totalImagesPullingTime="11.903893801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:34.887145885 +0000 UTC m=+14.639868609" watchObservedRunningTime="2026-07-20 21:02:34.887713118 +0000 UTC m=+14.640435838"
Jul 20 21:02:35.764639 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.764405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:35.764803 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.764456    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:35.764803 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:35.764734    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:35.764803 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.764455    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:35.764958 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:35.764815    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:35.764958 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:35.764877    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:35.856430 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.856365    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zw96k" event={"ID":"73354489-004c-4429-9ba9-2cadd2eec8ff","Type":"ContainerStarted","Data":"a91f30748838325aec9900eaf1baed78a52c4ebf121f606e73748dcf30b183e6"}
Jul 20 21:02:35.858037 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.857979    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fs9kl" event={"ID":"335d465f-e796-4de5-a149-0a728bab41a6","Type":"ContainerStarted","Data":"670cf64704f4472b4095773a39474d87b21524de1438deca446f3afd4c789f20"}
Jul 20 21:02:35.859651 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.859620    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" event={"ID":"5782c222-9fed-498a-836d-de45e2e35c12","Type":"ContainerStarted","Data":"d1aab3ac6e3e79e7cd0f55f31b88eec36dc03f81c3d147ff4e858b28509a688c"}
Jul 20 21:02:35.861312 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.861221    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" event={"ID":"02dc06bbe211fea0e45d5ad3a8ef1fa8","Type":"ContainerStarted","Data":"f75872efa41f2f73b27a7b67bc8964d5524ffd1a46a06a8e23d31efeb83c2c0a"}
Jul 20 21:02:35.862919 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.862871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7c57j" event={"ID":"cdc7cf7a-3a3c-4c3a-b098-e46322aa9a01","Type":"ContainerStarted","Data":"f61ff06345b12e73d6a6d61c9ad31bb593e47612a789b6a7386c38dd0ca1aee6"}
Jul 20 21:02:35.864391 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.864367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v" event={"ID":"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c","Type":"ContainerStarted","Data":"2e69286163e8d1cadec5248781f28011a58d92d37e79c734c8ffd0e687a27270"}
Jul 20 21:02:35.865995 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.865972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-frz2v" event={"ID":"e9ec5099-bccf-40fd-bc3e-d4c386061cff","Type":"ContainerStarted","Data":"3f60d98589a164fc4368a10f2e1377bcd5feee3c10ec6dd0ef5758b868e32ef2"}
Jul 20 21:02:35.874101 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.874042    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zw96k" podStartSLOduration=2.552638662 podStartE2EDuration="14.874024679s" totalImagesPullingTime="12.321386017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:35.873117238 +0000 UTC m=+15.625839986" watchObservedRunningTime="2026-07-20 21:02:35.874024679 +0000 UTC m=+15.626747403"
Jul 20 21:02:35.901124 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.901060    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7c57j" podStartSLOduration=2.58805753 podStartE2EDuration="14.901041999s" totalImagesPullingTime="12.312984469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:35.887292152 +0000 UTC m=+15.640014874" watchObservedRunningTime="2026-07-20 21:02:35.901041999 +0000 UTC m=+15.653764722"
Jul 20 21:02:35.914964 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.914928    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fs9kl" podStartSLOduration=2.564983138 podStartE2EDuration="14.91491592s" totalImagesPullingTime="12.349932782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:35.914778411 +0000 UTC m=+15.667501137" watchObservedRunningTime="2026-07-20 21:02:35.91491592 +0000 UTC m=+15.667638637"
Jul 20 21:02:35.953778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:35.953721    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-frz2v" podStartSLOduration=2.508456211 podStartE2EDuration="14.953707801s" totalImagesPullingTime="12.44525159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:35.953371302 +0000 UTC m=+15.706094028" watchObservedRunningTime="2026-07-20 21:02:35.953707801 +0000 UTC m=+15.706430524"
Jul 20 21:02:37.038313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:37.038275    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:37.038932 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:37.038911    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:37.409284 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:37.409206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:37.409456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:37.409324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:37.409456 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.409398    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:37.409456 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.409427    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:37.409607 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.409484    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:02:53.409461797 +0000 UTC m=+33.162184499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:37.409607 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.409506    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret podName:ccbdeae7-d204-44c7-bd07-bf3c91742105 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:53.409497107 +0000 UTC m=+33.162219808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret") pod "global-pull-secret-syncer-7s52p" (UID: "ccbdeae7-d204-44c7-bd07-bf3c91742105") : object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:37.510307 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:37.510276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:37.510457 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.510441    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 21:02:37.510525 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.510465    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 21:02:37.510525 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.510475    2573 projected.go:196] Error preparing data for projected volume kube-api-access-mrqhb for pod openshift-network-diagnostics/network-check-target-x87l8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:37.510584 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.510535    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb podName:04af2ea7-3401-4b85-9108-19c5b9049de4 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:53.510520453 +0000 UTC m=+33.263243158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mrqhb" (UniqueName: "kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb") pod "network-check-target-x87l8" (UID: "04af2ea7-3401-4b85-9108-19c5b9049de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:37.763702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:37.763670    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:37.763874 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:37.763670    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:37.763874 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.763811    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:37.763997 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.763895    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:37.763997 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:37.763670    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:37.764123 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:37.763995    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:38.871631 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:38.871602    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 21:02:39.764035 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:39.763999    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:39.764035 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:39.764026    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:39.764035 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:39.764035    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:39.764316 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:39.764150    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:39.764316 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:39.764259    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:39.764400 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:39.764340    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:41.763826 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:41.763790    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:41.763826 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:41.763831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:41.764353 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:41.763904    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:41.764353 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:41.763918    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:41.764353 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:41.764007    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:41.764353 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:41.764088    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:42.880174 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:42.880143    2573 generic.go:356] "Generic (PLEG): container finished" podID="5782c222-9fed-498a-836d-de45e2e35c12" containerID="d1aab3ac6e3e79e7cd0f55f31b88eec36dc03f81c3d147ff4e858b28509a688c" exitCode=0
Jul 20 21:02:42.880563 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:42.880232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" event={"ID":"5782c222-9fed-498a-836d-de45e2e35c12","Type":"ContainerDied","Data":"d1aab3ac6e3e79e7cd0f55f31b88eec36dc03f81c3d147ff4e858b28509a688c"}
Jul 20 21:02:42.882190 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:42.882151    2573 generic.go:356] "Generic (PLEG): container finished" podID="02dc06bbe211fea0e45d5ad3a8ef1fa8" containerID="f75872efa41f2f73b27a7b67bc8964d5524ffd1a46a06a8e23d31efeb83c2c0a" exitCode=0
Jul 20 21:02:42.882190 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:42.882191    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" event={"ID":"02dc06bbe211fea0e45d5ad3a8ef1fa8","Type":"ContainerDied","Data":"f75872efa41f2f73b27a7b67bc8964d5524ffd1a46a06a8e23d31efeb83c2c0a"}
Jul 20 21:02:43.317223 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.317058    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 21:02:43.647618 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.647411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:43.647920 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.647902    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fs9kl"
Jul 20 21:02:43.736181 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.736110    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T21:02:43.317218419Z","UUID":"25b3dbf4-2b88-49e6-a2c5-a3178babafd0","Handler":null,"Name":"","Endpoint":""}
Jul 20 21:02:43.737366 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.737352    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 21:02:43.737445 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.737386    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 21:02:43.764134 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.764111    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:43.764245 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.764141    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:43.764245 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.764110    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:43.764245 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:43.764225    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:43.764382 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:43.764307    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:43.764421 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:43.764369    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:43.886690 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.886605    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hm9zz" event={"ID":"100b8d7c-f6d3-4620-b24d-6ea809073333","Type":"ContainerStarted","Data":"444816374de8b4efd00f96d75e65b025abecce0c7d91b9748e3dde19269c8e86"}
Jul 20 21:02:43.888499 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.888473    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v" event={"ID":"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c","Type":"ContainerStarted","Data":"26eb624619242784d2322d6376f12e67309ba2fcefde6690c19edbd69c798ee4"}
Jul 20 21:02:43.891136 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.891112    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:02:43.891454 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.891438    2573 generic.go:356] "Generic (PLEG): container finished" podID="7ebfe27c-db36-403d-855a-e757efa8d930" containerID="537e957d97298e861437a9743dd423660a98e8fe3aee7240d0347589e9967fa7" exitCode=1
Jul 20 21:02:43.891533 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.891513    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerStarted","Data":"de32dbd0c18939a25c9ca563e18566ea01596931d9cbfc04db25d42acc4369eb"}
Jul 20 21:02:43.891609 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.891594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerStarted","Data":"e3d04989dd2854323ca75b3dae0b513a988a6d5dba834ca8accf70905cc902f9"}
Jul 20 21:02:43.891666 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.891652    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerStarted","Data":"c83b8700e0d69ae1654a96341ceb9d859d5a18937add04ff9e338126796ea4e1"}
Jul 20 21:02:43.891723 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.891707    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerStarted","Data":"baf8ac06c774b35afdba2a081b9045d623ddb8e2890ee19ad1b51d4fa02bb3a3"}
Jul 20 21:02:43.891785 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.891773    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerDied","Data":"537e957d97298e861437a9743dd423660a98e8fe3aee7240d0347589e9967fa7"}
Jul 20 21:02:43.891840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.891831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerStarted","Data":"220c2f79282ed64fc22606965df64f132687345b6c99cc558c9d810c0b24e57e"}
Jul 20 21:02:43.893295 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.893275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" event={"ID":"02dc06bbe211fea0e45d5ad3a8ef1fa8","Type":"ContainerStarted","Data":"e81e89a6e6fe8c40ae19056c4bbfcf955d4e9366f14a00410ee0492eff1f26f6"}
Jul 20 21:02:43.904661 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.904624    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hm9zz" podStartSLOduration=1.92607462 podStartE2EDuration="22.904612333s" totalImagesPullingTime="20.978537713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:43.904132089 +0000 UTC m=+23.656854811" watchObservedRunningTime="2026-07-20 21:02:43.904612333 +0000 UTC m=+23.657335056"
Jul 20 21:02:43.918708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:43.918672    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-242.ec2.internal" podStartSLOduration=21.918661758 podStartE2EDuration="21.918661758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:43.9184996 +0000 UTC m=+23.671222323" watchObservedRunningTime="2026-07-20 21:02:43.918661758 +0000 UTC m=+23.671384481"
Jul 20 21:02:45.764059 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:45.764024    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:45.764059 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:45.764043    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:45.764652 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:45.764040    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:45.764652 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:45.764157    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:45.764652 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:45.764241    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:45.764652 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:45.764322    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:45.902134 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:45.902111    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:02:45.902541 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:45.902515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerStarted","Data":"09d65745936dc9e1a407573695dcc55d03702b000e0dbea056e64ec1f3a59f4a"}
Jul 20 21:02:45.904722 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:45.904699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v" event={"ID":"d654e5f2-9cf4-46d7-99ac-d619ebb5c32c","Type":"ContainerStarted","Data":"1b43d21032fe330c8ccca35ed60d518e3926d5290a33ff95b1ce956a1da626f8"}
Jul 20 21:02:45.927685 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:45.926250    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bc5v" podStartSLOduration=3.154835637 podStartE2EDuration="24.926229956s" totalImagesPullingTime="21.771394319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:45.923783768 +0000 UTC m=+25.676506492" watchObservedRunningTime="2026-07-20 21:02:45.926229956 +0000 UTC m=+25.678952680"
Jul 20 21:02:47.763783 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:47.763754    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:47.763783 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:47.763769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:47.764349 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:47.763751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:47.764349 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:47.763859    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:47.764349 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:47.763939    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:47.764349 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:47.764044    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:49.764132 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.764097    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:49.764132 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.764125    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:49.764735 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.764130    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:49.764735 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:49.764204    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:49.764735 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:49.764271    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:49.764735 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:49.764329    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:49.917024 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.917000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:02:49.917396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.917364    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerStarted","Data":"739f9cf216654f300041c07aff7ebe1c013d97a02f91467c92c5bb903758f16d"}
Jul 20 21:02:49.917785 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.917753    2573 scope.go:117] "RemoveContainer" containerID="537e957d97298e861437a9743dd423660a98e8fe3aee7240d0347589e9967fa7"
Jul 20 21:02:49.918020 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.917997    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:49.919274 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.919251    2573 generic.go:356] "Generic (PLEG): container finished" podID="5782c222-9fed-498a-836d-de45e2e35c12" containerID="b54e5822092c6a0a929c71b2c4c9403f0d817fb2e294be284ce9ef277b22c754" exitCode=0
Jul 20 21:02:49.919365 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.919288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" event={"ID":"5782c222-9fed-498a-836d-de45e2e35c12","Type":"ContainerDied","Data":"b54e5822092c6a0a929c71b2c4c9403f0d817fb2e294be284ce9ef277b22c754"}
Jul 20 21:02:49.933802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:49.933779    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:50.924501 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.924475    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:02:50.924904 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.924832    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" event={"ID":"7ebfe27c-db36-403d-855a-e757efa8d930","Type":"ContainerStarted","Data":"e3b543658e8f27b0186bf0a1c998b459c5d733f5440fa3f2cb7f4fedd3cccd15"}
Jul 20 21:02:50.925125 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.925108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:50.927955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.925695    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:50.943799 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.943772    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:02:50.950561 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.950538    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7s52p"]
Jul 20 21:02:50.950671 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.950624    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:50.950731 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:50.950704    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:50.956928 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.956892    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd" podStartSLOduration=9.615595718 podStartE2EDuration="29.956880535s" totalImagesPullingTime="20.341284817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:02:50.956487425 +0000 UTC m=+30.709210170" watchObservedRunningTime="2026-07-20 21:02:50.956880535 +0000 UTC m=+30.709603257"
Jul 20 21:02:50.958311 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.958273    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x87l8"]
Jul 20 21:02:50.958443 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.958383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:50.958526 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:50.958487    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:50.959027 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.959001    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8l2tg"]
Jul 20 21:02:50.959145 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:50.959131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:50.959270 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:50.959233    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:51.928710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:51.928677    2573 generic.go:356] "Generic (PLEG): container finished" podID="5782c222-9fed-498a-836d-de45e2e35c12" containerID="744a6f735a22b0a28afc6edb992fcb0b75b49506bf52f7dcef96962d73c3e4e2" exitCode=0
Jul 20 21:02:51.929093 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:51.928750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" event={"ID":"5782c222-9fed-498a-836d-de45e2e35c12","Type":"ContainerDied","Data":"744a6f735a22b0a28afc6edb992fcb0b75b49506bf52f7dcef96962d73c3e4e2"}
Jul 20 21:02:52.764705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:52.764542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:52.764852 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:52.764559    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:52.764852 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:52.764809    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:52.764852 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:52.764559    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:52.765003 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:52.764862    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:52.765003 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:52.764926    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:53.433458 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:53.433401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:53.433743 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:53.433464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:53.433743 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:53.433552    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:53.433743 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:53.433600    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret podName:ccbdeae7-d204-44c7-bd07-bf3c91742105 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:25.433586706 +0000 UTC m=+65.186309406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret") pod "global-pull-secret-syncer-7s52p" (UID: "ccbdeae7-d204-44c7-bd07-bf3c91742105") : object "kube-system"/"original-pull-secret" not registered
Jul 20 21:02:53.433743 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:53.433552    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:53.433743 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:53.433689    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:03:25.43367175 +0000 UTC m=+65.186394455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 21:02:53.534540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:53.534515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:53.534661 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:53.534614    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 21:02:53.534661 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:53.534628    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 21:02:53.534661 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:53.534636    2573 projected.go:196] Error preparing data for projected volume kube-api-access-mrqhb for pod openshift-network-diagnostics/network-check-target-x87l8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:53.534752 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:53.534675    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb podName:04af2ea7-3401-4b85-9108-19c5b9049de4 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:25.534664238 +0000 UTC m=+65.287386938 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mrqhb" (UniqueName: "kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb") pod "network-check-target-x87l8" (UID: "04af2ea7-3401-4b85-9108-19c5b9049de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 21:02:53.934955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:53.934924    2573 generic.go:356] "Generic (PLEG): container finished" podID="5782c222-9fed-498a-836d-de45e2e35c12" containerID="556d5e2076ca27ad6fcb583dc89f67c95446d0a354423d199407fcb86fa43627" exitCode=0
Jul 20 21:02:53.935156 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:53.934961    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" event={"ID":"5782c222-9fed-498a-836d-de45e2e35c12","Type":"ContainerDied","Data":"556d5e2076ca27ad6fcb583dc89f67c95446d0a354423d199407fcb86fa43627"}
Jul 20 21:02:54.764028 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:54.763996    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:54.764523 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:54.763996    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:54.764523 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:54.764116    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x87l8" podUID="04af2ea7-3401-4b85-9108-19c5b9049de4"
Jul 20 21:02:54.764523 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:54.764011    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:54.764523 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:54.764169    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:02:54.764523 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:54.764244    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s52p" podUID="ccbdeae7-d204-44c7-bd07-bf3c91742105"
Jul 20 21:02:55.560381 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.560348    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-242.ec2.internal" event="NodeReady"
Jul 20 21:02:55.560600 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.560478    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 21:02:55.598652 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.598625    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"]
Jul 20 21:02:55.600677 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.600660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:02:55.602312 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.602291    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-977f755c-plqj6"]
Jul 20 21:02:55.603862 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.603841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.604286 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.604269    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 21:02:55.604286 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.604280    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-btd57\""
Jul 20 21:02:55.604425 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.604271    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 21:02:55.606217 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.606199    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-24tzc\""
Jul 20 21:02:55.606217 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.606202    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 21:02:55.606494 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.606475    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 21:02:55.606576 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.606513    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 21:02:55.611708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.611689    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 21:02:55.615212 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.615178    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"]
Jul 20 21:02:55.623505 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.623483    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-977f755c-plqj6"]
Jul 20 21:02:55.623923 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.623905    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6xncf"]
Jul 20 21:02:55.625767 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.625749    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.626052 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.626032    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b9gt6"]
Jul 20 21:02:55.627708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.627691    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b9gt6"
Jul 20 21:02:55.628581 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.628561    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 21:02:55.629216 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.629203    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n29b9\""
Jul 20 21:02:55.629268 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.629260    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 21:02:55.630392 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.630376    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 21:02:55.630692 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.630677    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 21:02:55.630781 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.630705    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2wsgb\""
Jul 20 21:02:55.630842 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.630823    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 21:02:55.636972 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.636950    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6xncf"]
Jul 20 21:02:55.640739 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.640719    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b9gt6"]
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40069710-60c1-42f1-8792-ee9befb5c154-tmp-dir\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650519    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8p25\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-kube-api-access-x8p25\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff466237-8d4e-451b-9f64-1a2f09aace58-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-registry-certificates\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-trusted-ca\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-image-registry-private-configuration\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-installation-pull-secrets\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12907773-237c-481c-91cd-3e8f6102a9af-ca-trust-extracted\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650807    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sknn6\" (UniqueName: \"kubernetes.io/projected/40069710-60c1-42f1-8792-ee9befb5c154-kube-api-access-sknn6\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99d3963f-e3cf-4654-980c-f7b71972a1a9-cert\") pod \"ingress-canary-b9gt6\" (UID: \"99d3963f-e3cf-4654-980c-f7b71972a1a9\") " pod="openshift-ingress-canary/ingress-canary-b9gt6"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650857    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djbv2\" (UniqueName: \"kubernetes.io/projected/99d3963f-e3cf-4654-980c-f7b71972a1a9-kube-api-access-djbv2\") pod \"ingress-canary-b9gt6\" (UID: \"99d3963f-e3cf-4654-980c-f7b71972a1a9\") " pod="openshift-ingress-canary/ingress-canary-b9gt6"
Jul 20 21:02:55.651098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-bound-sa-token\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.651798 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650933    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:02:55.651798 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.651798 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.650992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40069710-60c1-42f1-8792-ee9befb5c154-config-volume\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.751507 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff466237-8d4e-451b-9f64-1a2f09aace58-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:02:55.751700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-registry-certificates\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.751700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751566    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.751700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751591    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-trusted-ca\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.751700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-image-registry-private-configuration\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.751700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751647    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-installation-pull-secrets\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.751700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12907773-237c-481c-91cd-3e8f6102a9af-ca-trust-extracted\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.751700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751694    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sknn6\" (UniqueName: \"kubernetes.io/projected/40069710-60c1-42f1-8792-ee9befb5c154-kube-api-access-sknn6\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.751955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99d3963f-e3cf-4654-980c-f7b71972a1a9-cert\") pod \"ingress-canary-b9gt6\" (UID: \"99d3963f-e3cf-4654-980c-f7b71972a1a9\") " pod="openshift-ingress-canary/ingress-canary-b9gt6"
Jul 20 21:02:55.751955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djbv2\" (UniqueName: \"kubernetes.io/projected/99d3963f-e3cf-4654-980c-f7b71972a1a9-kube-api-access-djbv2\") pod \"ingress-canary-b9gt6\" (UID: \"99d3963f-e3cf-4654-980c-f7b71972a1a9\") " pod="openshift-ingress-canary/ingress-canary-b9gt6"
Jul 20 21:02:55.751955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751773    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-bound-sa-token\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.751955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751815    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:02:55.751955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.751955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40069710-60c1-42f1-8792-ee9befb5c154-config-volume\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.751955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40069710-60c1-42f1-8792-ee9befb5c154-tmp-dir\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.751955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.751911    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8p25\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-kube-api-access-x8p25\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.752340 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:55.752008    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 21:02:55.752340 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:55.752104    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls podName:40069710-60c1-42f1-8792-ee9befb5c154 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:56.252065092 +0000 UTC m=+36.004787794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls") pod "dns-default-6xncf" (UID: "40069710-60c1-42f1-8792-ee9befb5c154") : secret "dns-default-metrics-tls" not found
Jul 20 21:02:55.752340 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:55.752205    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:02:55.752500 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.752472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40069710-60c1-42f1-8792-ee9befb5c154-tmp-dir\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.752722 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.752593    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40069710-60c1-42f1-8792-ee9befb5c154-config-volume\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.752722 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.752600    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-registry-certificates\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.752722 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:55.752668    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:56.252650664 +0000 UTC m=+36.005373377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:02:55.752722 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.752681    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12907773-237c-481c-91cd-3e8f6102a9af-ca-trust-extracted\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.752722 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.752704    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff466237-8d4e-451b-9f64-1a2f09aace58-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:02:55.752992 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:55.752736    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 21:02:55.752992 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:55.752748    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-977f755c-plqj6: secret "image-registry-tls" not found
Jul 20 21:02:55.752992 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:55.752804    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls podName:12907773-237c-481c-91cd-3e8f6102a9af nodeName:}" failed. No retries permitted until 2026-07-20 21:02:56.252792058 +0000 UTC m=+36.005514772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls") pod "image-registry-977f755c-plqj6" (UID: "12907773-237c-481c-91cd-3e8f6102a9af") : secret "image-registry-tls" not found
Jul 20 21:02:55.753167 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.753122    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-trusted-ca\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.757007 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.756981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-installation-pull-secrets\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.757007 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.756994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-image-registry-private-configuration\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.757199 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.757045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99d3963f-e3cf-4654-980c-f7b71972a1a9-cert\") pod \"ingress-canary-b9gt6\" (UID: \"99d3963f-e3cf-4654-980c-f7b71972a1a9\") " pod="openshift-ingress-canary/ingress-canary-b9gt6"
Jul 20 21:02:55.760906 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.760877    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sknn6\" (UniqueName: \"kubernetes.io/projected/40069710-60c1-42f1-8792-ee9befb5c154-kube-api-access-sknn6\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:55.761855 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.761822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djbv2\" (UniqueName: \"kubernetes.io/projected/99d3963f-e3cf-4654-980c-f7b71972a1a9-kube-api-access-djbv2\") pod \"ingress-canary-b9gt6\" (UID: \"99d3963f-e3cf-4654-980c-f7b71972a1a9\") " pod="openshift-ingress-canary/ingress-canary-b9gt6"
Jul 20 21:02:55.761935 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.761890    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-bound-sa-token\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.762581 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.762559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8p25\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-kube-api-access-x8p25\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:55.939479 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:55.939446    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b9gt6"
Jul 20 21:02:56.076516 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.076355    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b9gt6"]
Jul 20 21:02:56.080294 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:02:56.080264    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d3963f_e3cf_4654_980c_f7b71972a1a9.slice/crio-89eae5b50d6d4aa21d4f71b73fb2507c1dbbfdbadad6ad52ce87f5bf11bf4b7e WatchSource:0}: Error finding container 89eae5b50d6d4aa21d4f71b73fb2507c1dbbfdbadad6ad52ce87f5bf11bf4b7e: Status 404 returned error can't find the container with id 89eae5b50d6d4aa21d4f71b73fb2507c1dbbfdbadad6ad52ce87f5bf11bf4b7e
Jul 20 21:02:56.256698 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.256664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:56.256880 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:56.256830    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 21:02:56.256946 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:56.256899    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls podName:40069710-60c1-42f1-8792-ee9befb5c154 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:57.256878343 +0000 UTC m=+37.009601044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls") pod "dns-default-6xncf" (UID: "40069710-60c1-42f1-8792-ee9befb5c154") : secret "dns-default-metrics-tls" not found
Jul 20 21:02:56.256946 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.256927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:02:56.257052 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.256962    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:56.257140 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:56.257050    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:02:56.257140 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:56.257059    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 21:02:56.257140 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:56.257095    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-977f755c-plqj6: secret "image-registry-tls" not found
Jul 20 21:02:56.257140 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:56.257122    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:57.257107825 +0000 UTC m=+37.009830526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:02:56.257140 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:56.257141    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls podName:12907773-237c-481c-91cd-3e8f6102a9af nodeName:}" failed. No retries permitted until 2026-07-20 21:02:57.257134108 +0000 UTC m=+37.009856808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls") pod "image-registry-977f755c-plqj6" (UID: "12907773-237c-481c-91cd-3e8f6102a9af") : secret "image-registry-tls" not found
Jul 20 21:02:56.763921 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.763890    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:02:56.764125 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.763890    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:02:56.764361 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.763888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:02:56.767031 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.766827    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 21:02:56.768018 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.767998    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 21:02:56.768140 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.767998    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 21:02:56.768140 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.768068    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 21:02:56.768140 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.768130    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hpjcj\""
Jul 20 21:02:56.768306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.768295    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lfgsb\""
Jul 20 21:02:56.945589 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:56.945552    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b9gt6" event={"ID":"99d3963f-e3cf-4654-980c-f7b71972a1a9","Type":"ContainerStarted","Data":"89eae5b50d6d4aa21d4f71b73fb2507c1dbbfdbadad6ad52ce87f5bf11bf4b7e"}
Jul 20 21:02:57.265134 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:57.265102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:02:57.265134 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:57.265146    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:57.265388 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:57.265210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:57.265388 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:57.265264    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:02:57.265388 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:57.265301    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 21:02:57.265388 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:57.265314    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-977f755c-plqj6: secret "image-registry-tls" not found
Jul 20 21:02:57.265388 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:57.265324    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 21:02:57.265388 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:57.265332    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:59.265313421 +0000 UTC m=+39.018036128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:02:57.265388 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:57.265360    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls podName:12907773-237c-481c-91cd-3e8f6102a9af nodeName:}" failed. No retries permitted until 2026-07-20 21:02:59.265349171 +0000 UTC m=+39.018071885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls") pod "image-registry-977f755c-plqj6" (UID: "12907773-237c-481c-91cd-3e8f6102a9af") : secret "image-registry-tls" not found
Jul 20 21:02:57.265388 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:57.265383    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls podName:40069710-60c1-42f1-8792-ee9befb5c154 nodeName:}" failed. No retries permitted until 2026-07-20 21:02:59.265368158 +0000 UTC m=+39.018090877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls") pod "dns-default-6xncf" (UID: "40069710-60c1-42f1-8792-ee9befb5c154") : secret "dns-default-metrics-tls" not found
Jul 20 21:02:59.283533 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:59.283494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:02:59.283941 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:59.283537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:02:59.283941 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:02:59.283607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:02:59.283941 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:59.283672    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:02:59.283941 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:59.283736    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 21:02:59.283941 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:59.283760    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:03.283738906 +0000 UTC m=+43.036461606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:02:59.283941 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:59.283737    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 21:02:59.283941 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:59.283786    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-977f755c-plqj6: secret "image-registry-tls" not found
Jul 20 21:02:59.283941 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:59.283791    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls podName:40069710-60c1-42f1-8792-ee9befb5c154 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:03.2837748 +0000 UTC m=+43.036497503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls") pod "dns-default-6xncf" (UID: "40069710-60c1-42f1-8792-ee9befb5c154") : secret "dns-default-metrics-tls" not found
Jul 20 21:02:59.283941 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:02:59.283825    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls podName:12907773-237c-481c-91cd-3e8f6102a9af nodeName:}" failed. No retries permitted until 2026-07-20 21:03:03.283813449 +0000 UTC m=+43.036536153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls") pod "image-registry-977f755c-plqj6" (UID: "12907773-237c-481c-91cd-3e8f6102a9af") : secret "image-registry-tls" not found
Jul 20 21:03:00.956698 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:00.956621    2573 generic.go:356] "Generic (PLEG): container finished" podID="5782c222-9fed-498a-836d-de45e2e35c12" containerID="d323497ac3fb6417c9d33a74b015dd47228a20ae5208ba2d3b3c5b937478df3a" exitCode=0
Jul 20 21:03:00.957143 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:00.956702    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" event={"ID":"5782c222-9fed-498a-836d-de45e2e35c12","Type":"ContainerDied","Data":"d323497ac3fb6417c9d33a74b015dd47228a20ae5208ba2d3b3c5b937478df3a"}
Jul 20 21:03:00.957996 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:00.957979    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b9gt6" event={"ID":"99d3963f-e3cf-4654-980c-f7b71972a1a9","Type":"ContainerStarted","Data":"eae3f64ea6a6d3b54513be2b671ea51ac70d52b06f291052af67b23d6f7db331"}
Jul 20 21:03:00.996360 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:00.996287    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b9gt6" podStartSLOduration=2.075087348 podStartE2EDuration="5.996270324s" totalImagesPullingTime="3.921182976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:03:00.995846437 +0000 UTC m=+40.748569160" watchObservedRunningTime="2026-07-20 21:03:00.996270324 +0000 UTC m=+40.748993046"
Jul 20 21:03:01.963836 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:01.963657    2573 generic.go:356] "Generic (PLEG): container finished" podID="5782c222-9fed-498a-836d-de45e2e35c12" containerID="c17784cf7a86c3b9923334cdeb4c87d7cdfd9806f9752860caba342fe9f17e7b" exitCode=0
Jul 20 21:03:01.964209 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:01.963731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" event={"ID":"5782c222-9fed-498a-836d-de45e2e35c12","Type":"ContainerDied","Data":"c17784cf7a86c3b9923334cdeb4c87d7cdfd9806f9752860caba342fe9f17e7b"}
Jul 20 21:03:02.969661 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:02.969628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" event={"ID":"5782c222-9fed-498a-836d-de45e2e35c12","Type":"ContainerStarted","Data":"ae0ba37d60043a42bd753e26338e355c992257f1ec063ed2648b1bc0de97481c"}
Jul 20 21:03:02.995635 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:02.995587    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vsb6d" podStartSLOduration=15.020475025 podStartE2EDuration="41.995572936s" totalImagesPullingTime="26.975097911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:03:02.994239677 +0000 UTC m=+42.746962398" watchObservedRunningTime="2026-07-20 21:03:02.995572936 +0000 UTC m=+42.748295657"
Jul 20 21:03:03.188211 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.188185    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"]
Jul 20 21:03:03.213266 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.213241    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"]
Jul 20 21:03:03.213416 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.213379    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"
Jul 20 21:03:03.217620 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.217587    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 21:03:03.217620 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.217605    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pvpzr\""
Jul 20 21:03:03.217620 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.217587    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 21:03:03.217818 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.217592    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 21:03:03.217818 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.217728    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 20 21:03:03.226985 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.226968    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"]
Jul 20 21:03:03.227087 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.227048    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.230250 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.230232    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 20 21:03:03.230361 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.230335    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 20 21:03:03.230361 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.230350    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 20 21:03:03.230451 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.230385    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 20 21:03:03.249068 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.249047    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"]
Jul 20 21:03:03.249068 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.249069    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"]
Jul 20 21:03:03.249207 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.249102    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"]
Jul 20 21:03:03.249207 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.249152    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.251998 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.251984    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 21:03:03.313396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjt99\" (UniqueName: \"kubernetes.io/projected/9e080321-6cdc-403d-a824-ed59cf528852-kube-api-access-sjt99\") pod \"managed-serviceaccount-addon-agent-88df9995b-pzzm9\" (UID: \"9e080321-6cdc-403d-a824-ed59cf528852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"
Jul 20 21:03:03.313396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n26n\" (UniqueName: \"kubernetes.io/projected/831cee7c-665b-4c03-97d1-b849bc228da3-kube-api-access-8n26n\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.313543 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl99h\" (UniqueName: \"kubernetes.io/projected/16b34621-0033-4cb6-9cd7-e14e6bf69f8a-kube-api-access-zl99h\") pod \"klusterlet-addon-workmgr-b8fd47ccc-p44bg\" (UID: \"16b34621-0033-4cb6-9cd7-e14e6bf69f8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.313543 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e080321-6cdc-403d-a824-ed59cf528852-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-88df9995b-pzzm9\" (UID: \"9e080321-6cdc-403d-a824-ed59cf528852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"
Jul 20 21:03:03.313543 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-ca\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.313543 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313498    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:03:03.313543 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313518    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/831cee7c-665b-4c03-97d1-b849bc228da3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.313716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313555    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.313716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:03:03.313716 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:03.313602    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:03:03.313716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-hub\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.313716 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:03.313657    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 21:03:03.313716 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:03.313677    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:11.313661981 +0000 UTC m=+51.066384681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:03:03.313716 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:03.313699    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls podName:40069710-60c1-42f1-8792-ee9befb5c154 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:11.313684725 +0000 UTC m=+51.066407426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls") pod "dns-default-6xncf" (UID: "40069710-60c1-42f1-8792-ee9befb5c154") : secret "dns-default-metrics-tls" not found
Jul 20 21:03:03.313937 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.313937 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16b34621-0033-4cb6-9cd7-e14e6bf69f8a-tmp\") pod \"klusterlet-addon-workmgr-b8fd47ccc-p44bg\" (UID: \"16b34621-0033-4cb6-9cd7-e14e6bf69f8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.313937 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:03:03.313937 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.313823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/16b34621-0033-4cb6-9cd7-e14e6bf69f8a-klusterlet-config\") pod \"klusterlet-addon-workmgr-b8fd47ccc-p44bg\" (UID: \"16b34621-0033-4cb6-9cd7-e14e6bf69f8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.313937 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:03.313873    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 21:03:03.313937 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:03.313882    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-977f755c-plqj6: secret "image-registry-tls" not found
Jul 20 21:03:03.313937 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:03.313905    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls podName:12907773-237c-481c-91cd-3e8f6102a9af nodeName:}" failed. No retries permitted until 2026-07-20 21:03:11.313897531 +0000 UTC m=+51.066620231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls") pod "image-registry-977f755c-plqj6" (UID: "12907773-237c-481c-91cd-3e8f6102a9af") : secret "image-registry-tls" not found
Jul 20 21:03:03.414855 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.414828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-hub\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.414947 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.414858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.414947 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.414875    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16b34621-0033-4cb6-9cd7-e14e6bf69f8a-tmp\") pod \"klusterlet-addon-workmgr-b8fd47ccc-p44bg\" (UID: \"16b34621-0033-4cb6-9cd7-e14e6bf69f8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.414947 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.414927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/16b34621-0033-4cb6-9cd7-e14e6bf69f8a-klusterlet-config\") pod \"klusterlet-addon-workmgr-b8fd47ccc-p44bg\" (UID: \"16b34621-0033-4cb6-9cd7-e14e6bf69f8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.415095 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.414967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjt99\" (UniqueName: \"kubernetes.io/projected/9e080321-6cdc-403d-a824-ed59cf528852-kube-api-access-sjt99\") pod \"managed-serviceaccount-addon-agent-88df9995b-pzzm9\" (UID: \"9e080321-6cdc-403d-a824-ed59cf528852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"
Jul 20 21:03:03.415095 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.414994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n26n\" (UniqueName: \"kubernetes.io/projected/831cee7c-665b-4c03-97d1-b849bc228da3-kube-api-access-8n26n\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.415095 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.415068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl99h\" (UniqueName: \"kubernetes.io/projected/16b34621-0033-4cb6-9cd7-e14e6bf69f8a-kube-api-access-zl99h\") pod \"klusterlet-addon-workmgr-b8fd47ccc-p44bg\" (UID: \"16b34621-0033-4cb6-9cd7-e14e6bf69f8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.415268 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.415248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e080321-6cdc-403d-a824-ed59cf528852-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-88df9995b-pzzm9\" (UID: \"9e080321-6cdc-403d-a824-ed59cf528852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"
Jul 20 21:03:03.415317 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.415291    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-ca\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.415432 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.415367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/831cee7c-665b-4c03-97d1-b849bc228da3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.415432 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.415432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.415849 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.415804    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16b34621-0033-4cb6-9cd7-e14e6bf69f8a-tmp\") pod \"klusterlet-addon-workmgr-b8fd47ccc-p44bg\" (UID: \"16b34621-0033-4cb6-9cd7-e14e6bf69f8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.416270 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.416149    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/831cee7c-665b-4c03-97d1-b849bc228da3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.419135 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.419107    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-ca\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.419237 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.419223    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.419278 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.419252    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.419347 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.419332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e080321-6cdc-403d-a824-ed59cf528852-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-88df9995b-pzzm9\" (UID: \"9e080321-6cdc-403d-a824-ed59cf528852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"
Jul 20 21:03:03.419392 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.419374    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/16b34621-0033-4cb6-9cd7-e14e6bf69f8a-klusterlet-config\") pod \"klusterlet-addon-workmgr-b8fd47ccc-p44bg\" (UID: \"16b34621-0033-4cb6-9cd7-e14e6bf69f8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.419672 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.419658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/831cee7c-665b-4c03-97d1-b849bc228da3-hub\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.425182 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.425162    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl99h\" (UniqueName: \"kubernetes.io/projected/16b34621-0033-4cb6-9cd7-e14e6bf69f8a-kube-api-access-zl99h\") pod \"klusterlet-addon-workmgr-b8fd47ccc-p44bg\" (UID: \"16b34621-0033-4cb6-9cd7-e14e6bf69f8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.425339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.425320    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjt99\" (UniqueName: \"kubernetes.io/projected/9e080321-6cdc-403d-a824-ed59cf528852-kube-api-access-sjt99\") pod \"managed-serviceaccount-addon-agent-88df9995b-pzzm9\" (UID: \"9e080321-6cdc-403d-a824-ed59cf528852\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"
Jul 20 21:03:03.425394 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.425367    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n26n\" (UniqueName: \"kubernetes.io/projected/831cee7c-665b-4c03-97d1-b849bc228da3-kube-api-access-8n26n\") pod \"cluster-proxy-proxy-agent-6cfb688f79-zzktj\" (UID: \"831cee7c-665b-4c03-97d1-b849bc228da3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.535020 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.534994    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"
Jul 20 21:03:03.541170 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.541147    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:03:03.566665 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.566651    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:03.717228 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.717202    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"]
Jul 20 21:03:03.720062 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:03:03.720029    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e080321_6cdc_403d_a824_ed59cf528852.slice/crio-6d5f70bceaa297dfdb1ee974a7fe3c80705709a21a1e7607eed3a44a8d3a1039 WatchSource:0}: Error finding container 6d5f70bceaa297dfdb1ee974a7fe3c80705709a21a1e7607eed3a44a8d3a1039: Status 404 returned error can't find the container with id 6d5f70bceaa297dfdb1ee974a7fe3c80705709a21a1e7607eed3a44a8d3a1039
Jul 20 21:03:03.735582 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.735553    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"]
Jul 20 21:03:03.738451 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:03:03.738427    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod831cee7c_665b_4c03_97d1_b849bc228da3.slice/crio-a3259a1a14751c154077d393fc5d13eb77a11a18d59d6c4dc22a0962e146c979 WatchSource:0}: Error finding container a3259a1a14751c154077d393fc5d13eb77a11a18d59d6c4dc22a0962e146c979: Status 404 returned error can't find the container with id a3259a1a14751c154077d393fc5d13eb77a11a18d59d6c4dc22a0962e146c979
Jul 20 21:03:03.753299 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.753275    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"]
Jul 20 21:03:03.755630 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:03:03.755610    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b34621_0033_4cb6_9cd7_e14e6bf69f8a.slice/crio-03a4fd975551215ca9149d0ce5282bb5f28a30323bd8f5c688565ef5891dcb1a WatchSource:0}: Error finding container 03a4fd975551215ca9149d0ce5282bb5f28a30323bd8f5c688565ef5891dcb1a: Status 404 returned error can't find the container with id 03a4fd975551215ca9149d0ce5282bb5f28a30323bd8f5c688565ef5891dcb1a
Jul 20 21:03:03.973334 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.973306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" event={"ID":"831cee7c-665b-4c03-97d1-b849bc228da3","Type":"ContainerStarted","Data":"a3259a1a14751c154077d393fc5d13eb77a11a18d59d6c4dc22a0962e146c979"}
Jul 20 21:03:03.974444 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.974418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" event={"ID":"16b34621-0033-4cb6-9cd7-e14e6bf69f8a","Type":"ContainerStarted","Data":"03a4fd975551215ca9149d0ce5282bb5f28a30323bd8f5c688565ef5891dcb1a"}
Jul 20 21:03:03.975385 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:03.975363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9" event={"ID":"9e080321-6cdc-403d-a824-ed59cf528852","Type":"ContainerStarted","Data":"6d5f70bceaa297dfdb1ee974a7fe3c80705709a21a1e7607eed3a44a8d3a1039"}
Jul 20 21:03:09.995219 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:09.995045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9" event={"ID":"9e080321-6cdc-403d-a824-ed59cf528852","Type":"ContainerStarted","Data":"fa0d4d71c31760a0833d14b215a5a60ca6508061af7229654e6ac169c770c4aa"}
Jul 20 21:03:10.999941 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:10.999901    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" event={"ID":"831cee7c-665b-4c03-97d1-b849bc228da3","Type":"ContainerStarted","Data":"7ad078b97cbe56b03fa920faf9e1c97c5c89ae88154471144a72bfee1fb060bd"}
Jul 20 21:03:11.000357 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:10.999954    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" event={"ID":"831cee7c-665b-4c03-97d1-b849bc228da3","Type":"ContainerStarted","Data":"59a191bd6930ed1f57c1b1d26741f5f04eee2c65d0d90a58afe4c379b72f3753"}
Jul 20 21:03:11.000357 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:10.999969    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" event={"ID":"831cee7c-665b-4c03-97d1-b849bc228da3","Type":"ContainerStarted","Data":"c62340a3913292a45c166b7ddff418ff25e01598fb52923264675997f9ce6a22"}
Jul 20 21:03:11.001461 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:11.001436    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" event={"ID":"16b34621-0033-4cb6-9cd7-e14e6bf69f8a","Type":"ContainerStarted","Data":"72b0003636e631931497735f5d86f820b116c2a88e78ca01b0eb7118b802094e"}
Jul 20 21:03:11.001589 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:11.001573    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:11.003207 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:11.003190    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:03:11.022619 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:11.022581    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" podStartSLOduration=1.8437265919999999 podStartE2EDuration="8.022569262s" totalImagesPullingTime="6.17884267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:03:11.021823742 +0000 UTC m=+50.774546476" watchObservedRunningTime="2026-07-20 21:03:11.022569262 +0000 UTC m=+50.775291962"
Jul 20 21:03:11.038579 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:11.038546    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9" podStartSLOduration=1.8550389250000001 podStartE2EDuration="8.038532976s" totalImagesPullingTime="6.183494051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:03:11.037613041 +0000 UTC m=+50.790335763" watchObservedRunningTime="2026-07-20 21:03:11.038532976 +0000 UTC m=+50.791255697"
Jul 20 21:03:11.058753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:11.058722    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" podStartSLOduration=1.9094164500000002 podStartE2EDuration="8.058713209s" totalImagesPullingTime="6.149296759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:03:11.058421435 +0000 UTC m=+50.811144157" watchObservedRunningTime="2026-07-20 21:03:11.058713209 +0000 UTC m=+50.811435931"
Jul 20 21:03:11.391053 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:11.390983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:03:11.391053 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:11.391038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:03:11.391286 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:11.391112    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:03:11.391286 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:11.391160    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 21:03:11.391286 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:11.391175    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-977f755c-plqj6: secret "image-registry-tls" not found
Jul 20 21:03:11.391286 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:11.391201    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 21:03:11.391286 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:11.391206    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:03:11.391286 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:11.391240    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls podName:12907773-237c-481c-91cd-3e8f6102a9af nodeName:}" failed. No retries permitted until 2026-07-20 21:03:27.391219709 +0000 UTC m=+67.143942429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls") pod "image-registry-977f755c-plqj6" (UID: "12907773-237c-481c-91cd-3e8f6102a9af") : secret "image-registry-tls" not found
Jul 20 21:03:11.391286 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:11.391263    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:27.391250096 +0000 UTC m=+67.143972799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:03:11.391286 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:11.391282    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls podName:40069710-60c1-42f1-8792-ee9befb5c154 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:27.391272959 +0000 UTC m=+67.143995659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls") pod "dns-default-6xncf" (UID: "40069710-60c1-42f1-8792-ee9befb5c154") : secret "dns-default-metrics-tls" not found
Jul 20 21:03:22.940749 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:22.940715    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt8xd"
Jul 20 21:03:25.484144 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.484101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:03:25.484144 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.484148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:03:25.487265 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.487246    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 21:03:25.487316 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.487246    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 21:03:25.494769 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:25.494746    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 21:03:25.494866 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:25.494808    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:04:29.494789204 +0000 UTC m=+129.247511918 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : secret "metrics-daemon-secret" not found
Jul 20 21:03:25.497892 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.497869    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbdeae7-d204-44c7-bd07-bf3c91742105-original-pull-secret\") pod \"global-pull-secret-syncer-7s52p\" (UID: \"ccbdeae7-d204-44c7-bd07-bf3c91742105\") " pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:03:25.584667 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.584631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:03:25.587710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.587696    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 21:03:25.588714 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.588700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s52p"
Jul 20 21:03:25.597753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.597733    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 21:03:25.608250 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.608233    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrqhb\" (UniqueName: \"kubernetes.io/projected/04af2ea7-3401-4b85-9108-19c5b9049de4-kube-api-access-mrqhb\") pod \"network-check-target-x87l8\" (UID: \"04af2ea7-3401-4b85-9108-19c5b9049de4\") " pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:03:25.707640 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.707611    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7s52p"]
Jul 20 21:03:25.710474 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:03:25.710445    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbdeae7_d204_44c7_bd07_bf3c91742105.slice/crio-e12cd300e7437c842424b8acf8403d5d9829e01d4a61310be17708a736496b9e WatchSource:0}: Error finding container e12cd300e7437c842424b8acf8403d5d9829e01d4a61310be17708a736496b9e: Status 404 returned error can't find the container with id e12cd300e7437c842424b8acf8403d5d9829e01d4a61310be17708a736496b9e
Jul 20 21:03:25.879322 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.879249    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lfgsb\""
Jul 20 21:03:25.886545 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:25.886521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:03:26.001594 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:26.001567    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x87l8"]
Jul 20 21:03:26.004754 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:03:26.004723    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04af2ea7_3401_4b85_9108_19c5b9049de4.slice/crio-9c1cbb7f89ca85346fdec9003d8968bc9a403c85ddf1089445d7a838d9b23435 WatchSource:0}: Error finding container 9c1cbb7f89ca85346fdec9003d8968bc9a403c85ddf1089445d7a838d9b23435: Status 404 returned error can't find the container with id 9c1cbb7f89ca85346fdec9003d8968bc9a403c85ddf1089445d7a838d9b23435
Jul 20 21:03:26.044704 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:26.044680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x87l8" event={"ID":"04af2ea7-3401-4b85-9108-19c5b9049de4","Type":"ContainerStarted","Data":"9c1cbb7f89ca85346fdec9003d8968bc9a403c85ddf1089445d7a838d9b23435"}
Jul 20 21:03:26.045728 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:26.045708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7s52p" event={"ID":"ccbdeae7-d204-44c7-bd07-bf3c91742105","Type":"ContainerStarted","Data":"e12cd300e7437c842424b8acf8403d5d9829e01d4a61310be17708a736496b9e"}
Jul 20 21:03:27.398087 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:27.398043    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:03:27.398539 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:27.398108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:03:27.398539 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:27.398140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:03:27.398539 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:27.398197    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:03:27.398539 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:27.398241    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 21:03:27.398539 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:27.398255    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-977f755c-plqj6: secret "image-registry-tls" not found
Jul 20 21:03:27.398539 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:27.398274    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:59.398252601 +0000 UTC m=+99.150975318 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:03:27.398539 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:27.398293    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls podName:12907773-237c-481c-91cd-3e8f6102a9af nodeName:}" failed. No retries permitted until 2026-07-20 21:03:59.398283026 +0000 UTC m=+99.151005726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls") pod "image-registry-977f755c-plqj6" (UID: "12907773-237c-481c-91cd-3e8f6102a9af") : secret "image-registry-tls" not found
Jul 20 21:03:27.398539 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:27.398244    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 21:03:27.398539 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:27.398321    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls podName:40069710-60c1-42f1-8792-ee9befb5c154 nodeName:}" failed. No retries permitted until 2026-07-20 21:03:59.398312309 +0000 UTC m=+99.151035010 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls") pod "dns-default-6xncf" (UID: "40069710-60c1-42f1-8792-ee9befb5c154") : secret "dns-default-metrics-tls" not found
Jul 20 21:03:31.065180 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:31.065056    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x87l8" event={"ID":"04af2ea7-3401-4b85-9108-19c5b9049de4","Type":"ContainerStarted","Data":"acb11194cd0cea4db3f62f2ccca21ffa29b2cf7c607f3d64e40017ec142c3339"}
Jul 20 21:03:31.065180 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:31.065144    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:03:31.066568 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:31.066535    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7s52p" event={"ID":"ccbdeae7-d204-44c7-bd07-bf3c91742105","Type":"ContainerStarted","Data":"cf3725e9ae96d58d9731d51b59a2247a7cdcff73d88a3e9975bf5c3791f68e55"}
Jul 20 21:03:31.081472 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:31.081428    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x87l8" podStartSLOduration=65.328738271 podStartE2EDuration="1m10.081416337s" totalImagesPullingTime="4.752678066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:03:31.080885971 +0000 UTC m=+70.833608716" watchObservedRunningTime="2026-07-20 21:03:31.081416337 +0000 UTC m=+70.834139059"
Jul 20 21:03:59.418943 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:59.418821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:03:59.418943 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:59.418870    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:03:59.418943 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:03:59.418922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:03:59.419542 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:59.418980    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 21:03:59.419542 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:59.419050    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls podName:40069710-60c1-42f1-8792-ee9befb5c154 nodeName:}" failed. No retries permitted until 2026-07-20 21:05:03.419031128 +0000 UTC m=+163.171753841 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls") pod "dns-default-6xncf" (UID: "40069710-60c1-42f1-8792-ee9befb5c154") : secret "dns-default-metrics-tls" not found
Jul 20 21:03:59.419542 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:59.419048    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 21:03:59.419542 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:59.419090    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-977f755c-plqj6: secret "image-registry-tls" not found
Jul 20 21:03:59.419542 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:59.419050    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:03:59.419542 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:59.419130    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls podName:12907773-237c-481c-91cd-3e8f6102a9af nodeName:}" failed. No retries permitted until 2026-07-20 21:05:03.419117941 +0000 UTC m=+163.171840644 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls") pod "image-registry-977f755c-plqj6" (UID: "12907773-237c-481c-91cd-3e8f6102a9af") : secret "image-registry-tls" not found
Jul 20 21:03:59.419542 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:03:59.419172    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:05:03.419156952 +0000 UTC m=+163.171879656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:04:02.073915 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:04:02.073888    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x87l8"
Jul 20 21:04:02.094527 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:04:02.094487    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7s52p" podStartSLOduration=96.041873303 podStartE2EDuration="1m41.094474682s" totalImagesPullingTime="5.052601379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:03:31.096159741 +0000 UTC m=+70.848882464" watchObservedRunningTime="2026-07-20 21:04:02.094474682 +0000 UTC m=+101.847197407"
Jul 20 21:04:29.526569 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:04:29.526523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:04:29.527056 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:04:29.526661    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 21:04:29.527056 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:04:29.526721    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:06:31.526705054 +0000 UTC m=+251.279427755 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : secret "metrics-daemon-secret" not found
Jul 20 21:04:58.612438 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:04:58.612392    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz" podUID="ff466237-8d4e-451b-9f64-1a2f09aace58"
Jul 20 21:04:58.617572 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:04:58.617543    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-977f755c-plqj6" podUID="12907773-237c-481c-91cd-3e8f6102a9af"
Jul 20 21:04:58.634722 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:04:58.634689    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6xncf" podUID="40069710-60c1-42f1-8792-ee9befb5c154"
Jul 20 21:04:59.315658 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:04:59.315632    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:04:59.315829 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:04:59.315634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xncf"
Jul 20 21:04:59.315829 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:04:59.315640    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:04:59.782858 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:04:59.782820    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:05:03.481887 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:03.481850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:05:03.482371 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:03.481931    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:05:03.482371 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:03.481974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:05:03.482371 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:05:03.482011    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:05:03.482371 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:05:03.482062    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 21:05:03.482371 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:05:03.482096    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-977f755c-plqj6: secret "image-registry-tls" not found
Jul 20 21:05:03.482371 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:05:03.482117    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:07:05.482095316 +0000 UTC m=+285.234818034 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:05:03.482371 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:05:03.482125    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 21:05:03.482371 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:05:03.482138    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls podName:12907773-237c-481c-91cd-3e8f6102a9af nodeName:}" failed. No retries permitted until 2026-07-20 21:07:05.482126821 +0000 UTC m=+285.234849524 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls") pod "image-registry-977f755c-plqj6" (UID: "12907773-237c-481c-91cd-3e8f6102a9af") : secret "image-registry-tls" not found
Jul 20 21:05:03.482371 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:05:03.482227    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls podName:40069710-60c1-42f1-8792-ee9befb5c154 nodeName:}" failed. No retries permitted until 2026-07-20 21:07:05.482207065 +0000 UTC m=+285.234929767 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls") pod "dns-default-6xncf" (UID: "40069710-60c1-42f1-8792-ee9befb5c154") : secret "dns-default-metrics-tls" not found
Jul 20 21:05:10.352361 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:10.352272    2573 generic.go:356] "Generic (PLEG): container finished" podID="16b34621-0033-4cb6-9cd7-e14e6bf69f8a" containerID="72b0003636e631931497735f5d86f820b116c2a88e78ca01b0eb7118b802094e" exitCode=1
Jul 20 21:05:10.352840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:10.352365    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" event={"ID":"16b34621-0033-4cb6-9cd7-e14e6bf69f8a","Type":"ContainerDied","Data":"72b0003636e631931497735f5d86f820b116c2a88e78ca01b0eb7118b802094e"}
Jul 20 21:05:10.352840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:10.352771    2573 scope.go:117] "RemoveContainer" containerID="72b0003636e631931497735f5d86f820b116c2a88e78ca01b0eb7118b802094e"
Jul 20 21:05:10.353894 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:10.353873    2573 generic.go:356] "Generic (PLEG): container finished" podID="9e080321-6cdc-403d-a824-ed59cf528852" containerID="fa0d4d71c31760a0833d14b215a5a60ca6508061af7229654e6ac169c770c4aa" exitCode=255
Jul 20 21:05:10.353995 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:10.353921    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9" event={"ID":"9e080321-6cdc-403d-a824-ed59cf528852","Type":"ContainerDied","Data":"fa0d4d71c31760a0833d14b215a5a60ca6508061af7229654e6ac169c770c4aa"}
Jul 20 21:05:10.354169 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:10.354157    2573 scope.go:117] "RemoveContainer" containerID="fa0d4d71c31760a0833d14b215a5a60ca6508061af7229654e6ac169c770c4aa"
Jul 20 21:05:11.001820 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:11.001781    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:05:11.358358 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:11.358257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" event={"ID":"16b34621-0033-4cb6-9cd7-e14e6bf69f8a","Type":"ContainerStarted","Data":"54e89ca8209985642fa3a47e4cf482ed317d1ce1b0c8b4e6ba390172bdfdc564"}
Jul 20 21:05:11.358793 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:11.358427    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:05:11.359145 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:11.359125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:05:11.360120 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:11.360101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9" event={"ID":"9e080321-6cdc-403d-a824-ed59cf528852","Type":"ContainerStarted","Data":"e19ba9210dbf50f3987baa33bf0a5a9959be50909844daff49b7574bfed32547"}
Jul 20 21:05:14.763693 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:05:14.763604    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:06:31.604212 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:31.604178    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:06:31.604683 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:31.604285    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 21:06:31.604683 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:31.604338    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs podName:23c795c0-0e1a-4ff5-8fef-723de361d42f nodeName:}" failed. No retries permitted until 2026-07-20 21:08:33.604324763 +0000 UTC m=+373.357047464 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs") pod "network-metrics-daemon-8l2tg" (UID: "23c795c0-0e1a-4ff5-8fef-723de361d42f") : secret "metrics-daemon-secret" not found
Jul 20 21:06:55.585338 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.585260    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mbrsj"]
Jul 20 21:06:55.587434 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.587418    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.594684 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.594666    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 21:06:55.601935 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:55.601913    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 20 21:06:55.604295 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:55.604274    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-mbrsj\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="8a12aebb-d0ed-40a5-a53d-8c47693bb423" pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.604563 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:55.604543    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret"
Jul 20 21:06:55.604628 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:55.604609    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 20 21:06:55.607303 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:55.607285    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-kgm4r\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kgm4r\"" type="*v1.Secret"
Jul 20 21:06:55.650064 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.650040    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbrsj"]
Jul 20 21:06:55.672407 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.672382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qblmj\" (UniqueName: \"kubernetes.io/projected/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-api-access-qblmj\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.672501 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.672427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.672501 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.672473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a12aebb-d0ed-40a5-a53d-8c47693bb423-data-volume\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.672573 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.672510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a12aebb-d0ed-40a5-a53d-8c47693bb423-crio-socket\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.672573 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.672554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.772876 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.772845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.772876 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.772874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qblmj\" (UniqueName: \"kubernetes.io/projected/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-api-access-qblmj\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.773064 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.772904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.773064 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.772943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a12aebb-d0ed-40a5-a53d-8c47693bb423-data-volume\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.773064 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.772984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a12aebb-d0ed-40a5-a53d-8c47693bb423-crio-socket\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.773064 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.773059    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a12aebb-d0ed-40a5-a53d-8c47693bb423-crio-socket\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:55.773222 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:55.773126    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 21:06:55.773258 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:55.773223    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:06:56.2732016 +0000 UTC m=+276.025924304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : configmap "kube-rbac-proxy" not found
Jul 20 21:06:55.773329 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:55.773312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a12aebb-d0ed-40a5-a53d-8c47693bb423-data-volume\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:56.276630 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:56.276583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:56.276815 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:56.276700    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 21:06:56.276815 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:56.276771    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:06:57.276756619 +0000 UTC m=+277.029479319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : configmap "kube-rbac-proxy" not found
Jul 20 21:06:56.598513 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:56.598431    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kgm4r\""
Jul 20 21:06:56.675869 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:56.675841    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 21:06:56.773399 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:56.773373    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition
Jul 20 21:06:56.773559 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:56.773444    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:06:57.273425408 +0000 UTC m=+277.026148108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : failed to sync secret cache: timed out waiting for the condition
Jul 20 21:06:56.791390 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:56.791355    2573 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 20 21:06:56.791511 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:56.791398    2573 projected.go:196] Error preparing data for projected volume kube-api-access-qblmj for pod openshift-insights/insights-runtime-extractor-mbrsj: failed to sync configmap cache: timed out waiting for the condition
Jul 20 21:06:56.791511 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:56.791451    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-api-access-qblmj podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:06:57.291436365 +0000 UTC m=+277.044159077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qblmj" (UniqueName: "kubernetes.io/projected/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-api-access-qblmj") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : failed to sync configmap cache: timed out waiting for the condition
Jul 20 21:06:56.889785 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:56.889723    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 21:06:56.977426 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:56.977401    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 21:06:57.285106 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:57.285060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:57.285275 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:57.285161    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 21:06:57.285275 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:57.285168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:57.285275 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:57.285214    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:06:59.285199337 +0000 UTC m=+279.037922038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : configmap "kube-rbac-proxy" not found
Jul 20 21:06:57.285275 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:57.285270    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 21:06:57.285433 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:57.285320    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:06:58.285309122 +0000 UTC m=+278.038031823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : secret "insights-runtime-extractor-tls" not found
Jul 20 21:06:57.385912 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:57.385883    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qblmj\" (UniqueName: \"kubernetes.io/projected/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-api-access-qblmj\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:57.388243 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:57.388221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qblmj\" (UniqueName: \"kubernetes.io/projected/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-api-access-qblmj\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:58.293237 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:58.293198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:58.293699 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:58.293328    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 21:06:58.293699 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:58.293402    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:07:00.293382131 +0000 UTC m=+280.046104832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : secret "insights-runtime-extractor-tls" not found
Jul 20 21:06:58.632752 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:58.632680    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zw96k_73354489-004c-4429-9ba9-2cadd2eec8ff/dns-node-resolver/0.log"
Jul 20 21:06:59.300920 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:59.300879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:06:59.301330 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:59.301003    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 21:06:59.301330 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:06:59.301065    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:07:03.30104861 +0000 UTC m=+283.053771311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : configmap "kube-rbac-proxy" not found
Jul 20 21:06:59.452672 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:06:59.452650    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-frz2v_e9ec5099-bccf-40fd-bc3e-d4c386061cff/node-ca/0.log"
Jul 20 21:07:00.237097 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:00.237048    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b9gt6_99d3963f-e3cf-4654-980c-f7b71972a1a9/serve-healthcheck-canary/0.log"
Jul 20 21:07:00.308325 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:00.308295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:07:00.308683 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:00.308429    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 21:07:00.308683 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:00.308480    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:07:04.308467539 +0000 UTC m=+284.061190240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : secret "insights-runtime-extractor-tls" not found
Jul 20 21:07:02.316713 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:02.316663    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-977f755c-plqj6" podUID="12907773-237c-481c-91cd-3e8f6102a9af"
Jul 20 21:07:02.316713 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:02.316663    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6xncf" podUID="40069710-60c1-42f1-8792-ee9befb5c154"
Jul 20 21:07:02.316713 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:02.316666    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz" podUID="ff466237-8d4e-451b-9f64-1a2f09aace58"
Jul 20 21:07:02.688005 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:02.687919    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:07:02.688005 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:02.687924    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:07:02.688005 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:02.687927    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xncf"
Jul 20 21:07:03.330649 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:03.330612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:07:03.331111 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:03.330735    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 21:07:03.331111 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:03.330808    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:07:11.330792542 +0000 UTC m=+291.083515243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : configmap "kube-rbac-proxy" not found
Jul 20 21:07:04.339232 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:04.339144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:07:04.339574 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:04.339295    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 21:07:04.339574 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:04.339360    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls podName:8a12aebb-d0ed-40a5-a53d-8c47693bb423 nodeName:}" failed. No retries permitted until 2026-07-20 21:07:12.339345332 +0000 UTC m=+292.092068033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mbrsj" (UID: "8a12aebb-d0ed-40a5-a53d-8c47693bb423") : secret "insights-runtime-extractor-tls" not found
Jul 20 21:07:05.548833 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.548789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:07:05.549356 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.548868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:07:05.549356 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.548921    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:07:05.549356 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:05.548928    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 21:07:05.549356 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:05.548990    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert podName:ff466237-8d4e-451b-9f64-1a2f09aace58 nodeName:}" failed. No retries permitted until 2026-07-20 21:09:07.54897574 +0000 UTC m=+407.301698441 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t54vz" (UID: "ff466237-8d4e-451b-9f64-1a2f09aace58") : secret "networking-console-plugin-cert" not found
Jul 20 21:07:05.551284 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.551259    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40069710-60c1-42f1-8792-ee9befb5c154-metrics-tls\") pod \"dns-default-6xncf\" (UID: \"40069710-60c1-42f1-8792-ee9befb5c154\") " pod="openshift-dns/dns-default-6xncf"
Jul 20 21:07:05.551471 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.551449    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"image-registry-977f755c-plqj6\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") " pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:07:05.691753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.691726    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-24tzc\""
Jul 20 21:07:05.692796 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.692781    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n29b9\""
Jul 20 21:07:05.699608 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.699592    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:07:05.699706 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.699692    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xncf"
Jul 20 21:07:05.837336 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.837273    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6xncf"]
Jul 20 21:07:05.840937 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:07:05.840914    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40069710_60c1_42f1_8792_ee9befb5c154.slice/crio-0d8fe188cfcd3f3917219293b47d27d76ac6a62d6af7909d8fd6d929d7e5946e WatchSource:0}: Error finding container 0d8fe188cfcd3f3917219293b47d27d76ac6a62d6af7909d8fd6d929d7e5946e: Status 404 returned error can't find the container with id 0d8fe188cfcd3f3917219293b47d27d76ac6a62d6af7909d8fd6d929d7e5946e
Jul 20 21:07:05.858160 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:05.858137    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-977f755c-plqj6"]
Jul 20 21:07:05.861017 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:07:05.860988    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12907773_237c_481c_91cd_3e8f6102a9af.slice/crio-ce04d786c3f3c2019c3d4003f2ce676dd8b1108999e9e408270c599b797b69cd WatchSource:0}: Error finding container ce04d786c3f3c2019c3d4003f2ce676dd8b1108999e9e408270c599b797b69cd: Status 404 returned error can't find the container with id ce04d786c3f3c2019c3d4003f2ce676dd8b1108999e9e408270c599b797b69cd
Jul 20 21:07:06.700997 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:06.700955    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xncf" event={"ID":"40069710-60c1-42f1-8792-ee9befb5c154","Type":"ContainerStarted","Data":"0d8fe188cfcd3f3917219293b47d27d76ac6a62d6af7909d8fd6d929d7e5946e"}
Jul 20 21:07:06.702953 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:06.702924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-977f755c-plqj6" event={"ID":"12907773-237c-481c-91cd-3e8f6102a9af","Type":"ContainerStarted","Data":"a32e6d509a25ce860bc98952f5503d6a924d08898146595fab89ca32e7c97802"}
Jul 20 21:07:06.703111 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:06.703040    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-977f755c-plqj6" event={"ID":"12907773-237c-481c-91cd-3e8f6102a9af","Type":"ContainerStarted","Data":"ce04d786c3f3c2019c3d4003f2ce676dd8b1108999e9e408270c599b797b69cd"}
Jul 20 21:07:06.703111 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:06.703069    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:07:08.710915 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:08.710878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xncf" event={"ID":"40069710-60c1-42f1-8792-ee9befb5c154","Type":"ContainerStarted","Data":"75a1d7a9d7c510c650ce181ba9d6a418eddef544bb76dedba16601bca47dd9aa"}
Jul 20 21:07:08.711395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:08.710952    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xncf" event={"ID":"40069710-60c1-42f1-8792-ee9befb5c154","Type":"ContainerStarted","Data":"05b02a280dcd2d504403814109e757b4608a07e019c6b3807995395daa85687f"}
Jul 20 21:07:08.711395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:08.711006    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6xncf"
Jul 20 21:07:08.733438 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:08.733395    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6xncf" podStartSLOduration=251.801355954 podStartE2EDuration="4m13.733380424s" totalImagesPullingTime="1.93202447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:07:08.732630478 +0000 UTC m=+288.485353210" watchObservedRunningTime="2026-07-20 21:07:08.733380424 +0000 UTC m=+288.486103147"
Jul 20 21:07:08.733772 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:08.733752    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-977f755c-plqj6" podStartSLOduration=287.733746871 podStartE2EDuration="4m47.733746871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:07:06.73388651 +0000 UTC m=+286.486609231" watchObservedRunningTime="2026-07-20 21:07:08.733746871 +0000 UTC m=+288.486469591"
Jul 20 21:07:10.718597 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:10.718506    2573 generic.go:356] "Generic (PLEG): container finished" podID="16b34621-0033-4cb6-9cd7-e14e6bf69f8a" containerID="54e89ca8209985642fa3a47e4cf482ed317d1ce1b0c8b4e6ba390172bdfdc564" exitCode=1
Jul 20 21:07:10.718597 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:10.718579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" event={"ID":"16b34621-0033-4cb6-9cd7-e14e6bf69f8a","Type":"ContainerDied","Data":"54e89ca8209985642fa3a47e4cf482ed317d1ce1b0c8b4e6ba390172bdfdc564"}
Jul 20 21:07:10.719108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:10.718642    2573 scope.go:117] "RemoveContainer" containerID="72b0003636e631931497735f5d86f820b116c2a88e78ca01b0eb7118b802094e"
Jul 20 21:07:10.719108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:10.718971    2573 scope.go:117] "RemoveContainer" containerID="54e89ca8209985642fa3a47e4cf482ed317d1ce1b0c8b4e6ba390172bdfdc564"
Jul 20 21:07:10.719221 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:10.719199    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-b8fd47ccc-p44bg_open-cluster-management-agent-addon(16b34621-0033-4cb6-9cd7-e14e6bf69f8a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" podUID="16b34621-0033-4cb6-9cd7-e14e6bf69f8a"
Jul 20 21:07:10.720415 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:10.720392    2573 generic.go:356] "Generic (PLEG): container finished" podID="9e080321-6cdc-403d-a824-ed59cf528852" containerID="e19ba9210dbf50f3987baa33bf0a5a9959be50909844daff49b7574bfed32547" exitCode=255
Jul 20 21:07:10.720506 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:10.720466    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9" event={"ID":"9e080321-6cdc-403d-a824-ed59cf528852","Type":"ContainerDied","Data":"e19ba9210dbf50f3987baa33bf0a5a9959be50909844daff49b7574bfed32547"}
Jul 20 21:07:10.720751 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:10.720726    2573 scope.go:117] "RemoveContainer" containerID="e19ba9210dbf50f3987baa33bf0a5a9959be50909844daff49b7574bfed32547"
Jul 20 21:07:10.720872 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:10.720857    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-88df9995b-pzzm9_open-cluster-management-agent-addon(9e080321-6cdc-403d-a824-ed59cf528852)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9" podUID="9e080321-6cdc-403d-a824-ed59cf528852"
Jul 20 21:07:10.728158 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:10.728136    2573 scope.go:117] "RemoveContainer" containerID="fa0d4d71c31760a0833d14b215a5a60ca6508061af7229654e6ac169c770c4aa"
Jul 20 21:07:11.358548 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:11.358515    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:07:11.399374 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:11.399351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:07:11.399758 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:11.399741    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a12aebb-d0ed-40a5-a53d-8c47693bb423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:07:11.725337 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:11.725315    2573 scope.go:117] "RemoveContainer" containerID="54e89ca8209985642fa3a47e4cf482ed317d1ce1b0c8b4e6ba390172bdfdc564"
Jul 20 21:07:11.725770 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:11.725525    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-b8fd47ccc-p44bg_open-cluster-management-agent-addon(16b34621-0033-4cb6-9cd7-e14e6bf69f8a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" podUID="16b34621-0033-4cb6-9cd7-e14e6bf69f8a"
Jul 20 21:07:12.406253 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:12.406215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:07:12.408505 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:12.408478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a12aebb-d0ed-40a5-a53d-8c47693bb423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbrsj\" (UID: \"8a12aebb-d0ed-40a5-a53d-8c47693bb423\") " pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:07:12.695785 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:12.695709    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbrsj"
Jul 20 21:07:12.833596 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:12.831797    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbrsj"]
Jul 20 21:07:12.836306 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:07:12.836279    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a12aebb_d0ed_40a5_a53d_8c47693bb423.slice/crio-5c6fedd311e4d1bf81dc878ed57daf19e243b579a5d39f2ac1018b6811025420 WatchSource:0}: Error finding container 5c6fedd311e4d1bf81dc878ed57daf19e243b579a5d39f2ac1018b6811025420: Status 404 returned error can't find the container with id 5c6fedd311e4d1bf81dc878ed57daf19e243b579a5d39f2ac1018b6811025420
Jul 20 21:07:13.535892 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:13.535854    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9"
Jul 20 21:07:13.536314 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:13.536278    2573 scope.go:117] "RemoveContainer" containerID="e19ba9210dbf50f3987baa33bf0a5a9959be50909844daff49b7574bfed32547"
Jul 20 21:07:13.536513 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:13.536478    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-88df9995b-pzzm9_open-cluster-management-agent-addon(9e080321-6cdc-403d-a824-ed59cf528852)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9" podUID="9e080321-6cdc-403d-a824-ed59cf528852"
Jul 20 21:07:13.567555 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:13.567522    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:07:13.567954 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:13.567938    2573 scope.go:117] "RemoveContainer" containerID="54e89ca8209985642fa3a47e4cf482ed317d1ce1b0c8b4e6ba390172bdfdc564"
Jul 20 21:07:13.568220 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:13.568155    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-b8fd47ccc-p44bg_open-cluster-management-agent-addon(16b34621-0033-4cb6-9cd7-e14e6bf69f8a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" podUID="16b34621-0033-4cb6-9cd7-e14e6bf69f8a"
Jul 20 21:07:13.735409 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:13.735373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbrsj" event={"ID":"8a12aebb-d0ed-40a5-a53d-8c47693bb423","Type":"ContainerStarted","Data":"5c6fedd311e4d1bf81dc878ed57daf19e243b579a5d39f2ac1018b6811025420"}
Jul 20 21:07:17.750214 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:17.750131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbrsj" event={"ID":"8a12aebb-d0ed-40a5-a53d-8c47693bb423","Type":"ContainerStarted","Data":"2aa8a257ac6500f80af46906dc471aed4bc01b9d5bd64699e0c83e2104824d26"}
Jul 20 21:07:17.764339 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:07:17.764305    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8l2tg" podUID="23c795c0-0e1a-4ff5-8fef-723de361d42f"
Jul 20 21:07:18.716338 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:18.716306    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6xncf"
Jul 20 21:07:20.869932 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:20.869908    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:07:20.869932 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:20.869913    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:07:20.876790 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:20.876678    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 21:07:21.766297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:21.766258    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbrsj" event={"ID":"8a12aebb-d0ed-40a5-a53d-8c47693bb423","Type":"ContainerStarted","Data":"c3e8bc96d760639dc2c3858e33cf362bf77e85de8994c432caa4c9591afdd15a"}
Jul 20 21:07:24.777360 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:24.777324    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbrsj" event={"ID":"8a12aebb-d0ed-40a5-a53d-8c47693bb423","Type":"ContainerStarted","Data":"17d469f0c7784865e0e05ea36efe38e488d3cb2b70873d98bf31695abc256294"}
Jul 20 21:07:24.798416 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:24.798366    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mbrsj" podStartSLOduration=18.411046268 podStartE2EDuration="29.798353352s" totalImagesPullingTime="11.387307084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:06:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:07:24.796882372 +0000 UTC m=+304.549605094" watchObservedRunningTime="2026-07-20 21:07:24.798353352 +0000 UTC m=+304.551076075"
Jul 20 21:07:25.703720 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:25.703687    2573 patch_prober.go:28] interesting pod/image-registry-977f755c-plqj6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 21:07:25.703903 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:25.703737    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-977f755c-plqj6" podUID="12907773-237c-481c-91cd-3e8f6102a9af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 21:07:27.711480 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:27.711452    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:07:27.764440 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:27.764407    2573 scope.go:117] "RemoveContainer" containerID="54e89ca8209985642fa3a47e4cf482ed317d1ce1b0c8b4e6ba390172bdfdc564"
Jul 20 21:07:28.764570 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:28.764534    2573 scope.go:117] "RemoveContainer" containerID="e19ba9210dbf50f3987baa33bf0a5a9959be50909844daff49b7574bfed32547"
Jul 20 21:07:28.789861 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:28.789829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg" event={"ID":"16b34621-0033-4cb6-9cd7-e14e6bf69f8a","Type":"ContainerStarted","Data":"db9b9b843e283e58e898132fd1dec8b38cf8400be80c665e6d4d6c5192cd3df3"}
Jul 20 21:07:28.790121 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:28.790105    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:07:28.791578 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:28.791558    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b8fd47ccc-p44bg"
Jul 20 21:07:29.375796 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.375767    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b2t8c"]
Jul 20 21:07:29.378980 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.378962    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.381834 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.381811    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 21:07:29.382195 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.382179    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 21:07:29.383356 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.383341    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 21:07:29.383356 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.383351    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 21:07:29.383499 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.383364    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 21:07:29.383499 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.383351    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 21:07:29.390094 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.386665    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8pvq7\""
Jul 20 21:07:29.537615 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.537591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e94684-ef93-4db2-8f8e-e097b4528f95-sys\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.537751 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.537620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-textfile\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.537751 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.537649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74e94684-ef93-4db2-8f8e-e097b4528f95-metrics-client-ca\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.537751 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.537669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74e94684-ef93-4db2-8f8e-e097b4528f95-root\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.537859 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.537750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-tls\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.537859 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.537791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.537859 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.537846    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-wtmp\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.538005 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.537890    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.538005 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.537911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhjxf\" (UniqueName: \"kubernetes.io/projected/74e94684-ef93-4db2-8f8e-e097b4528f95-kube-api-access-vhjxf\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638606 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-tls\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638606 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638768 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-wtmp\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638768 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjxf\" (UniqueName: \"kubernetes.io/projected/74e94684-ef93-4db2-8f8e-e097b4528f95-kube-api-access-vhjxf\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e94684-ef93-4db2-8f8e-e097b4528f95-sys\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-textfile\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638872    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74e94684-ef93-4db2-8f8e-e097b4528f95-metrics-client-ca\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638885    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-wtmp\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.638992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74e94684-ef93-4db2-8f8e-e097b4528f95-root\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.639171 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.638991    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74e94684-ef93-4db2-8f8e-e097b4528f95-root\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.639232 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.639188    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.639232 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.639219    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-textfile\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.639329 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.639317    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e94684-ef93-4db2-8f8e-e097b4528f95-sys\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.639373 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.639345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74e94684-ef93-4db2-8f8e-e097b4528f95-metrics-client-ca\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.640912 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.640888    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-tls\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.641061 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.640946    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74e94684-ef93-4db2-8f8e-e097b4528f95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.647775 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.647757    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjxf\" (UniqueName: \"kubernetes.io/projected/74e94684-ef93-4db2-8f8e-e097b4528f95-kube-api-access-vhjxf\") pod \"node-exporter-b2t8c\" (UID: \"74e94684-ef93-4db2-8f8e-e097b4528f95\") " pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.692918 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.692897    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b2t8c"
Jul 20 21:07:29.703896 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:07:29.703874    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e94684_ef93_4db2_8f8e_e097b4528f95.slice/crio-58e75a57d5fe80a0f7222e7a51b38a9f775426495f80672c181ee4f50dcb071a WatchSource:0}: Error finding container 58e75a57d5fe80a0f7222e7a51b38a9f775426495f80672c181ee4f50dcb071a: Status 404 returned error can't find the container with id 58e75a57d5fe80a0f7222e7a51b38a9f775426495f80672c181ee4f50dcb071a
Jul 20 21:07:29.705640 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.705625    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 21:07:29.794039 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.794011    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2t8c" event={"ID":"74e94684-ef93-4db2-8f8e-e097b4528f95","Type":"ContainerStarted","Data":"58e75a57d5fe80a0f7222e7a51b38a9f775426495f80672c181ee4f50dcb071a"}
Jul 20 21:07:29.795715 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:29.795692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-88df9995b-pzzm9" event={"ID":"9e080321-6cdc-403d-a824-ed59cf528852","Type":"ContainerStarted","Data":"1a61202f416fd1f920776a1f7930cf4ddf4d9bca69c9484fd35666b33d205ae4"}
Jul 20 21:07:31.764377 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:31.764346    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:07:31.803255 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:31.803227    2573 generic.go:356] "Generic (PLEG): container finished" podID="74e94684-ef93-4db2-8f8e-e097b4528f95" containerID="372e6c7602dab165eaab2dce1cb10363aa40eba37936cb9001d630c991aa55e4" exitCode=0
Jul 20 21:07:31.803396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:31.803272    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2t8c" event={"ID":"74e94684-ef93-4db2-8f8e-e097b4528f95","Type":"ContainerDied","Data":"372e6c7602dab165eaab2dce1cb10363aa40eba37936cb9001d630c991aa55e4"}
Jul 20 21:07:32.807764 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:32.807726    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2t8c" event={"ID":"74e94684-ef93-4db2-8f8e-e097b4528f95","Type":"ContainerStarted","Data":"891a18b6d280da715d31c0c797aff182fe23c406a1b74532e37ea443af8d6583"}
Jul 20 21:07:32.808223 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:32.807782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2t8c" event={"ID":"74e94684-ef93-4db2-8f8e-e097b4528f95","Type":"ContainerStarted","Data":"de296dbf42989a0fbf88da94fcce11f657a8ef231f7af46d84324c00221fa24d"}
Jul 20 21:07:32.830315 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:32.830276    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b2t8c" podStartSLOduration=2.73437228 podStartE2EDuration="3.830262197s" totalImagesPullingTime="1.034013507s" totalInitContainerRuntime="61.87641ms" isStatefulPod=true podCreationTimestamp="2026-07-20 21:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:07:32.828627852 +0000 UTC m=+312.581350594" watchObservedRunningTime="2026-07-20 21:07:32.830262197 +0000 UTC m=+312.582984919"
Jul 20 21:07:42.700487 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:07:42.700453    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-977f755c-plqj6"]
Jul 20 21:08:07.719879 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:07.719810    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-977f755c-plqj6" podUID="12907773-237c-481c-91cd-3e8f6102a9af" containerName="registry" containerID="cri-o://a32e6d509a25ce860bc98952f5503d6a924d08898146595fab89ca32e7c97802" gracePeriod=30
Jul 20 21:08:07.915315 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:07.915280    2573 generic.go:356] "Generic (PLEG): container finished" podID="12907773-237c-481c-91cd-3e8f6102a9af" containerID="a32e6d509a25ce860bc98952f5503d6a924d08898146595fab89ca32e7c97802" exitCode=0
Jul 20 21:08:07.915433 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:07.915329    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-977f755c-plqj6" event={"ID":"12907773-237c-481c-91cd-3e8f6102a9af","Type":"ContainerDied","Data":"a32e6d509a25ce860bc98952f5503d6a924d08898146595fab89ca32e7c97802"}
Jul 20 21:08:07.954515 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:07.954496    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:08:08.008653 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.008625    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-image-registry-private-configuration\") pod \"12907773-237c-481c-91cd-3e8f6102a9af\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") "
Jul 20 21:08:08.008781 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.008677    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-registry-certificates\") pod \"12907773-237c-481c-91cd-3e8f6102a9af\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") "
Jul 20 21:08:08.008781 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.008717    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8p25\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-kube-api-access-x8p25\") pod \"12907773-237c-481c-91cd-3e8f6102a9af\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") "
Jul 20 21:08:08.008781 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.008741    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-installation-pull-secrets\") pod \"12907773-237c-481c-91cd-3e8f6102a9af\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") "
Jul 20 21:08:08.008781 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.008773    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-bound-sa-token\") pod \"12907773-237c-481c-91cd-3e8f6102a9af\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") "
Jul 20 21:08:08.008974 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.008797    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") pod \"12907773-237c-481c-91cd-3e8f6102a9af\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") "
Jul 20 21:08:08.008974 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.008824    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12907773-237c-481c-91cd-3e8f6102a9af-ca-trust-extracted\") pod \"12907773-237c-481c-91cd-3e8f6102a9af\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") "
Jul 20 21:08:08.008974 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.008846    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-trusted-ca\") pod \"12907773-237c-481c-91cd-3e8f6102a9af\" (UID: \"12907773-237c-481c-91cd-3e8f6102a9af\") "
Jul 20 21:08:08.009261 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.009230    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "12907773-237c-481c-91cd-3e8f6102a9af" (UID: "12907773-237c-481c-91cd-3e8f6102a9af"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:08:08.009436 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.009390    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "12907773-237c-481c-91cd-3e8f6102a9af" (UID: "12907773-237c-481c-91cd-3e8f6102a9af"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:08:08.011042 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.011013    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "12907773-237c-481c-91cd-3e8f6102a9af" (UID: "12907773-237c-481c-91cd-3e8f6102a9af"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:08:08.011256 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.011137    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "12907773-237c-481c-91cd-3e8f6102a9af" (UID: "12907773-237c-481c-91cd-3e8f6102a9af"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:08:08.011309 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.011256    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-kube-api-access-x8p25" (OuterVolumeSpecName: "kube-api-access-x8p25") pod "12907773-237c-481c-91cd-3e8f6102a9af" (UID: "12907773-237c-481c-91cd-3e8f6102a9af"). InnerVolumeSpecName "kube-api-access-x8p25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:08:08.011368 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.011340    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "12907773-237c-481c-91cd-3e8f6102a9af" (UID: "12907773-237c-481c-91cd-3e8f6102a9af"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:08:08.011460 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.011441    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "12907773-237c-481c-91cd-3e8f6102a9af" (UID: "12907773-237c-481c-91cd-3e8f6102a9af"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:08:08.017489 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.017460    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12907773-237c-481c-91cd-3e8f6102a9af-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "12907773-237c-481c-91cd-3e8f6102a9af" (UID: "12907773-237c-481c-91cd-3e8f6102a9af"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:08:08.109336 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.109316    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-bound-sa-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:08:08.109336 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.109334    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-registry-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:08:08.109435 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.109343    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12907773-237c-481c-91cd-3e8f6102a9af-ca-trust-extracted\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:08:08.109435 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.109352    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-trusted-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:08:08.109435 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.109361    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-image-registry-private-configuration\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:08:08.109435 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.109370    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12907773-237c-481c-91cd-3e8f6102a9af-registry-certificates\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:08:08.109435 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.109378    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8p25\" (UniqueName: \"kubernetes.io/projected/12907773-237c-481c-91cd-3e8f6102a9af-kube-api-access-x8p25\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:08:08.109435 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.109386    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12907773-237c-481c-91cd-3e8f6102a9af-installation-pull-secrets\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:08:08.920156 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.920123    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-977f755c-plqj6"
Jul 20 21:08:08.920551 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.920121    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-977f755c-plqj6" event={"ID":"12907773-237c-481c-91cd-3e8f6102a9af","Type":"ContainerDied","Data":"ce04d786c3f3c2019c3d4003f2ce676dd8b1108999e9e408270c599b797b69cd"}
Jul 20 21:08:08.920551 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.920246    2573 scope.go:117] "RemoveContainer" containerID="a32e6d509a25ce860bc98952f5503d6a924d08898146595fab89ca32e7c97802"
Jul 20 21:08:08.938555 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.938536    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-977f755c-plqj6"]
Jul 20 21:08:08.944337 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:08.944320    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-977f755c-plqj6"]
Jul 20 21:08:10.768516 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:10.768483    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12907773-237c-481c-91cd-3e8f6102a9af" path="/var/lib/kubelet/pods/12907773-237c-481c-91cd-3e8f6102a9af/volumes"
Jul 20 21:08:13.542697 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:13.542617    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" podUID="831cee7c-665b-4c03-97d1-b849bc228da3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 20 21:08:23.542779 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:23.542741    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" podUID="831cee7c-665b-4c03-97d1-b849bc228da3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 20 21:08:33.542723 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.542674    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" podUID="831cee7c-665b-4c03-97d1-b849bc228da3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 20 21:08:33.543152 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.542779    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj"
Jul 20 21:08:33.543460 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.543417    2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"7ad078b97cbe56b03fa920faf9e1c97c5c89ae88154471144a72bfee1fb060bd"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 20 21:08:33.543548 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.543484    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" podUID="831cee7c-665b-4c03-97d1-b849bc228da3" containerName="service-proxy" containerID="cri-o://7ad078b97cbe56b03fa920faf9e1c97c5c89ae88154471144a72bfee1fb060bd" gracePeriod=30
Jul 20 21:08:33.695243 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.695210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:08:33.697386 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.697359    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c795c0-0e1a-4ff5-8fef-723de361d42f-metrics-certs\") pod \"network-metrics-daemon-8l2tg\" (UID: \"23c795c0-0e1a-4ff5-8fef-723de361d42f\") " pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:08:33.868209 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.868069    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hpjcj\""
Jul 20 21:08:33.875405 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.875378    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8l2tg"
Jul 20 21:08:33.993412 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.993387    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8l2tg"]
Jul 20 21:08:33.996098 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:08:33.996058    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c795c0_0e1a_4ff5_8fef_723de361d42f.slice/crio-0214224dceb64496eed97cec31cc756bb46c24a22d882fe97523b2ce60930eb8 WatchSource:0}: Error finding container 0214224dceb64496eed97cec31cc756bb46c24a22d882fe97523b2ce60930eb8: Status 404 returned error can't find the container with id 0214224dceb64496eed97cec31cc756bb46c24a22d882fe97523b2ce60930eb8
Jul 20 21:08:33.998908 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.998886    2573 generic.go:356] "Generic (PLEG): container finished" podID="831cee7c-665b-4c03-97d1-b849bc228da3" containerID="7ad078b97cbe56b03fa920faf9e1c97c5c89ae88154471144a72bfee1fb060bd" exitCode=2
Jul 20 21:08:33.999001 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.998954    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" event={"ID":"831cee7c-665b-4c03-97d1-b849bc228da3","Type":"ContainerDied","Data":"7ad078b97cbe56b03fa920faf9e1c97c5c89ae88154471144a72bfee1fb060bd"}
Jul 20 21:08:33.999040 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:33.998998    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cfb688f79-zzktj" event={"ID":"831cee7c-665b-4c03-97d1-b849bc228da3","Type":"ContainerStarted","Data":"b0e9a667d2901db4daf86b9d95ad1ae7dfb9d9e50a8ac61cd8c34f581b89d9d4"}
Jul 20 21:08:35.002990 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:35.002952    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8l2tg" event={"ID":"23c795c0-0e1a-4ff5-8fef-723de361d42f","Type":"ContainerStarted","Data":"0214224dceb64496eed97cec31cc756bb46c24a22d882fe97523b2ce60930eb8"}
Jul 20 21:08:36.008402 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:36.008366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8l2tg" event={"ID":"23c795c0-0e1a-4ff5-8fef-723de361d42f","Type":"ContainerStarted","Data":"10597f0073a6511a4a13efb2da23477dd58d482280005e9051293b803cc62e54"}
Jul 20 21:08:36.008817 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:36.008425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8l2tg" event={"ID":"23c795c0-0e1a-4ff5-8fef-723de361d42f","Type":"ContainerStarted","Data":"2566806b93f4af4b62fbdf34fd9748e1b4a0153960ce91566e2ae6477303bda1"}
Jul 20 21:08:36.027673 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:08:36.027628    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8l2tg" podStartSLOduration=373.772073329 podStartE2EDuration="6m15.027613735s" totalImagesPullingTime="1.255540406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:08:36.026937568 +0000 UTC m=+375.779660289" watchObservedRunningTime="2026-07-20 21:08:36.027613735 +0000 UTC m=+375.780336466"
Jul 20 21:09:05.689255 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:09:05.689210    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz" podUID="ff466237-8d4e-451b-9f64-1a2f09aace58"
Jul 20 21:09:06.106391 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:09:06.106361    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:09:07.639021 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:09:07.638978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:09:07.641469 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:09:07.641445    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff466237-8d4e-451b-9f64-1a2f09aace58-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t54vz\" (UID: \"ff466237-8d4e-451b-9f64-1a2f09aace58\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:09:07.909683 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:09:07.909600    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-btd57\""
Jul 20 21:09:07.917782 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:09:07.917759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"
Jul 20 21:09:08.040650 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:09:08.040620    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz"]
Jul 20 21:09:08.044130 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:09:08.044104    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff466237_8d4e_451b_9f64_1a2f09aace58.slice/crio-e9786b484ac7702f5f1403b81b5384a9db0a61c0efabadd88c7387a2fd168e8e WatchSource:0}: Error finding container e9786b484ac7702f5f1403b81b5384a9db0a61c0efabadd88c7387a2fd168e8e: Status 404 returned error can't find the container with id e9786b484ac7702f5f1403b81b5384a9db0a61c0efabadd88c7387a2fd168e8e
Jul 20 21:09:08.113441 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:09:08.113414    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz" event={"ID":"ff466237-8d4e-451b-9f64-1a2f09aace58","Type":"ContainerStarted","Data":"e9786b484ac7702f5f1403b81b5384a9db0a61c0efabadd88c7387a2fd168e8e"}
Jul 20 21:09:10.121212 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:09:10.121180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz" event={"ID":"ff466237-8d4e-451b-9f64-1a2f09aace58","Type":"ContainerStarted","Data":"611877734eea10b3c66f936034dfa492bf6482107a172cc0a166e56419e5da4b"}
Jul 20 21:09:10.137890 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:09:10.137846    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t54vz" podStartSLOduration=380.910987667 podStartE2EDuration="6m22.137831699s" totalImagesPullingTime="1.226844032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:09:10.137764379 +0000 UTC m=+409.890487102" watchObservedRunningTime="2026-07-20 21:09:10.137831699 +0000 UTC m=+409.890554423"
Jul 20 21:10:13.973540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:13.973503    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"]
Jul 20 21:10:13.973999 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:13.973733    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12907773-237c-481c-91cd-3e8f6102a9af" containerName="registry"
Jul 20 21:10:13.973999 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:13.973743    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="12907773-237c-481c-91cd-3e8f6102a9af" containerName="registry"
Jul 20 21:10:13.973999 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:13.973788    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="12907773-237c-481c-91cd-3e8f6102a9af" containerName="registry"
Jul 20 21:10:13.976521 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:13.976505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"
Jul 20 21:10:13.979773 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:13.979746    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-m2shg\""
Jul 20 21:10:13.980042 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:13.980023    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 21:10:13.980497 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:13.980479    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 21:10:13.992228 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:13.992208    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"]
Jul 20 21:10:14.087708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:14.087666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr7wc\" (UniqueName: \"kubernetes.io/projected/9b98b932-8e41-494b-a56b-9f79cfdefc00-kube-api-access-mr7wc\") pod \"cert-manager-operator-controller-manager-55c444bf86-84tb9\" (UID: \"9b98b932-8e41-494b-a56b-9f79cfdefc00\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"
Jul 20 21:10:14.087708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:14.087708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b98b932-8e41-494b-a56b-9f79cfdefc00-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-84tb9\" (UID: \"9b98b932-8e41-494b-a56b-9f79cfdefc00\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"
Jul 20 21:10:14.188815 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:14.188766    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr7wc\" (UniqueName: \"kubernetes.io/projected/9b98b932-8e41-494b-a56b-9f79cfdefc00-kube-api-access-mr7wc\") pod \"cert-manager-operator-controller-manager-55c444bf86-84tb9\" (UID: \"9b98b932-8e41-494b-a56b-9f79cfdefc00\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"
Jul 20 21:10:14.188815 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:14.188816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b98b932-8e41-494b-a56b-9f79cfdefc00-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-84tb9\" (UID: \"9b98b932-8e41-494b-a56b-9f79cfdefc00\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"
Jul 20 21:10:14.189179 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:14.189163    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b98b932-8e41-494b-a56b-9f79cfdefc00-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-84tb9\" (UID: \"9b98b932-8e41-494b-a56b-9f79cfdefc00\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"
Jul 20 21:10:14.197821 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:14.197800    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr7wc\" (UniqueName: \"kubernetes.io/projected/9b98b932-8e41-494b-a56b-9f79cfdefc00-kube-api-access-mr7wc\") pod \"cert-manager-operator-controller-manager-55c444bf86-84tb9\" (UID: \"9b98b932-8e41-494b-a56b-9f79cfdefc00\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"
Jul 20 21:10:14.285841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:14.285750    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"
Jul 20 21:10:14.421414 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:14.421389    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9"]
Jul 20 21:10:14.423489 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:10:14.423456    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b98b932_8e41_494b_a56b_9f79cfdefc00.slice/crio-b0ffd4ebc367a2bc7f4d9d6ac7e7a11cd43164b8d65774c317c67926d0fd7415 WatchSource:0}: Error finding container b0ffd4ebc367a2bc7f4d9d6ac7e7a11cd43164b8d65774c317c67926d0fd7415: Status 404 returned error can't find the container with id b0ffd4ebc367a2bc7f4d9d6ac7e7a11cd43164b8d65774c317c67926d0fd7415
Jul 20 21:10:15.333440 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:15.333396    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9" event={"ID":"9b98b932-8e41-494b-a56b-9f79cfdefc00","Type":"ContainerStarted","Data":"b0ffd4ebc367a2bc7f4d9d6ac7e7a11cd43164b8d65774c317c67926d0fd7415"}
Jul 20 21:10:17.343454 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:17.343418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9" event={"ID":"9b98b932-8e41-494b-a56b-9f79cfdefc00","Type":"ContainerStarted","Data":"ffaf2d3fcaf7b7e53a4013cfa8f1b1a920b43600dbb71727d57024fdea900a1b"}
Jul 20 21:10:17.376096 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:17.376022    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-84tb9" podStartSLOduration=2.015764008 podStartE2EDuration="4.376005273s" totalImagesPullingTime="2.360241265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:10:17.369973519 +0000 UTC m=+477.122696242" watchObservedRunningTime="2026-07-20 21:10:17.376005273 +0000 UTC m=+477.128728022"
Jul 20 21:10:18.489164 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.489123    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"]
Jul 20 21:10:18.492614 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.492590    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.495436 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.495376    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rxvs8\""
Jul 20 21:10:18.495571 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.495467    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 21:10:18.496535 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.496519    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 21:10:18.501667 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.501645    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"]
Jul 20 21:10:18.523800 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.523770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6ltj\" (UniqueName: \"kubernetes.io/projected/c3e88060-0343-4554-9ecf-8c15d0fbae3e-kube-api-access-q6ltj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.523895 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.523822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.523895 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.523867    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.624564 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.624527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.624564 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.624563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.624796 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.624616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6ltj\" (UniqueName: \"kubernetes.io/projected/c3e88060-0343-4554-9ecf-8c15d0fbae3e-kube-api-access-q6ltj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.624965 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.624941    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.625018 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.624992    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.633260 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.633236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6ltj\" (UniqueName: \"kubernetes.io/projected/c3e88060-0343-4554-9ecf-8c15d0fbae3e-kube-api-access-q6ltj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.801922 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.801841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:18.932653 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:18.932617    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"]
Jul 20 21:10:18.935779 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:10:18.935752    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e88060_0343_4554_9ecf_8c15d0fbae3e.slice/crio-9db2a786ed37c2e7c02f5269aae24db5a78b078c2ad0840009f0ef13b4ccc381 WatchSource:0}: Error finding container 9db2a786ed37c2e7c02f5269aae24db5a78b078c2ad0840009f0ef13b4ccc381: Status 404 returned error can't find the container with id 9db2a786ed37c2e7c02f5269aae24db5a78b078c2ad0840009f0ef13b4ccc381
Jul 20 21:10:19.352453 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:19.352418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw" event={"ID":"c3e88060-0343-4554-9ecf-8c15d0fbae3e","Type":"ContainerStarted","Data":"9db2a786ed37c2e7c02f5269aae24db5a78b078c2ad0840009f0ef13b4ccc381"}
Jul 20 21:10:25.378726 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:25.378691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw" event={"ID":"c3e88060-0343-4554-9ecf-8c15d0fbae3e","Type":"ContainerStarted","Data":"63c84ccdb606ace8a47b29b163fd58551840c1d04c0c72a84be29efd5c7bf141"}
Jul 20 21:10:26.383635 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:26.383598    2573 generic.go:356] "Generic (PLEG): container finished" podID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerID="63c84ccdb606ace8a47b29b163fd58551840c1d04c0c72a84be29efd5c7bf141" exitCode=0
Jul 20 21:10:26.384036 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:26.383687    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw" event={"ID":"c3e88060-0343-4554-9ecf-8c15d0fbae3e","Type":"ContainerDied","Data":"63c84ccdb606ace8a47b29b163fd58551840c1d04c0c72a84be29efd5c7bf141"}
Jul 20 21:10:28.393965 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:28.393926    2573 generic.go:356] "Generic (PLEG): container finished" podID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerID="ff29b97fd358a99367f6f4550dd7e986c7494e3a0e662e50a0e48a5fe97214f0" exitCode=0
Jul 20 21:10:28.394368 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:28.394022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw" event={"ID":"c3e88060-0343-4554-9ecf-8c15d0fbae3e","Type":"ContainerDied","Data":"ff29b97fd358a99367f6f4550dd7e986c7494e3a0e662e50a0e48a5fe97214f0"}
Jul 20 21:10:36.427768 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:36.427726    2573 generic.go:356] "Generic (PLEG): container finished" podID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerID="92022feaadc12de3af1be61c9fbdc8f9f65b5a9c21f4301ecd2180057ce6bb3c" exitCode=0
Jul 20 21:10:36.428437 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:36.427817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw" event={"ID":"c3e88060-0343-4554-9ecf-8c15d0fbae3e","Type":"ContainerDied","Data":"92022feaadc12de3af1be61c9fbdc8f9f65b5a9c21f4301ecd2180057ce6bb3c"}
Jul 20 21:10:37.555643 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.555618    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:37.675302 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.675259    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-bundle\") pod \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") "
Jul 20 21:10:37.675302 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.675304    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-util\") pod \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") "
Jul 20 21:10:37.675635 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.675324    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6ltj\" (UniqueName: \"kubernetes.io/projected/c3e88060-0343-4554-9ecf-8c15d0fbae3e-kube-api-access-q6ltj\") pod \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\" (UID: \"c3e88060-0343-4554-9ecf-8c15d0fbae3e\") "
Jul 20 21:10:37.675793 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.675762    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-bundle" (OuterVolumeSpecName: "bundle") pod "c3e88060-0343-4554-9ecf-8c15d0fbae3e" (UID: "c3e88060-0343-4554-9ecf-8c15d0fbae3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:10:37.677753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.677702    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3e88060-0343-4554-9ecf-8c15d0fbae3e-kube-api-access-q6ltj" (OuterVolumeSpecName: "kube-api-access-q6ltj") pod "c3e88060-0343-4554-9ecf-8c15d0fbae3e" (UID: "c3e88060-0343-4554-9ecf-8c15d0fbae3e"). InnerVolumeSpecName "kube-api-access-q6ltj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:10:37.679464 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.679415    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-util" (OuterVolumeSpecName: "util") pod "c3e88060-0343-4554-9ecf-8c15d0fbae3e" (UID: "c3e88060-0343-4554-9ecf-8c15d0fbae3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:10:37.776367 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.776323    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-bundle\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:10:37.776367 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.776358    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3e88060-0343-4554-9ecf-8c15d0fbae3e-util\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:10:37.776367 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:37.776368    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6ltj\" (UniqueName: \"kubernetes.io/projected/c3e88060-0343-4554-9ecf-8c15d0fbae3e-kube-api-access-q6ltj\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:10:38.437771 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:38.437736    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw" event={"ID":"c3e88060-0343-4554-9ecf-8c15d0fbae3e","Type":"ContainerDied","Data":"9db2a786ed37c2e7c02f5269aae24db5a78b078c2ad0840009f0ef13b4ccc381"}
Jul 20 21:10:38.437938 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:38.437789    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9db2a786ed37c2e7c02f5269aae24db5a78b078c2ad0840009f0ef13b4ccc381"
Jul 20 21:10:38.437938 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:38.437745    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvltw"
Jul 20 21:10:42.120297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.120258    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"]
Jul 20 21:10:42.120754 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.120513    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerName="extract"
Jul 20 21:10:42.120754 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.120525    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerName="extract"
Jul 20 21:10:42.120754 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.120537    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerName="util"
Jul 20 21:10:42.120754 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.120542    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerName="util"
Jul 20 21:10:42.120754 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.120550    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerName="pull"
Jul 20 21:10:42.120754 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.120556    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerName="pull"
Jul 20 21:10:42.120754 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.120611    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3e88060-0343-4554-9ecf-8c15d0fbae3e" containerName="extract"
Jul 20 21:10:42.178057 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.178013    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"]
Jul 20 21:10:42.178236 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.178139    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"
Jul 20 21:10:42.180970 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.180945    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 21:10:42.181218 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.181201    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 21:10:42.182237 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.182221    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rlsk7\""
Jul 20 21:10:42.309865 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.309825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h9slw\" (UID: \"9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"
Jul 20 21:10:42.309865 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.309873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqmcw\" (UniqueName: \"kubernetes.io/projected/9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69-kube-api-access-jqmcw\") pod \"openshift-lws-operator-fd8ccff4c-h9slw\" (UID: \"9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"
Jul 20 21:10:42.411237 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.411155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqmcw\" (UniqueName: \"kubernetes.io/projected/9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69-kube-api-access-jqmcw\") pod \"openshift-lws-operator-fd8ccff4c-h9slw\" (UID: \"9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"
Jul 20 21:10:42.411237 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.411223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h9slw\" (UID: \"9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"
Jul 20 21:10:42.411605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.411582    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h9slw\" (UID: \"9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"
Jul 20 21:10:42.419825 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.419795    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqmcw\" (UniqueName: \"kubernetes.io/projected/9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69-kube-api-access-jqmcw\") pod \"openshift-lws-operator-fd8ccff4c-h9slw\" (UID: \"9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"
Jul 20 21:10:42.487091 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.487036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"
Jul 20 21:10:42.627854 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:42.627832    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw"]
Jul 20 21:10:42.633940 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:10:42.633908    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9eeb7d5f_f73b_4c0a_96fd_0da02b6a0b69.slice/crio-81b0856566138de7b2068ec92855a5e9186ba6398973160487343eb30c297e05 WatchSource:0}: Error finding container 81b0856566138de7b2068ec92855a5e9186ba6398973160487343eb30c297e05: Status 404 returned error can't find the container with id 81b0856566138de7b2068ec92855a5e9186ba6398973160487343eb30c297e05
Jul 20 21:10:43.456388 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:43.456351    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw" event={"ID":"9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69","Type":"ContainerStarted","Data":"81b0856566138de7b2068ec92855a5e9186ba6398973160487343eb30c297e05"}
Jul 20 21:10:46.469630 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:46.469594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw" event={"ID":"9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69","Type":"ContainerStarted","Data":"6bf7744d58366ebd12cb0452220aae23254f12e250dcdadf37a0396514a3800c"}
Jul 20 21:10:46.491831 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:10:46.491788    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9slw" podStartSLOduration=1.609616282 podStartE2EDuration="4.491770045s" totalImagesPullingTime="2.882153763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:10:46.491091086 +0000 UTC m=+506.243813822" watchObservedRunningTime="2026-07-20 21:10:46.491770045 +0000 UTC m=+506.244492767"
Jul 20 21:11:07.318379 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.318343    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"]
Jul 20 21:11:07.320657 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.320640    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.331331 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.331308    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 21:11:07.331331 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.331311    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 21:11:07.332323 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.332307    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 21:11:07.332584 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.332552    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 21:11:07.332862 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.332844    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tc9ds\""
Jul 20 21:11:07.346717 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.346691    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"]
Jul 20 21:11:07.502926 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.502888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b867932-1539-4a17-bc94-4e82cbd91967-manifests\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.502926 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.502931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b867932-1539-4a17-bc94-4e82cbd91967-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.503201 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.502965    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b867932-1539-4a17-bc94-4e82cbd91967-webhook-cert\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.503201 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.503037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b867932-1539-4a17-bc94-4e82cbd91967-tmp\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.503201 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.503070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbdsq\" (UniqueName: \"kubernetes.io/projected/2b867932-1539-4a17-bc94-4e82cbd91967-kube-api-access-cbdsq\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.604048 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.603946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b867932-1539-4a17-bc94-4e82cbd91967-webhook-cert\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.604048 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.604000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b867932-1539-4a17-bc94-4e82cbd91967-tmp\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.604048 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.604018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbdsq\" (UniqueName: \"kubernetes.io/projected/2b867932-1539-4a17-bc94-4e82cbd91967-kube-api-access-cbdsq\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.604048 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.604053    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b867932-1539-4a17-bc94-4e82cbd91967-manifests\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.604366 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.604070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b867932-1539-4a17-bc94-4e82cbd91967-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.604543 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.604524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b867932-1539-4a17-bc94-4e82cbd91967-manifests\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.606448 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.606418    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b867932-1539-4a17-bc94-4e82cbd91967-tmp\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.606673 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.606650    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b867932-1539-4a17-bc94-4e82cbd91967-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.606742 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.606720    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b867932-1539-4a17-bc94-4e82cbd91967-webhook-cert\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.619204 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.619177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbdsq\" (UniqueName: \"kubernetes.io/projected/2b867932-1539-4a17-bc94-4e82cbd91967-kube-api-access-cbdsq\") pod \"opendatahub-operator-controller-manager-66b5c4b596-kjgmf\" (UID: \"2b867932-1539-4a17-bc94-4e82cbd91967\") " pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.630050 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.630019    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:07.761492 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:07.761438    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"]
Jul 20 21:11:07.766008 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:11:07.765965    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b867932_1539_4a17_bc94_4e82cbd91967.slice/crio-2162eb95ff53f73a158c63a63f1a5b0b588b1997bd376d88ef3a7297123206bc WatchSource:0}: Error finding container 2162eb95ff53f73a158c63a63f1a5b0b588b1997bd376d88ef3a7297123206bc: Status 404 returned error can't find the container with id 2162eb95ff53f73a158c63a63f1a5b0b588b1997bd376d88ef3a7297123206bc
Jul 20 21:11:08.556482 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:08.556434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf" event={"ID":"2b867932-1539-4a17-bc94-4e82cbd91967","Type":"ContainerStarted","Data":"2162eb95ff53f73a158c63a63f1a5b0b588b1997bd376d88ef3a7297123206bc"}
Jul 20 21:11:11.571185 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:11.571147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf" event={"ID":"2b867932-1539-4a17-bc94-4e82cbd91967","Type":"ContainerStarted","Data":"6029548214bd88748a33437bfef02fc37b6613c11ed16a49e717ef502acd42ef"}
Jul 20 21:11:12.576368 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:12.576332    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b867932-1539-4a17-bc94-4e82cbd91967" containerID="6029548214bd88748a33437bfef02fc37b6613c11ed16a49e717ef502acd42ef" exitCode=0
Jul 20 21:11:12.576758 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:12.576422    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf" event={"ID":"2b867932-1539-4a17-bc94-4e82cbd91967","Type":"ContainerDied","Data":"6029548214bd88748a33437bfef02fc37b6613c11ed16a49e717ef502acd42ef"}
Jul 20 21:11:13.582454 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:13.582417    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf" event={"ID":"2b867932-1539-4a17-bc94-4e82cbd91967","Type":"ContainerStarted","Data":"aa32dab24757c4502dd9c627d63d968bb4176e0bab343bf2b560ce63fcf51fd9"}
Jul 20 21:11:13.582854 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:13.582521    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:13.608212 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:13.608157    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf" podStartSLOduration=1.903744368 podStartE2EDuration="6.608140531s" totalImagesPullingTime="3.657410085s" totalInitContainerRuntime="1.046986078s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:11:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:11:13.605981787 +0000 UTC m=+533.358704510" watchObservedRunningTime="2026-07-20 21:11:13.608140531 +0000 UTC m=+533.360863253"
Jul 20 21:11:24.589311 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:24.589275    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66b5c4b596-kjgmf"
Jul 20 21:11:27.587845 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.587804    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"]
Jul 20 21:11:27.596306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.596280    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:27.608920 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.608895    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 21:11:27.609710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.609688    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 21:11:27.609800 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.609784    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 21:11:27.609850 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.609785    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fmzrc\""
Jul 20 21:11:27.609900 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.609862    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 21:11:27.626388 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.626356    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"]
Jul 20 21:11:27.644376 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.644344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-tls-certs\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:27.644523 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.644391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgvnp\" (UniqueName: \"kubernetes.io/projected/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-kube-api-access-sgvnp\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:27.644523 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.644452    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-tmp\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:27.745579 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.745544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-tmp\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:27.745760 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.745604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-tls-certs\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:27.745760 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.745649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgvnp\" (UniqueName: \"kubernetes.io/projected/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-kube-api-access-sgvnp\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:27.745843 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:27.745800    2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 20 21:11:27.745901 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:27.745889    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-tls-certs podName:c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab nodeName:}" failed. No retries permitted until 2026-07-20 21:11:28.245863996 +0000 UTC m=+547.998586709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-tls-certs") pod "kube-auth-proxy-5cfcf6b877-65xpm" (UID: "c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab") : secret "kube-auth-proxy-tls" not found
Jul 20 21:11:27.747867 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.747832    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-tmp\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:27.774938 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.774901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgvnp\" (UniqueName: \"kubernetes.io/projected/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-kube-api-access-sgvnp\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:27.822086 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.822037    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9qjrf"]
Jul 20 21:11:27.825456 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.825431    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:27.830048 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.830022    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 20 21:11:27.838990 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.838925    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vs2lx\""
Jul 20 21:11:27.846553 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.846523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4w5t\" (UniqueName: \"kubernetes.io/projected/fcf7b721-1a6e-4a67-b888-22adc66b24cb-kube-api-access-j4w5t\") pod \"odh-model-controller-7998c67dc4-9qjrf\" (UID: \"fcf7b721-1a6e-4a67-b888-22adc66b24cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:27.846703 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.846586    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcf7b721-1a6e-4a67-b888-22adc66b24cb-cert\") pod \"odh-model-controller-7998c67dc4-9qjrf\" (UID: \"fcf7b721-1a6e-4a67-b888-22adc66b24cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:27.848815 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.848780    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9qjrf"]
Jul 20 21:11:27.947671 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.947625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcf7b721-1a6e-4a67-b888-22adc66b24cb-cert\") pod \"odh-model-controller-7998c67dc4-9qjrf\" (UID: \"fcf7b721-1a6e-4a67-b888-22adc66b24cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:27.947935 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.947686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4w5t\" (UniqueName: \"kubernetes.io/projected/fcf7b721-1a6e-4a67-b888-22adc66b24cb-kube-api-access-j4w5t\") pod \"odh-model-controller-7998c67dc4-9qjrf\" (UID: \"fcf7b721-1a6e-4a67-b888-22adc66b24cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:27.947935 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:27.947828    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 20 21:11:27.947935 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:27.947927    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf7b721-1a6e-4a67-b888-22adc66b24cb-cert podName:fcf7b721-1a6e-4a67-b888-22adc66b24cb nodeName:}" failed. No retries permitted until 2026-07-20 21:11:28.447895274 +0000 UTC m=+548.200617989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fcf7b721-1a6e-4a67-b888-22adc66b24cb-cert") pod "odh-model-controller-7998c67dc4-9qjrf" (UID: "fcf7b721-1a6e-4a67-b888-22adc66b24cb") : secret "odh-model-controller-webhook-cert" not found
Jul 20 21:11:27.965843 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:27.965801    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4w5t\" (UniqueName: \"kubernetes.io/projected/fcf7b721-1a6e-4a67-b888-22adc66b24cb-kube-api-access-j4w5t\") pod \"odh-model-controller-7998c67dc4-9qjrf\" (UID: \"fcf7b721-1a6e-4a67-b888-22adc66b24cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:28.249455 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:28.249407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-tls-certs\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:28.252041 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:28.252015    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab-tls-certs\") pod \"kube-auth-proxy-5cfcf6b877-65xpm\" (UID: \"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab\") " pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:28.451150 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:28.451109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcf7b721-1a6e-4a67-b888-22adc66b24cb-cert\") pod \"odh-model-controller-7998c67dc4-9qjrf\" (UID: \"fcf7b721-1a6e-4a67-b888-22adc66b24cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:28.453531 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:28.453499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcf7b721-1a6e-4a67-b888-22adc66b24cb-cert\") pod \"odh-model-controller-7998c67dc4-9qjrf\" (UID: \"fcf7b721-1a6e-4a67-b888-22adc66b24cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:28.505487 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:28.505401    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"
Jul 20 21:11:28.640428 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:28.640397    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm"]
Jul 20 21:11:28.643478 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:11:28.643443    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c102a2_b7b4_4bc3_bd5d_ec93f49cfeab.slice/crio-7430b3822bb7b315948338057f6a0bf150413c83a3878ebbd8c7a86fd19ae85c WatchSource:0}: Error finding container 7430b3822bb7b315948338057f6a0bf150413c83a3878ebbd8c7a86fd19ae85c: Status 404 returned error can't find the container with id 7430b3822bb7b315948338057f6a0bf150413c83a3878ebbd8c7a86fd19ae85c
Jul 20 21:11:28.736239 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:28.736200    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:28.891173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:28.891143    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9qjrf"]
Jul 20 21:11:28.893493 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:11:28.893448    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf7b721_1a6e_4a67_b888_22adc66b24cb.slice/crio-fb025fef0d2723e5af28f17fd223ad84e7a7b115f0952b7c9da2016d7571d90c WatchSource:0}: Error finding container fb025fef0d2723e5af28f17fd223ad84e7a7b115f0952b7c9da2016d7571d90c: Status 404 returned error can't find the container with id fb025fef0d2723e5af28f17fd223ad84e7a7b115f0952b7c9da2016d7571d90c
Jul 20 21:11:29.083742 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.083645    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-brdw7"]
Jul 20 21:11:29.087987 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.087961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:29.092347 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.092321    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4b8lx\""
Jul 20 21:11:29.093357 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.093332    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 20 21:11:29.157605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.157555    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h7dh\" (UniqueName: \"kubernetes.io/projected/eae21af0-a80b-4050-a083-e6ed13e82135-kube-api-access-9h7dh\") pod \"model-serving-api-54d89bd5fc-brdw7\" (UID: \"eae21af0-a80b-4050-a083-e6ed13e82135\") " pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:29.157786 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.157669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae21af0-a80b-4050-a083-e6ed13e82135-tls-certs\") pod \"model-serving-api-54d89bd5fc-brdw7\" (UID: \"eae21af0-a80b-4050-a083-e6ed13e82135\") " pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:29.173491 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.173458    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-brdw7"]
Jul 20 21:11:29.258242 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.258210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae21af0-a80b-4050-a083-e6ed13e82135-tls-certs\") pod \"model-serving-api-54d89bd5fc-brdw7\" (UID: \"eae21af0-a80b-4050-a083-e6ed13e82135\") " pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:29.258435 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.258254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h7dh\" (UniqueName: \"kubernetes.io/projected/eae21af0-a80b-4050-a083-e6ed13e82135-kube-api-access-9h7dh\") pod \"model-serving-api-54d89bd5fc-brdw7\" (UID: \"eae21af0-a80b-4050-a083-e6ed13e82135\") " pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:29.261202 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.261176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae21af0-a80b-4050-a083-e6ed13e82135-tls-certs\") pod \"model-serving-api-54d89bd5fc-brdw7\" (UID: \"eae21af0-a80b-4050-a083-e6ed13e82135\") " pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:29.268189 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.268163    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h7dh\" (UniqueName: \"kubernetes.io/projected/eae21af0-a80b-4050-a083-e6ed13e82135-kube-api-access-9h7dh\") pod \"model-serving-api-54d89bd5fc-brdw7\" (UID: \"eae21af0-a80b-4050-a083-e6ed13e82135\") " pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:29.398176 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.398062    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:29.511292 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.511212    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"]
Jul 20 21:11:29.514847 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.514819    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.518225 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.517899    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 21:11:29.519091 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.518577    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 21:11:29.519091 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.518785    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 21:11:29.519091 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.518933    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 21:11:29.519091 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.518972    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r57pv\""
Jul 20 21:11:29.536302 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.536254    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"]
Jul 20 21:11:29.562062 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.561965    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.562062 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.562004    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-istio-token\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.562062 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.562060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-cacerts\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.562346 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.562115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0be36e4c-d37c-4448-be40-943831253194-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.562346 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.562149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7sp5\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-kube-api-access-c7sp5\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.562346 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.562179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.562346 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.562216    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be36e4c-d37c-4448-be40-943831253194-local-certs\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.567234 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.567158    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-brdw7"]
Jul 20 21:11:29.570807 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:11:29.570762    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae21af0_a80b_4050_a083_e6ed13e82135.slice/crio-1b8abe2736affdef681e63df9babfbfd2d4b0beecbb27600ae2c7aa62ef3f57b WatchSource:0}: Error finding container 1b8abe2736affdef681e63df9babfbfd2d4b0beecbb27600ae2c7aa62ef3f57b: Status 404 returned error can't find the container with id 1b8abe2736affdef681e63df9babfbfd2d4b0beecbb27600ae2c7aa62ef3f57b
Jul 20 21:11:29.653440 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.653322    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm" event={"ID":"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab","Type":"ContainerStarted","Data":"7430b3822bb7b315948338057f6a0bf150413c83a3878ebbd8c7a86fd19ae85c"}
Jul 20 21:11:29.655804 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.655758    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-brdw7" event={"ID":"eae21af0-a80b-4050-a083-e6ed13e82135","Type":"ContainerStarted","Data":"1b8abe2736affdef681e63df9babfbfd2d4b0beecbb27600ae2c7aa62ef3f57b"}
Jul 20 21:11:29.658005 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.657958    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf" event={"ID":"fcf7b721-1a6e-4a67-b888-22adc66b24cb","Type":"ContainerStarted","Data":"fb025fef0d2723e5af28f17fd223ad84e7a7b115f0952b7c9da2016d7571d90c"}
Jul 20 21:11:29.663714 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.663667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.663909 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.663731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-istio-token\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.663909 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.663771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-cacerts\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.663909 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.663810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0be36e4c-d37c-4448-be40-943831253194-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.663909 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.663853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7sp5\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-kube-api-access-c7sp5\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.663909 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.663891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.664342 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.663944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be36e4c-d37c-4448-be40-943831253194-local-certs\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.665193 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.665164    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0be36e4c-d37c-4448-be40-943831253194-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.667934 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.667873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.669621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.669573    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be36e4c-d37c-4448-be40-943831253194-local-certs\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.672092 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.672021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-cacerts\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.673669 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.673629    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.675461 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.675419    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-istio-token\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.676629 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.676588    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7sp5\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-kube-api-access-c7sp5\") pod \"istiod-openshift-gateway-7574459656-g82k6\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:29.837522 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:29.837480    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:30.028851 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:30.028776    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"]
Jul 20 21:11:30.034669 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:11:30.034635    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be36e4c_d37c_4448_be40_943831253194.slice/crio-986282306b7cca9eab31f2c8dec6e70fa88f107ee062b0c20094e634d336f027 WatchSource:0}: Error finding container 986282306b7cca9eab31f2c8dec6e70fa88f107ee062b0c20094e634d336f027: Status 404 returned error can't find the container with id 986282306b7cca9eab31f2c8dec6e70fa88f107ee062b0c20094e634d336f027
Jul 20 21:11:30.672429 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:30.672344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6" event={"ID":"0be36e4c-d37c-4448-be40-943831253194","Type":"ContainerStarted","Data":"986282306b7cca9eab31f2c8dec6e70fa88f107ee062b0c20094e634d336f027"}
Jul 20 21:11:34.357259 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.357209    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:11:34.357627 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.357292    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:11:34.693389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.693289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-brdw7" event={"ID":"eae21af0-a80b-4050-a083-e6ed13e82135","Type":"ContainerStarted","Data":"e2773ff7492bb37d10f709e9021dabe4e556f2a26b55f249964c13ccfbd52a51"}
Jul 20 21:11:34.693389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.693379    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:34.695016 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.694987    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf" event={"ID":"fcf7b721-1a6e-4a67-b888-22adc66b24cb","Type":"ContainerStarted","Data":"ef88e31fa51788bcdef909e86967f600e2e18ebe12aba1da7b5d0654418d5b7a"}
Jul 20 21:11:34.695169 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.695108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:34.696659 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.696633    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6" event={"ID":"0be36e4c-d37c-4448-be40-943831253194","Type":"ContainerStarted","Data":"efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2"}
Jul 20 21:11:34.696774 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.696706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:34.698357 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.698327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm" event={"ID":"c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab","Type":"ContainerStarted","Data":"57a76e03d54c9142ea0cc114b5e3f4bb83a9c9b08acc3a3e3d48d297aac5edb4"}
Jul 20 21:11:34.766762 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.765802    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-brdw7" podStartSLOduration=1.046045037 podStartE2EDuration="5.765781315s" totalImagesPullingTime="4.719736278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:11:34.730286947 +0000 UTC m=+554.483009670" watchObservedRunningTime="2026-07-20 21:11:34.765781315 +0000 UTC m=+554.518504039"
Jul 20 21:11:34.804306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.804240    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cfcf6b877-65xpm" podStartSLOduration=2.161532622 podStartE2EDuration="7.804220203s" totalImagesPullingTime="5.642687581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:11:34.802602807 +0000 UTC m=+554.555325567" watchObservedRunningTime="2026-07-20 21:11:34.804220203 +0000 UTC m=+554.556942927"
Jul 20 21:11:34.804992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.804950    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6" podStartSLOduration=1.485881224 podStartE2EDuration="5.804935743s" totalImagesPullingTime="4.319054519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:11:34.767323897 +0000 UTC m=+554.520046621" watchObservedRunningTime="2026-07-20 21:11:34.804935743 +0000 UTC m=+554.557658467"
Jul 20 21:11:34.827036 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:34.826962    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf" podStartSLOduration=2.433473525 podStartE2EDuration="7.82694309s" totalImagesPullingTime="5.393469565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:11:34.825865806 +0000 UTC m=+554.578588529" watchObservedRunningTime="2026-07-20 21:11:34.82694309 +0000 UTC m=+554.579665807"
Jul 20 21:11:35.706434 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:35.706403    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-g82k6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 21:11:35.706805 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:35.706472    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6" podUID="0be36e4c-d37c-4448-be40-943831253194" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 21:11:38.706155 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:38.706125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:40.051283 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.051243    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"]
Jul 20 21:11:40.054558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.054535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:40.062979 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.062958    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 20 21:11:40.063230 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.063215    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-56hw6\""
Jul 20 21:11:40.076609 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.076040    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"]
Jul 20 21:11:40.082242 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.082198    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"]
Jul 20 21:11:40.082391 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.082308    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:40.088237 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.088210    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4qr7g\""
Jul 20 21:11:40.091353 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.091331    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 20 21:11:40.123371 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.123337    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"]
Jul 20 21:11:40.157741 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.157706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-cert\") pod \"kserve-controller-manager-d6f4b65b8-vk2k8\" (UID: \"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:40.157741 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.157744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de27a5fc-d80a-46f1-830f-da9f5911bae7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jchd8\" (UID: \"de27a5fc-d80a-46f1-830f-da9f5911bae7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:40.157964 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.157765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfpnz\" (UniqueName: \"kubernetes.io/projected/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-kube-api-access-qfpnz\") pod \"kserve-controller-manager-d6f4b65b8-vk2k8\" (UID: \"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:40.157964 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.157838    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fww98\" (UniqueName: \"kubernetes.io/projected/de27a5fc-d80a-46f1-830f-da9f5911bae7-kube-api-access-fww98\") pod \"llmisvc-controller-manager-777c6bd7d5-jchd8\" (UID: \"de27a5fc-d80a-46f1-830f-da9f5911bae7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:40.258399 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.258358    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-cert\") pod \"kserve-controller-manager-d6f4b65b8-vk2k8\" (UID: \"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:40.258399 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.258405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de27a5fc-d80a-46f1-830f-da9f5911bae7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jchd8\" (UID: \"de27a5fc-d80a-46f1-830f-da9f5911bae7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:40.258664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.258426    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfpnz\" (UniqueName: \"kubernetes.io/projected/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-kube-api-access-qfpnz\") pod \"kserve-controller-manager-d6f4b65b8-vk2k8\" (UID: \"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:40.258664 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:40.258511    2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 20 21:11:40.258664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.258553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww98\" (UniqueName: \"kubernetes.io/projected/de27a5fc-d80a-46f1-830f-da9f5911bae7-kube-api-access-fww98\") pod \"llmisvc-controller-manager-777c6bd7d5-jchd8\" (UID: \"de27a5fc-d80a-46f1-830f-da9f5911bae7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:40.258664 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:40.258573    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-cert podName:34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae nodeName:}" failed. No retries permitted until 2026-07-20 21:11:40.758556222 +0000 UTC m=+560.511278925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-cert") pod "kserve-controller-manager-d6f4b65b8-vk2k8" (UID: "34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae") : secret "kserve-webhook-server-cert" not found
Jul 20 21:11:40.258664 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:40.258520    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 20 21:11:40.258664 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:40.258665    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de27a5fc-d80a-46f1-830f-da9f5911bae7-cert podName:de27a5fc-d80a-46f1-830f-da9f5911bae7 nodeName:}" failed. No retries permitted until 2026-07-20 21:11:40.758651037 +0000 UTC m=+560.511373738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de27a5fc-d80a-46f1-830f-da9f5911bae7-cert") pod "llmisvc-controller-manager-777c6bd7d5-jchd8" (UID: "de27a5fc-d80a-46f1-830f-da9f5911bae7") : secret "llmisvc-webhook-server-cert" not found
Jul 20 21:11:40.271196 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.271172    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfpnz\" (UniqueName: \"kubernetes.io/projected/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-kube-api-access-qfpnz\") pod \"kserve-controller-manager-d6f4b65b8-vk2k8\" (UID: \"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:40.273397 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.273381    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fww98\" (UniqueName: \"kubernetes.io/projected/de27a5fc-d80a-46f1-830f-da9f5911bae7-kube-api-access-fww98\") pod \"llmisvc-controller-manager-777c6bd7d5-jchd8\" (UID: \"de27a5fc-d80a-46f1-830f-da9f5911bae7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:40.763022 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.762986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-cert\") pod \"kserve-controller-manager-d6f4b65b8-vk2k8\" (UID: \"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:40.763022 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.763028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de27a5fc-d80a-46f1-830f-da9f5911bae7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jchd8\" (UID: \"de27a5fc-d80a-46f1-830f-da9f5911bae7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:40.763279 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:40.763171    2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 20 21:11:40.763279 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:40.763245    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-cert podName:34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae nodeName:}" failed. No retries permitted until 2026-07-20 21:11:41.76322951 +0000 UTC m=+561.515952211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-cert") pod "kserve-controller-manager-d6f4b65b8-vk2k8" (UID: "34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae") : secret "kserve-webhook-server-cert" not found
Jul 20 21:11:40.765631 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.765607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de27a5fc-d80a-46f1-830f-da9f5911bae7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jchd8\" (UID: \"de27a5fc-d80a-46f1-830f-da9f5911bae7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:40.993175 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:40.993137    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:41.144753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:41.144714    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"]
Jul 20 21:11:41.148989 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:11:41.148962    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podde27a5fc_d80a_46f1_830f_da9f5911bae7.slice/crio-bddbc8a014702cae28f984331e27eaa7bc8446b6913f75f52fd52b88932e5459 WatchSource:0}: Error finding container bddbc8a014702cae28f984331e27eaa7bc8446b6913f75f52fd52b88932e5459: Status 404 returned error can't find the container with id bddbc8a014702cae28f984331e27eaa7bc8446b6913f75f52fd52b88932e5459
Jul 20 21:11:41.730224 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:41.730187    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8" event={"ID":"de27a5fc-d80a-46f1-830f-da9f5911bae7","Type":"ContainerStarted","Data":"bddbc8a014702cae28f984331e27eaa7bc8446b6913f75f52fd52b88932e5459"}
Jul 20 21:11:41.772819 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:41.772784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-cert\") pod \"kserve-controller-manager-d6f4b65b8-vk2k8\" (UID: \"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:41.775215 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:41.775190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae-cert\") pod \"kserve-controller-manager-d6f4b65b8-vk2k8\" (UID: \"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:41.864334 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:41.864293    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:42.021374 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:42.021266    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"]
Jul 20 21:11:42.023992 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:11:42.023961    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34bbd3d9_eb63_4d5f_a9fd_e8d4665029ae.slice/crio-ed15a9b03d324e37e2410185c42edb81ab04a95239f92be38b2fc59598302021 WatchSource:0}: Error finding container ed15a9b03d324e37e2410185c42edb81ab04a95239f92be38b2fc59598302021: Status 404 returned error can't find the container with id ed15a9b03d324e37e2410185c42edb81ab04a95239f92be38b2fc59598302021
Jul 20 21:11:42.736782 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:42.736750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8" event={"ID":"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae","Type":"ContainerStarted","Data":"ed15a9b03d324e37e2410185c42edb81ab04a95239f92be38b2fc59598302021"}
Jul 20 21:11:42.895687 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:42.895652    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"]
Jul 20 21:11:42.895884 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:42.895852    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6" podUID="0be36e4c-d37c-4448-be40-943831253194" containerName="discovery" containerID="cri-o://efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2" gracePeriod=30
Jul 20 21:11:43.183772 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.183742    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:43.285152 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.285047    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0be36e4c-d37c-4448-be40-943831253194-istio-csr-ca-configmap\") pod \"0be36e4c-d37c-4448-be40-943831253194\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") "
Jul 20 21:11:43.285152 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.285124    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-kubeconfig\") pod \"0be36e4c-d37c-4448-be40-943831253194\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") "
Jul 20 21:11:43.285389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.285158    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7sp5\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-kube-api-access-c7sp5\") pod \"0be36e4c-d37c-4448-be40-943831253194\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") "
Jul 20 21:11:43.285389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.285198    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-csr-dns-cert\") pod \"0be36e4c-d37c-4448-be40-943831253194\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") "
Jul 20 21:11:43.285389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.285256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-cacerts\") pod \"0be36e4c-d37c-4448-be40-943831253194\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") "
Jul 20 21:11:43.285389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.285275    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-istio-token\") pod \"0be36e4c-d37c-4448-be40-943831253194\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") "
Jul 20 21:11:43.285389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.285295    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be36e4c-d37c-4448-be40-943831253194-local-certs\") pod \"0be36e4c-d37c-4448-be40-943831253194\" (UID: \"0be36e4c-d37c-4448-be40-943831253194\") "
Jul 20 21:11:43.285646 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.285572    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0be36e4c-d37c-4448-be40-943831253194-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0be36e4c-d37c-4448-be40-943831253194" (UID: "0be36e4c-d37c-4448-be40-943831253194"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:11:43.288144 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.288115    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-cacerts" (OuterVolumeSpecName: "cacerts") pod "0be36e4c-d37c-4448-be40-943831253194" (UID: "0be36e4c-d37c-4448-be40-943831253194"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:11:43.288281 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.288147    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0be36e4c-d37c-4448-be40-943831253194" (UID: "0be36e4c-d37c-4448-be40-943831253194"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:11:43.288356 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.288332    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be36e4c-d37c-4448-be40-943831253194-local-certs" (OuterVolumeSpecName: "local-certs") pod "0be36e4c-d37c-4448-be40-943831253194" (UID: "0be36e4c-d37c-4448-be40-943831253194"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:11:43.288395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.288351    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-kube-api-access-c7sp5" (OuterVolumeSpecName: "kube-api-access-c7sp5") pod "0be36e4c-d37c-4448-be40-943831253194" (UID: "0be36e4c-d37c-4448-be40-943831253194"). InnerVolumeSpecName "kube-api-access-c7sp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:11:43.288455 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.288431    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-istio-token" (OuterVolumeSpecName: "istio-token") pod "0be36e4c-d37c-4448-be40-943831253194" (UID: "0be36e4c-d37c-4448-be40-943831253194"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:11:43.288502 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.288475    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0be36e4c-d37c-4448-be40-943831253194" (UID: "0be36e4c-d37c-4448-be40-943831253194"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:11:43.386705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.386665    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-csr-dns-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:11:43.386705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.386702    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-cacerts\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:11:43.386969 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.386716    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:11:43.386969 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.386732    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be36e4c-d37c-4448-be40-943831253194-local-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:11:43.386969 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.386745    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0be36e4c-d37c-4448-be40-943831253194-istio-csr-ca-configmap\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:11:43.386969 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.386757    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0be36e4c-d37c-4448-be40-943831253194-istio-kubeconfig\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:11:43.386969 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.386777    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7sp5\" (UniqueName: \"kubernetes.io/projected/0be36e4c-d37c-4448-be40-943831253194-kube-api-access-c7sp5\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:11:43.746287 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.746243    2573 generic.go:356] "Generic (PLEG): container finished" podID="0be36e4c-d37c-4448-be40-943831253194" containerID="efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2" exitCode=0
Jul 20 21:11:43.746745 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.746300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6" event={"ID":"0be36e4c-d37c-4448-be40-943831253194","Type":"ContainerDied","Data":"efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2"}
Jul 20 21:11:43.746745 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.746342    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"
Jul 20 21:11:43.746745 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.746627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g82k6" event={"ID":"0be36e4c-d37c-4448-be40-943831253194","Type":"ContainerDied","Data":"986282306b7cca9eab31f2c8dec6e70fa88f107ee062b0c20094e634d336f027"}
Jul 20 21:11:43.747953 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.746675    2573 scope.go:117] "RemoveContainer" containerID="efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2"
Jul 20 21:11:43.786571 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.786537    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"]
Jul 20 21:11:43.791605 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:43.791578    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g82k6"]
Jul 20 21:11:44.153460 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:44.153117    2573 scope.go:117] "RemoveContainer" containerID="efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2"
Jul 20 21:11:44.153517 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:11:44.153465    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2\": container with ID starting with efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2 not found: ID does not exist" containerID="efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2"
Jul 20 21:11:44.153517 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:44.153492    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2"} err="failed to get container status \"efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2\": rpc error: code = NotFound desc = could not find container \"efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2\": container with ID starting with efed7081301bfccd124c093d5a7c6fcad4678d985ba6df70c46cd695a8e96bb2 not found: ID does not exist"
Jul 20 21:11:44.754623 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:44.754586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8" event={"ID":"de27a5fc-d80a-46f1-830f-da9f5911bae7","Type":"ContainerStarted","Data":"35e260831aa79677f88b30c3e420c8da2677dc90cbdd5bcf60eb35644df3ec49"}
Jul 20 21:11:44.755106 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:44.754732    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:11:44.770905 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:44.770865    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0be36e4c-d37c-4448-be40-943831253194" path="/var/lib/kubelet/pods/0be36e4c-d37c-4448-be40-943831253194/volumes"
Jul 20 21:11:44.786930 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:44.786869    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8" podStartSLOduration=1.733067382 podStartE2EDuration="4.786849897s" totalImagesPullingTime="3.053782515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:11:44.786293305 +0000 UTC m=+564.539016028" watchObservedRunningTime="2026-07-20 21:11:44.786849897 +0000 UTC m=+564.539572623"
Jul 20 21:11:45.706971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:45.706945    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9qjrf"
Jul 20 21:11:45.708794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:45.708767    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-brdw7"
Jul 20 21:11:45.761861 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:45.761825    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8" event={"ID":"34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae","Type":"ContainerStarted","Data":"e446891e8fbca1716484d5945de243b17329d8819cc9a836af81d5b303813e92"}
Jul 20 21:11:45.762377 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:45.762352    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:11:45.782715 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:11:45.782662    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8" podStartSLOduration=2.6144300940000003 podStartE2EDuration="5.782643126s" totalImagesPullingTime="3.168213032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:11:45.782047066 +0000 UTC m=+565.534769789" watchObservedRunningTime="2026-07-20 21:11:45.782643126 +0000 UTC m=+565.535365850"
Jul 20 21:12:15.763864 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:15.763837    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jchd8"
Jul 20 21:12:17.776982 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:17.776954    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vk2k8"
Jul 20 21:12:20.893704 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:20.893590    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:12:20.898460 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:20.894573    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:12:28.943570 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:28.943539    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzqr7"]
Jul 20 21:12:28.943979 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:28.943920    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be36e4c-d37c-4448-be40-943831253194" containerName="discovery"
Jul 20 21:12:28.943979 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:28.943939    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be36e4c-d37c-4448-be40-943831253194" containerName="discovery"
Jul 20 21:12:28.944094 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:28.944015    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be36e4c-d37c-4448-be40-943831253194" containerName="discovery"
Jul 20 21:12:28.946058 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:28.946031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7"
Jul 20 21:12:28.948877 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:28.948854    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 21:12:28.950229 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:28.950207    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 21:12:28.950356 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:28.950207    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rts8d\""
Jul 20 21:12:28.957770 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:28.957743    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzqr7"]
Jul 20 21:12:29.040872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.040827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zft75\" (UniqueName: \"kubernetes.io/projected/4813b8a2-1463-46f0-b371-c66064e786b7-kube-api-access-zft75\") pod \"kuadrant-operator-catalog-kzqr7\" (UID: \"4813b8a2-1463-46f0-b371-c66064e786b7\") " pod="kuadrant-system/kuadrant-operator-catalog-kzqr7"
Jul 20 21:12:29.142127 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.142068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zft75\" (UniqueName: \"kubernetes.io/projected/4813b8a2-1463-46f0-b371-c66064e786b7-kube-api-access-zft75\") pod \"kuadrant-operator-catalog-kzqr7\" (UID: \"4813b8a2-1463-46f0-b371-c66064e786b7\") " pod="kuadrant-system/kuadrant-operator-catalog-kzqr7"
Jul 20 21:12:29.153184 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.153160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zft75\" (UniqueName: \"kubernetes.io/projected/4813b8a2-1463-46f0-b371-c66064e786b7-kube-api-access-zft75\") pod \"kuadrant-operator-catalog-kzqr7\" (UID: \"4813b8a2-1463-46f0-b371-c66064e786b7\") " pod="kuadrant-system/kuadrant-operator-catalog-kzqr7"
Jul 20 21:12:29.258387 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.258341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7"
Jul 20 21:12:29.270617 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.270577    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzqr7"]
Jul 20 21:12:29.388897 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.388826    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzqr7"]
Jul 20 21:12:29.392864 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:12:29.392837    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4813b8a2_1463_46f0_b371_c66064e786b7.slice/crio-bc040ff765d0c495ac015055ab27ad09cbc7fb9bbe604887d326a5f7d4d3b2f6 WatchSource:0}: Error finding container bc040ff765d0c495ac015055ab27ad09cbc7fb9bbe604887d326a5f7d4d3b2f6: Status 404 returned error can't find the container with id bc040ff765d0c495ac015055ab27ad09cbc7fb9bbe604887d326a5f7d4d3b2f6
Jul 20 21:12:29.477349 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.477312    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjlnq"]
Jul 20 21:12:29.480329 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.480313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjlnq"
Jul 20 21:12:29.491293 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.491270    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjlnq"]
Jul 20 21:12:29.545953 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.545873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q88c\" (UniqueName: \"kubernetes.io/projected/b762ff94-d294-42da-9658-d10bf9a8c3df-kube-api-access-5q88c\") pod \"kuadrant-operator-catalog-qjlnq\" (UID: \"b762ff94-d294-42da-9658-d10bf9a8c3df\") " pod="kuadrant-system/kuadrant-operator-catalog-qjlnq"
Jul 20 21:12:29.646916 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.646864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q88c\" (UniqueName: \"kubernetes.io/projected/b762ff94-d294-42da-9658-d10bf9a8c3df-kube-api-access-5q88c\") pod \"kuadrant-operator-catalog-qjlnq\" (UID: \"b762ff94-d294-42da-9658-d10bf9a8c3df\") " pod="kuadrant-system/kuadrant-operator-catalog-qjlnq"
Jul 20 21:12:29.656502 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.656469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q88c\" (UniqueName: \"kubernetes.io/projected/b762ff94-d294-42da-9658-d10bf9a8c3df-kube-api-access-5q88c\") pod \"kuadrant-operator-catalog-qjlnq\" (UID: \"b762ff94-d294-42da-9658-d10bf9a8c3df\") " pod="kuadrant-system/kuadrant-operator-catalog-qjlnq"
Jul 20 21:12:29.789634 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.789597    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjlnq"
Jul 20 21:12:29.936340 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.936308    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjlnq"]
Jul 20 21:12:29.940235 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:12:29.940060    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb762ff94_d294_42da_9658_d10bf9a8c3df.slice/crio-f2af8d0bb61f0df677040c3ae418def09503235740f1ba161f08f7057db4a497 WatchSource:0}: Error finding container f2af8d0bb61f0df677040c3ae418def09503235740f1ba161f08f7057db4a497: Status 404 returned error can't find the container with id f2af8d0bb61f0df677040c3ae418def09503235740f1ba161f08f7057db4a497
Jul 20 21:12:29.941900 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.941881    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 21:12:29.953764 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.953734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjlnq" event={"ID":"b762ff94-d294-42da-9658-d10bf9a8c3df","Type":"ContainerStarted","Data":"f2af8d0bb61f0df677040c3ae418def09503235740f1ba161f08f7057db4a497"}
Jul 20 21:12:29.954836 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:29.954811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7" event={"ID":"4813b8a2-1463-46f0-b371-c66064e786b7","Type":"ContainerStarted","Data":"bc040ff765d0c495ac015055ab27ad09cbc7fb9bbe604887d326a5f7d4d3b2f6"}
Jul 20 21:12:31.966374 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:31.966266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjlnq" event={"ID":"b762ff94-d294-42da-9658-d10bf9a8c3df","Type":"ContainerStarted","Data":"318889f7d016be0de7d752bda226ef2d341a391f45cb59cfcb1606b7e136988a"}
Jul 20 21:12:31.967691 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:31.967665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7" event={"ID":"4813b8a2-1463-46f0-b371-c66064e786b7","Type":"ContainerStarted","Data":"c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7"}
Jul 20 21:12:31.967816 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:31.967731    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7" podUID="4813b8a2-1463-46f0-b371-c66064e786b7" containerName="registry-server" containerID="cri-o://c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7" gracePeriod=2
Jul 20 21:12:31.984090 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:31.984020    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qjlnq" podStartSLOduration=1.429820337 podStartE2EDuration="2.984000739s" totalImagesPullingTime="1.554180402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:12:31.98382936 +0000 UTC m=+611.736552099" watchObservedRunningTime="2026-07-20 21:12:31.984000739 +0000 UTC m=+611.736723463"
Jul 20 21:12:32.001292 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.001238    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7" podStartSLOduration=1.901930814 podStartE2EDuration="4.001221725s" totalImagesPullingTime="2.099290911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:12:32.000486121 +0000 UTC m=+611.753208878" watchObservedRunningTime="2026-07-20 21:12:32.001221725 +0000 UTC m=+611.753944479"
Jul 20 21:12:32.209778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.209754    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7"
Jul 20 21:12:32.266165 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.266114    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zft75\" (UniqueName: \"kubernetes.io/projected/4813b8a2-1463-46f0-b371-c66064e786b7-kube-api-access-zft75\") pod \"4813b8a2-1463-46f0-b371-c66064e786b7\" (UID: \"4813b8a2-1463-46f0-b371-c66064e786b7\") "
Jul 20 21:12:32.268253 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.268228    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4813b8a2-1463-46f0-b371-c66064e786b7-kube-api-access-zft75" (OuterVolumeSpecName: "kube-api-access-zft75") pod "4813b8a2-1463-46f0-b371-c66064e786b7" (UID: "4813b8a2-1463-46f0-b371-c66064e786b7"). InnerVolumeSpecName "kube-api-access-zft75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:12:32.366772 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.366733    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zft75\" (UniqueName: \"kubernetes.io/projected/4813b8a2-1463-46f0-b371-c66064e786b7-kube-api-access-zft75\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:32.973184 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.973151    2573 generic.go:356] "Generic (PLEG): container finished" podID="4813b8a2-1463-46f0-b371-c66064e786b7" containerID="c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7" exitCode=0
Jul 20 21:12:32.973578 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.973191    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7"
Jul 20 21:12:32.973578 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.973234    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7" event={"ID":"4813b8a2-1463-46f0-b371-c66064e786b7","Type":"ContainerDied","Data":"c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7"}
Jul 20 21:12:32.973578 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.973281    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzqr7" event={"ID":"4813b8a2-1463-46f0-b371-c66064e786b7","Type":"ContainerDied","Data":"bc040ff765d0c495ac015055ab27ad09cbc7fb9bbe604887d326a5f7d4d3b2f6"}
Jul 20 21:12:32.973578 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.973303    2573 scope.go:117] "RemoveContainer" containerID="c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7"
Jul 20 21:12:32.982779 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.982755    2573 scope.go:117] "RemoveContainer" containerID="c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7"
Jul 20 21:12:32.983107 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:12:32.983065    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7\": container with ID starting with c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7 not found: ID does not exist" containerID="c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7"
Jul 20 21:12:32.983189 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.983119    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7"} err="failed to get container status \"c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7\": rpc error: code = NotFound desc = could not find container \"c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7\": container with ID starting with c6c89cc5b76552e41b6431b8c4ef6890e1a786c7bfaf88fa9c6bc4848f4d9ca7 not found: ID does not exist"
Jul 20 21:12:32.991173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.991143    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzqr7"]
Jul 20 21:12:32.995169 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:32.995144    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzqr7"]
Jul 20 21:12:34.769210 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:34.769180    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4813b8a2-1463-46f0-b371-c66064e786b7" path="/var/lib/kubelet/pods/4813b8a2-1463-46f0-b371-c66064e786b7/volumes"
Jul 20 21:12:39.790273 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:39.790216    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qjlnq"
Jul 20 21:12:39.790273 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:39.790288    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qjlnq"
Jul 20 21:12:39.812861 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:39.812825    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qjlnq"
Jul 20 21:12:40.025446 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:40.025417    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qjlnq"
Jul 20 21:12:46.920118 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.920004    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"]
Jul 20 21:12:46.920994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.920456    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4813b8a2-1463-46f0-b371-c66064e786b7" containerName="registry-server"
Jul 20 21:12:46.920994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.920477    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4813b8a2-1463-46f0-b371-c66064e786b7" containerName="registry-server"
Jul 20 21:12:46.920994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.920548    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4813b8a2-1463-46f0-b371-c66064e786b7" containerName="registry-server"
Jul 20 21:12:46.923855 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.923832    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:46.927203 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.927185    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7cj5x\""
Jul 20 21:12:46.932972 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.932946    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"]
Jul 20 21:12:46.980324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.980281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:46.980324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.980328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:46.980565 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:46.980460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td4zv\" (UniqueName: \"kubernetes.io/projected/531926dd-bb37-4d0c-9724-f72d41c69a4d-kube-api-access-td4zv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:47.081021 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.080981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td4zv\" (UniqueName: \"kubernetes.io/projected/531926dd-bb37-4d0c-9724-f72d41c69a4d-kube-api-access-td4zv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:47.081021 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.081025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:47.081290 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.081049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:47.081517 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.081493    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:47.081559 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.081504    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:47.090844 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.090808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td4zv\" (UniqueName: \"kubernetes.io/projected/531926dd-bb37-4d0c-9724-f72d41c69a4d-kube-api-access-td4zv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:47.233777 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.233745    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:47.316406 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.316043    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"]
Jul 20 21:12:47.325819 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.325784    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.328358 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.328294    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"]
Jul 20 21:12:47.378830 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.378791    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"]
Jul 20 21:12:47.382108 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:12:47.382063    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531926dd_bb37_4d0c_9724_f72d41c69a4d.slice/crio-587556afaab2d383b820c722143f1bbc94dcb008a1ee7500c8a9809ad13a155e WatchSource:0}: Error finding container 587556afaab2d383b820c722143f1bbc94dcb008a1ee7500c8a9809ad13a155e: Status 404 returned error can't find the container with id 587556afaab2d383b820c722143f1bbc94dcb008a1ee7500c8a9809ad13a155e
Jul 20 21:12:47.383679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.383606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.383679 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.383654    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.383807 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.383720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4df2d\" (UniqueName: \"kubernetes.io/projected/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-kube-api-access-4df2d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.484209 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.484144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.484209 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.484191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.484380 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.484313    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4df2d\" (UniqueName: \"kubernetes.io/projected/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-kube-api-access-4df2d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.484535 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.484517    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.484568 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.484527    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.493583 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.493560    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4df2d\" (UniqueName: \"kubernetes.io/projected/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-kube-api-access-4df2d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.637710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.637681    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:47.716857 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.716820    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"]
Jul 20 21:12:47.721825 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.721797    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:47.730237 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.730087    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"]
Jul 20 21:12:47.774149 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.774123    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"]
Jul 20 21:12:47.776612 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:12:47.776582    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19a7fc0_c7ab_4e93_8fe9_72cdeb4169df.slice/crio-5601a7ba71eed63dd8a2fd200b06e7adab4aa75d9bc9611cd4111256b6e1e1d1 WatchSource:0}: Error finding container 5601a7ba71eed63dd8a2fd200b06e7adab4aa75d9bc9611cd4111256b6e1e1d1: Status 404 returned error can't find the container with id 5601a7ba71eed63dd8a2fd200b06e7adab4aa75d9bc9611cd4111256b6e1e1d1
Jul 20 21:12:47.786749 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.786728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp9dg\" (UniqueName: \"kubernetes.io/projected/93690712-178f-45b2-8bbe-109fd1d83400-kube-api-access-dp9dg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:47.786814 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.786771    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:47.786814 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.786800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:47.887940 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.887908    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:47.888146 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.887977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp9dg\" (UniqueName: \"kubernetes.io/projected/93690712-178f-45b2-8bbe-109fd1d83400-kube-api-access-dp9dg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:47.888146 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.888063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:47.888374 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.888348    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:47.888428 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.888394    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:47.898014 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:47.897992    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp9dg\" (UniqueName: \"kubernetes.io/projected/93690712-178f-45b2-8bbe-109fd1d83400-kube-api-access-dp9dg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:48.034504 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.034422    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:48.042098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.042054    2573 generic.go:356] "Generic (PLEG): container finished" podID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerID="ba1f7eebc981790c65cf70f589218f5e855b2ea0176f9474299534ca0dcf7359" exitCode=0
Jul 20 21:12:48.042248 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.042121    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd" event={"ID":"531926dd-bb37-4d0c-9724-f72d41c69a4d","Type":"ContainerDied","Data":"ba1f7eebc981790c65cf70f589218f5e855b2ea0176f9474299534ca0dcf7359"}
Jul 20 21:12:48.042248 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.042171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd" event={"ID":"531926dd-bb37-4d0c-9724-f72d41c69a4d","Type":"ContainerStarted","Data":"587556afaab2d383b820c722143f1bbc94dcb008a1ee7500c8a9809ad13a155e"}
Jul 20 21:12:48.043759 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.043727    2573 generic.go:356] "Generic (PLEG): container finished" podID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerID="0965453147fba8633612fd783bc139d9837bb9b837f5380b705bef6ad4a82dbc" exitCode=0
Jul 20 21:12:48.043850 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.043779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw" event={"ID":"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df","Type":"ContainerDied","Data":"0965453147fba8633612fd783bc139d9837bb9b837f5380b705bef6ad4a82dbc"}
Jul 20 21:12:48.043850 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.043810    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw" event={"ID":"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df","Type":"ContainerStarted","Data":"5601a7ba71eed63dd8a2fd200b06e7adab4aa75d9bc9611cd4111256b6e1e1d1"}
Jul 20 21:12:48.120141 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.120107    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"]
Jul 20 21:12:48.124968 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.124942    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.133996 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.133963    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"]
Jul 20 21:12:48.176401 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.176373    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"]
Jul 20 21:12:48.178628 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:12:48.178594    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93690712_178f_45b2_8bbe_109fd1d83400.slice/crio-a553cc526b796566a68d26115acc0165d2c91ecdb498ec39deeb031f64cfd53c WatchSource:0}: Error finding container a553cc526b796566a68d26115acc0165d2c91ecdb498ec39deeb031f64cfd53c: Status 404 returned error can't find the container with id a553cc526b796566a68d26115acc0165d2c91ecdb498ec39deeb031f64cfd53c
Jul 20 21:12:48.191166 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.191125    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjfxl\" (UniqueName: \"kubernetes.io/projected/09405bd6-8305-4b21-b8c8-09702bb62603-kube-api-access-bjfxl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.191166 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.191161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.191361 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.191178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.291929 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.291893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjfxl\" (UniqueName: \"kubernetes.io/projected/09405bd6-8305-4b21-b8c8-09702bb62603-kube-api-access-bjfxl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.292027 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.291941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.292027 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.291956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.292277 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.292259    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.292316 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.292292    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.302259 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.302235    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjfxl\" (UniqueName: \"kubernetes.io/projected/09405bd6-8305-4b21-b8c8-09702bb62603-kube-api-access-bjfxl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.437222 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.437177    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:48.572058 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:48.572034    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"]
Jul 20 21:12:48.574029 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:12:48.573989    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09405bd6_8305_4b21_b8c8_09702bb62603.slice/crio-f85c82436887b76e8ac5570adb1448fc83412587b3a9beb969e7db8132274704 WatchSource:0}: Error finding container f85c82436887b76e8ac5570adb1448fc83412587b3a9beb969e7db8132274704: Status 404 returned error can't find the container with id f85c82436887b76e8ac5570adb1448fc83412587b3a9beb969e7db8132274704
Jul 20 21:12:49.051377 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:49.051351    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd" event={"ID":"531926dd-bb37-4d0c-9724-f72d41c69a4d","Type":"ContainerStarted","Data":"f3e5f43180a2f40788a9f66c4e64bad249146252418fc67764243eb148d3191b"}
Jul 20 21:12:49.053533 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:49.053506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw" event={"ID":"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df","Type":"ContainerStarted","Data":"8cdd05700a0da1b8793b25f69a6c9ec8c5d30acf0f2c33339f0cd2db476c7ca4"}
Jul 20 21:12:49.055136 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:49.055096    2573 generic.go:356] "Generic (PLEG): container finished" podID="09405bd6-8305-4b21-b8c8-09702bb62603" containerID="0a0c702979e59ec8df1fa47223e6bcce01f2cc1716e92dad2a36d384e5ed510f" exitCode=0
Jul 20 21:12:49.055248 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:49.055176    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285" event={"ID":"09405bd6-8305-4b21-b8c8-09702bb62603","Type":"ContainerDied","Data":"0a0c702979e59ec8df1fa47223e6bcce01f2cc1716e92dad2a36d384e5ed510f"}
Jul 20 21:12:49.055248 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:49.055215    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285" event={"ID":"09405bd6-8305-4b21-b8c8-09702bb62603","Type":"ContainerStarted","Data":"f85c82436887b76e8ac5570adb1448fc83412587b3a9beb969e7db8132274704"}
Jul 20 21:12:49.057052 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:49.057023    2573 generic.go:356] "Generic (PLEG): container finished" podID="93690712-178f-45b2-8bbe-109fd1d83400" containerID="7a0537bae62411e09a3aa305923b6c72d6fef159a554ac3bf0892e555882eb11" exitCode=0
Jul 20 21:12:49.057225 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:49.057104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv" event={"ID":"93690712-178f-45b2-8bbe-109fd1d83400","Type":"ContainerDied","Data":"7a0537bae62411e09a3aa305923b6c72d6fef159a554ac3bf0892e555882eb11"}
Jul 20 21:12:49.057225 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:49.057161    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv" event={"ID":"93690712-178f-45b2-8bbe-109fd1d83400","Type":"ContainerStarted","Data":"a553cc526b796566a68d26115acc0165d2c91ecdb498ec39deeb031f64cfd53c"}
Jul 20 21:12:50.065807 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:50.065768    2573 generic.go:356] "Generic (PLEG): container finished" podID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerID="f3e5f43180a2f40788a9f66c4e64bad249146252418fc67764243eb148d3191b" exitCode=0
Jul 20 21:12:50.066276 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:50.065854    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd" event={"ID":"531926dd-bb37-4d0c-9724-f72d41c69a4d","Type":"ContainerDied","Data":"f3e5f43180a2f40788a9f66c4e64bad249146252418fc67764243eb148d3191b"}
Jul 20 21:12:50.068144 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:50.068118    2573 generic.go:356] "Generic (PLEG): container finished" podID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerID="8cdd05700a0da1b8793b25f69a6c9ec8c5d30acf0f2c33339f0cd2db476c7ca4" exitCode=0
Jul 20 21:12:50.068272 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:50.068205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw" event={"ID":"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df","Type":"ContainerDied","Data":"8cdd05700a0da1b8793b25f69a6c9ec8c5d30acf0f2c33339f0cd2db476c7ca4"}
Jul 20 21:12:50.070332 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:50.070306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285" event={"ID":"09405bd6-8305-4b21-b8c8-09702bb62603","Type":"ContainerStarted","Data":"cb6a543650990207ca00bacc6afb1589ce31a5d990bdecc74163b7f28d272567"}
Jul 20 21:12:50.072478 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:50.072455    2573 generic.go:356] "Generic (PLEG): container finished" podID="93690712-178f-45b2-8bbe-109fd1d83400" containerID="6e5a4eefd6496a0aa02997e644dc300d52be99bf9e29900256d3e754451c4215" exitCode=0
Jul 20 21:12:50.072546 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:50.072495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv" event={"ID":"93690712-178f-45b2-8bbe-109fd1d83400","Type":"ContainerDied","Data":"6e5a4eefd6496a0aa02997e644dc300d52be99bf9e29900256d3e754451c4215"}
Jul 20 21:12:51.079302 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:51.079265    2573 generic.go:356] "Generic (PLEG): container finished" podID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerID="fd1315d9c0b3def3aba375a52ff91b399d3649193f4a2430c799b17228d41730" exitCode=0
Jul 20 21:12:51.079769 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:51.079343    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw" event={"ID":"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df","Type":"ContainerDied","Data":"fd1315d9c0b3def3aba375a52ff91b399d3649193f4a2430c799b17228d41730"}
Jul 20 21:12:51.081117 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:51.081090    2573 generic.go:356] "Generic (PLEG): container finished" podID="09405bd6-8305-4b21-b8c8-09702bb62603" containerID="cb6a543650990207ca00bacc6afb1589ce31a5d990bdecc74163b7f28d272567" exitCode=0
Jul 20 21:12:51.081226 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:51.081154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285" event={"ID":"09405bd6-8305-4b21-b8c8-09702bb62603","Type":"ContainerDied","Data":"cb6a543650990207ca00bacc6afb1589ce31a5d990bdecc74163b7f28d272567"}
Jul 20 21:12:51.083415 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:51.083391    2573 generic.go:356] "Generic (PLEG): container finished" podID="93690712-178f-45b2-8bbe-109fd1d83400" containerID="dfe17d40da059b5c1c064e827f2b5254a84fa2cefc1531a2616d50a549f373af" exitCode=0
Jul 20 21:12:51.083512 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:51.083445    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv" event={"ID":"93690712-178f-45b2-8bbe-109fd1d83400","Type":"ContainerDied","Data":"dfe17d40da059b5c1c064e827f2b5254a84fa2cefc1531a2616d50a549f373af"}
Jul 20 21:12:51.085564 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:51.085542    2573 generic.go:356] "Generic (PLEG): container finished" podID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerID="bee62b1843286c4d5d21468378a6b35bac3f78f76848827994ab5d74f4b2d4ba" exitCode=0
Jul 20 21:12:51.085645 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:51.085622    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd" event={"ID":"531926dd-bb37-4d0c-9724-f72d41c69a4d","Type":"ContainerDied","Data":"bee62b1843286c4d5d21468378a6b35bac3f78f76848827994ab5d74f4b2d4ba"}
Jul 20 21:12:52.092109 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.092054    2573 generic.go:356] "Generic (PLEG): container finished" podID="09405bd6-8305-4b21-b8c8-09702bb62603" containerID="a964663cab1e6f35fdc7a926751126eb11f79f10592ad38d22de7f443215a70e" exitCode=0
Jul 20 21:12:52.092528 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.092119    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285" event={"ID":"09405bd6-8305-4b21-b8c8-09702bb62603","Type":"ContainerDied","Data":"a964663cab1e6f35fdc7a926751126eb11f79f10592ad38d22de7f443215a70e"}
Jul 20 21:12:52.232947 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.232917    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:52.276659 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.276634    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:52.279394 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.279377    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:52.325186 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325159    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td4zv\" (UniqueName: \"kubernetes.io/projected/531926dd-bb37-4d0c-9724-f72d41c69a4d-kube-api-access-td4zv\") pod \"531926dd-bb37-4d0c-9724-f72d41c69a4d\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") "
Jul 20 21:12:52.325186 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325189    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp9dg\" (UniqueName: \"kubernetes.io/projected/93690712-178f-45b2-8bbe-109fd1d83400-kube-api-access-dp9dg\") pod \"93690712-178f-45b2-8bbe-109fd1d83400\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") "
Jul 20 21:12:52.325406 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325212    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-bundle\") pod \"531926dd-bb37-4d0c-9724-f72d41c69a4d\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") "
Jul 20 21:12:52.325406 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325247    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-util\") pod \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") "
Jul 20 21:12:52.325406 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325285    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-bundle\") pod \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") "
Jul 20 21:12:52.325406 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325309    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-bundle\") pod \"93690712-178f-45b2-8bbe-109fd1d83400\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") "
Jul 20 21:12:52.325406 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325364    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-util\") pod \"93690712-178f-45b2-8bbe-109fd1d83400\" (UID: \"93690712-178f-45b2-8bbe-109fd1d83400\") "
Jul 20 21:12:52.325406 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325394    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4df2d\" (UniqueName: \"kubernetes.io/projected/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-kube-api-access-4df2d\") pod \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\" (UID: \"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df\") "
Jul 20 21:12:52.325702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325440    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-util\") pod \"531926dd-bb37-4d0c-9724-f72d41c69a4d\" (UID: \"531926dd-bb37-4d0c-9724-f72d41c69a4d\") "
Jul 20 21:12:52.325769 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.325739    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-bundle" (OuterVolumeSpecName: "bundle") pod "531926dd-bb37-4d0c-9724-f72d41c69a4d" (UID: "531926dd-bb37-4d0c-9724-f72d41c69a4d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:12:52.327998 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.327957    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-bundle" (OuterVolumeSpecName: "bundle") pod "c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" (UID: "c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:12:52.328307 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.328258    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-bundle" (OuterVolumeSpecName: "bundle") pod "93690712-178f-45b2-8bbe-109fd1d83400" (UID: "93690712-178f-45b2-8bbe-109fd1d83400"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:12:52.328424 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.328344    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531926dd-bb37-4d0c-9724-f72d41c69a4d-kube-api-access-td4zv" (OuterVolumeSpecName: "kube-api-access-td4zv") pod "531926dd-bb37-4d0c-9724-f72d41c69a4d" (UID: "531926dd-bb37-4d0c-9724-f72d41c69a4d"). InnerVolumeSpecName "kube-api-access-td4zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:12:52.328619 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.328575    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93690712-178f-45b2-8bbe-109fd1d83400-kube-api-access-dp9dg" (OuterVolumeSpecName: "kube-api-access-dp9dg") pod "93690712-178f-45b2-8bbe-109fd1d83400" (UID: "93690712-178f-45b2-8bbe-109fd1d83400"). InnerVolumeSpecName "kube-api-access-dp9dg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:12:52.328771 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.328748    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-kube-api-access-4df2d" (OuterVolumeSpecName: "kube-api-access-4df2d") pod "c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" (UID: "c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df"). InnerVolumeSpecName "kube-api-access-4df2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:12:52.332371 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.332339    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-util" (OuterVolumeSpecName: "util") pod "c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" (UID: "c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:12:52.333257 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.333236    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-util" (OuterVolumeSpecName: "util") pod "531926dd-bb37-4d0c-9724-f72d41c69a4d" (UID: "531926dd-bb37-4d0c-9724-f72d41c69a4d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:12:52.334740 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.334705    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-util" (OuterVolumeSpecName: "util") pod "93690712-178f-45b2-8bbe-109fd1d83400" (UID: "93690712-178f-45b2-8bbe-109fd1d83400"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:12:52.426313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.426230    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-util\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:52.426313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.426262    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td4zv\" (UniqueName: \"kubernetes.io/projected/531926dd-bb37-4d0c-9724-f72d41c69a4d-kube-api-access-td4zv\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:52.426313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.426273    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp9dg\" (UniqueName: \"kubernetes.io/projected/93690712-178f-45b2-8bbe-109fd1d83400-kube-api-access-dp9dg\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:52.426313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.426281    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/531926dd-bb37-4d0c-9724-f72d41c69a4d-bundle\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:52.426313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.426289    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-util\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:52.426313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.426296    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-bundle\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:52.426313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.426303    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-bundle\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:52.426313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.426310    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93690712-178f-45b2-8bbe-109fd1d83400-util\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:52.426313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:52.426318    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4df2d\" (UniqueName: \"kubernetes.io/projected/c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df-kube-api-access-4df2d\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:53.100033 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.099928    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd"
Jul 20 21:12:53.100033 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.099946    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd" event={"ID":"531926dd-bb37-4d0c-9724-f72d41c69a4d","Type":"ContainerDied","Data":"587556afaab2d383b820c722143f1bbc94dcb008a1ee7500c8a9809ad13a155e"}
Jul 20 21:12:53.100033 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.099998    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="587556afaab2d383b820c722143f1bbc94dcb008a1ee7500c8a9809ad13a155e"
Jul 20 21:12:53.101965 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.101932    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw"
Jul 20 21:12:53.101965 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.101936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw" event={"ID":"c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df","Type":"ContainerDied","Data":"5601a7ba71eed63dd8a2fd200b06e7adab4aa75d9bc9611cd4111256b6e1e1d1"}
Jul 20 21:12:53.102187 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.101976    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5601a7ba71eed63dd8a2fd200b06e7adab4aa75d9bc9611cd4111256b6e1e1d1"
Jul 20 21:12:53.104204 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.104168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv" event={"ID":"93690712-178f-45b2-8bbe-109fd1d83400","Type":"ContainerDied","Data":"a553cc526b796566a68d26115acc0165d2c91ecdb498ec39deeb031f64cfd53c"}
Jul 20 21:12:53.104323 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.104205    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv"
Jul 20 21:12:53.104323 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.104222    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a553cc526b796566a68d26115acc0165d2c91ecdb498ec39deeb031f64cfd53c"
Jul 20 21:12:53.229308 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.229283    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:53.334031 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.333991    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjfxl\" (UniqueName: \"kubernetes.io/projected/09405bd6-8305-4b21-b8c8-09702bb62603-kube-api-access-bjfxl\") pod \"09405bd6-8305-4b21-b8c8-09702bb62603\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") "
Jul 20 21:12:53.334031 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.334036    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-bundle\") pod \"09405bd6-8305-4b21-b8c8-09702bb62603\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") "
Jul 20 21:12:53.334228 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.334151    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-util\") pod \"09405bd6-8305-4b21-b8c8-09702bb62603\" (UID: \"09405bd6-8305-4b21-b8c8-09702bb62603\") "
Jul 20 21:12:53.334543 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.334517    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-bundle" (OuterVolumeSpecName: "bundle") pod "09405bd6-8305-4b21-b8c8-09702bb62603" (UID: "09405bd6-8305-4b21-b8c8-09702bb62603"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:12:53.336170 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.336145    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09405bd6-8305-4b21-b8c8-09702bb62603-kube-api-access-bjfxl" (OuterVolumeSpecName: "kube-api-access-bjfxl") pod "09405bd6-8305-4b21-b8c8-09702bb62603" (UID: "09405bd6-8305-4b21-b8c8-09702bb62603"). InnerVolumeSpecName "kube-api-access-bjfxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:12:53.339533 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.339501    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-util" (OuterVolumeSpecName: "util") pod "09405bd6-8305-4b21-b8c8-09702bb62603" (UID: "09405bd6-8305-4b21-b8c8-09702bb62603"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:12:53.435546 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.435438    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-util\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:53.435546 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.435489    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjfxl\" (UniqueName: \"kubernetes.io/projected/09405bd6-8305-4b21-b8c8-09702bb62603-kube-api-access-bjfxl\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:53.435546 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:53.435500    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09405bd6-8305-4b21-b8c8-09702bb62603-bundle\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:12:54.110849 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:54.110819    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285"
Jul 20 21:12:54.110849 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:54.110830    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285" event={"ID":"09405bd6-8305-4b21-b8c8-09702bb62603","Type":"ContainerDied","Data":"f85c82436887b76e8ac5570adb1448fc83412587b3a9beb969e7db8132274704"}
Jul 20 21:12:54.111394 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:12:54.110878    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f85c82436887b76e8ac5570adb1448fc83412587b3a9beb969e7db8132274704"
Jul 20 21:13:04.301395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301355    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"]
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301639    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerName="util"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301650    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerName="util"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301657    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerName="pull"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301664    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerName="pull"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301674    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09405bd6-8305-4b21-b8c8-09702bb62603" containerName="extract"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301680    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09405bd6-8305-4b21-b8c8-09702bb62603" containerName="extract"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301689    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerName="util"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301695    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerName="util"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301710    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09405bd6-8305-4b21-b8c8-09702bb62603" containerName="pull"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301715    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09405bd6-8305-4b21-b8c8-09702bb62603" containerName="pull"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301721    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerName="extract"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301725    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerName="extract"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301730    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93690712-178f-45b2-8bbe-109fd1d83400" containerName="extract"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301735    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="93690712-178f-45b2-8bbe-109fd1d83400" containerName="extract"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301742    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerName="extract"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301746    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerName="extract"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301753    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93690712-178f-45b2-8bbe-109fd1d83400" containerName="util"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301758    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="93690712-178f-45b2-8bbe-109fd1d83400" containerName="util"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301765    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09405bd6-8305-4b21-b8c8-09702bb62603" containerName="util"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301770    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09405bd6-8305-4b21-b8c8-09702bb62603" containerName="util"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301775    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerName="pull"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301780    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerName="pull"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301785    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93690712-178f-45b2-8bbe-109fd1d83400" containerName="pull"
Jul 20 21:13:04.301778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301790    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="93690712-178f-45b2-8bbe-109fd1d83400" containerName="pull"
Jul 20 21:13:04.302585 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301837    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="93690712-178f-45b2-8bbe-109fd1d83400" containerName="extract"
Jul 20 21:13:04.302585 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301848    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="531926dd-bb37-4d0c-9724-f72d41c69a4d" containerName="extract"
Jul 20 21:13:04.302585 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301853    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df" containerName="extract"
Jul 20 21:13:04.302585 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.301859    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="09405bd6-8305-4b21-b8c8-09702bb62603" containerName="extract"
Jul 20 21:13:04.307410 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.307388    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"
Jul 20 21:13:04.312741 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.312686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rhsh7\""
Jul 20 21:13:04.321267 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.321240    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"]
Jul 20 21:13:04.422742 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.422700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxw4j\" (UniqueName: \"kubernetes.io/projected/bc79abc1-f3d1-40da-82bd-af3b676631ad-kube-api-access-fxw4j\") pod \"authorino-operator-75cc8d5cb7-gkwv9\" (UID: \"bc79abc1-f3d1-40da-82bd-af3b676631ad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"
Jul 20 21:13:04.523580 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.523535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxw4j\" (UniqueName: \"kubernetes.io/projected/bc79abc1-f3d1-40da-82bd-af3b676631ad-kube-api-access-fxw4j\") pod \"authorino-operator-75cc8d5cb7-gkwv9\" (UID: \"bc79abc1-f3d1-40da-82bd-af3b676631ad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"
Jul 20 21:13:04.538869 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.538830    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxw4j\" (UniqueName: \"kubernetes.io/projected/bc79abc1-f3d1-40da-82bd-af3b676631ad-kube-api-access-fxw4j\") pod \"authorino-operator-75cc8d5cb7-gkwv9\" (UID: \"bc79abc1-f3d1-40da-82bd-af3b676631ad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"
Jul 20 21:13:04.617744 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.617655    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"
Jul 20 21:13:04.763438 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:04.763413    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"]
Jul 20 21:13:04.765735 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:13:04.765706    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc79abc1_f3d1_40da_82bd_af3b676631ad.slice/crio-9bd3f5ab19ddd90cec34269ef540f87f312ad453e227c44f207e0af4db2af5b1 WatchSource:0}: Error finding container 9bd3f5ab19ddd90cec34269ef540f87f312ad453e227c44f207e0af4db2af5b1: Status 404 returned error can't find the container with id 9bd3f5ab19ddd90cec34269ef540f87f312ad453e227c44f207e0af4db2af5b1
Jul 20 21:13:05.166115 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:05.166063    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9" event={"ID":"bc79abc1-f3d1-40da-82bd-af3b676631ad","Type":"ContainerStarted","Data":"9bd3f5ab19ddd90cec34269ef540f87f312ad453e227c44f207e0af4db2af5b1"}
Jul 20 21:13:07.179623 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:07.179534    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9" event={"ID":"bc79abc1-f3d1-40da-82bd-af3b676631ad","Type":"ContainerStarted","Data":"7b62c34d15ff0fa18b4dd1436b6effce02840ce4ab2a31683c6c9fa37d41879f"}
Jul 20 21:13:07.179623 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:07.179594    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"
Jul 20 21:13:07.201066 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:07.201011    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9" podStartSLOduration=1.079182374 podStartE2EDuration="3.200989474s" totalImagesPullingTime="2.1218071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:13:07.198923006 +0000 UTC m=+646.951645728" watchObservedRunningTime="2026-07-20 21:13:07.200989474 +0000 UTC m=+646.953712199"
Jul 20 21:13:07.984748 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:07.984715    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"]
Jul 20 21:13:07.988253 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:07.988231    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:07.991576 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:07.991556    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fmgz5\""
Jul 20 21:13:08.002135 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:08.002108    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"]
Jul 20 21:13:08.055228 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:08.055195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg275\" (UniqueName: \"kubernetes.io/projected/c2db77b9-8670-45bc-96b5-90d76cf359fb-kube-api-access-zg275\") pod \"limitador-operator-controller-manager-859d7b78bd-h49v6\" (UID: \"c2db77b9-8670-45bc-96b5-90d76cf359fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:08.156644 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:08.156605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg275\" (UniqueName: \"kubernetes.io/projected/c2db77b9-8670-45bc-96b5-90d76cf359fb-kube-api-access-zg275\") pod \"limitador-operator-controller-manager-859d7b78bd-h49v6\" (UID: \"c2db77b9-8670-45bc-96b5-90d76cf359fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:08.167535 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:08.167502    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg275\" (UniqueName: \"kubernetes.io/projected/c2db77b9-8670-45bc-96b5-90d76cf359fb-kube-api-access-zg275\") pod \"limitador-operator-controller-manager-859d7b78bd-h49v6\" (UID: \"c2db77b9-8670-45bc-96b5-90d76cf359fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:08.298149 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:08.298034    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:08.433973 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:08.433938    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"]
Jul 20 21:13:08.437769 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:13:08.437736    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2db77b9_8670_45bc_96b5_90d76cf359fb.slice/crio-3c57374a01e0bc97700cffc9f4271343411455434972fecba49ea6dd9a0799ef WatchSource:0}: Error finding container 3c57374a01e0bc97700cffc9f4271343411455434972fecba49ea6dd9a0799ef: Status 404 returned error can't find the container with id 3c57374a01e0bc97700cffc9f4271343411455434972fecba49ea6dd9a0799ef
Jul 20 21:13:09.195949 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:09.195909    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6" event={"ID":"c2db77b9-8670-45bc-96b5-90d76cf359fb","Type":"ContainerStarted","Data":"3c57374a01e0bc97700cffc9f4271343411455434972fecba49ea6dd9a0799ef"}
Jul 20 21:13:11.208981 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:11.208940    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6" event={"ID":"c2db77b9-8670-45bc-96b5-90d76cf359fb","Type":"ContainerStarted","Data":"ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059"}
Jul 20 21:13:11.209478 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:11.209023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:11.226279 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:11.226222    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6" podStartSLOduration=2.378715102 podStartE2EDuration="4.226203319s" totalImagesPullingTime="1.847488217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:13:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:13:11.225189857 +0000 UTC m=+650.977912579" watchObservedRunningTime="2026-07-20 21:13:11.226203319 +0000 UTC m=+650.978926041"
Jul 20 21:13:12.851866 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:12.851831    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"]
Jul 20 21:13:12.855441 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:12.855423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:12.858311 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:12.858282    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mwmn7\""
Jul 20 21:13:12.869005 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:12.868975    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"]
Jul 20 21:13:12.995273 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:12.995228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvq6l\" (UniqueName: \"kubernetes.io/projected/4999245a-e74f-4dc0-b706-b87fb6a4014c-kube-api-access-jvq6l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" (UID: \"4999245a-e74f-4dc0-b706-b87fb6a4014c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:12.995447 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:12.995314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999245a-e74f-4dc0-b706-b87fb6a4014c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" (UID: \"4999245a-e74f-4dc0-b706-b87fb6a4014c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:13.096540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:13.096499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvq6l\" (UniqueName: \"kubernetes.io/projected/4999245a-e74f-4dc0-b706-b87fb6a4014c-kube-api-access-jvq6l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" (UID: \"4999245a-e74f-4dc0-b706-b87fb6a4014c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:13.096698 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:13.096574    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999245a-e74f-4dc0-b706-b87fb6a4014c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" (UID: \"4999245a-e74f-4dc0-b706-b87fb6a4014c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:13.097030 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:13.097012    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999245a-e74f-4dc0-b706-b87fb6a4014c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" (UID: \"4999245a-e74f-4dc0-b706-b87fb6a4014c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:13.106446 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:13.106385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvq6l\" (UniqueName: \"kubernetes.io/projected/4999245a-e74f-4dc0-b706-b87fb6a4014c-kube-api-access-jvq6l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" (UID: \"4999245a-e74f-4dc0-b706-b87fb6a4014c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:13.165562 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:13.165527    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:13.307994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:13.307966    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"]
Jul 20 21:13:13.310709 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:13:13.310677    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4999245a_e74f_4dc0_b706_b87fb6a4014c.slice/crio-6bfac0f9d4b7bac8656cbd1b19ef3905562d3b3b9517de8db0a19e5cff8f91f4 WatchSource:0}: Error finding container 6bfac0f9d4b7bac8656cbd1b19ef3905562d3b3b9517de8db0a19e5cff8f91f4: Status 404 returned error can't find the container with id 6bfac0f9d4b7bac8656cbd1b19ef3905562d3b3b9517de8db0a19e5cff8f91f4
Jul 20 21:13:14.232917 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:14.232876    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4" event={"ID":"4999245a-e74f-4dc0-b706-b87fb6a4014c","Type":"ContainerStarted","Data":"6bfac0f9d4b7bac8656cbd1b19ef3905562d3b3b9517de8db0a19e5cff8f91f4"}
Jul 20 21:13:16.008520 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.008482    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"]
Jul 20 21:13:16.012123 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.012095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"
Jul 20 21:13:16.015495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.015468    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 20 21:13:16.015616 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.015468    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cwx94\""
Jul 20 21:13:16.024886 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.024857    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"]
Jul 20 21:13:16.121962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.121921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qvnt\" (UniqueName: \"kubernetes.io/projected/5721aa10-e7e4-4ffd-9af3-c72932089714-kube-api-access-6qvnt\") pod \"dns-operator-controller-manager-864dd78c4c-97nt5\" (UID: \"5721aa10-e7e4-4ffd-9af3-c72932089714\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"
Jul 20 21:13:16.222445 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.222403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qvnt\" (UniqueName: \"kubernetes.io/projected/5721aa10-e7e4-4ffd-9af3-c72932089714-kube-api-access-6qvnt\") pod \"dns-operator-controller-manager-864dd78c4c-97nt5\" (UID: \"5721aa10-e7e4-4ffd-9af3-c72932089714\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"
Jul 20 21:13:16.232678 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.232649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qvnt\" (UniqueName: \"kubernetes.io/projected/5721aa10-e7e4-4ffd-9af3-c72932089714-kube-api-access-6qvnt\") pod \"dns-operator-controller-manager-864dd78c4c-97nt5\" (UID: \"5721aa10-e7e4-4ffd-9af3-c72932089714\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"
Jul 20 21:13:16.326247 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.326159    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"
Jul 20 21:13:16.484184 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:16.484159    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"]
Jul 20 21:13:16.486594 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:13:16.486565    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5721aa10_e7e4_4ffd_9af3_c72932089714.slice/crio-6ba843a55326f0466e8023564f9db799770ca3fdf2c660662fac50c959a60bda WatchSource:0}: Error finding container 6ba843a55326f0466e8023564f9db799770ca3fdf2c660662fac50c959a60bda: Status 404 returned error can't find the container with id 6ba843a55326f0466e8023564f9db799770ca3fdf2c660662fac50c959a60bda
Jul 20 21:13:17.250597 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:17.250561    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5" event={"ID":"5721aa10-e7e4-4ffd-9af3-c72932089714","Type":"ContainerStarted","Data":"6ba843a55326f0466e8023564f9db799770ca3fdf2c660662fac50c959a60bda"}
Jul 20 21:13:18.192563 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:18.192520    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gkwv9"
Jul 20 21:13:19.265338 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:19.265293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5" event={"ID":"5721aa10-e7e4-4ffd-9af3-c72932089714","Type":"ContainerStarted","Data":"41a53bbdce85d837bcadfe71bf817ced500ab2409be996ea9e2f46053c3532c6"}
Jul 20 21:13:19.265841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:19.265449    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"
Jul 20 21:13:19.289859 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:19.289786    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5" podStartSLOduration=2.524765241 podStartE2EDuration="4.289765139s" totalImagesPullingTime="1.764999898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:13:19.289442842 +0000 UTC m=+659.042165566" watchObservedRunningTime="2026-07-20 21:13:19.289765139 +0000 UTC m=+659.042487866"
Jul 20 21:13:20.272122 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:20.272065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4" event={"ID":"4999245a-e74f-4dc0-b706-b87fb6a4014c","Type":"ContainerStarted","Data":"25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af"}
Jul 20 21:13:20.272567 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:20.272272    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:20.298576 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:20.298522    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4" podStartSLOduration=1.9343354590000001 podStartE2EDuration="8.298505046s" totalImagesPullingTime="6.364169587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:13:20.29723058 +0000 UTC m=+660.049953303" watchObservedRunningTime="2026-07-20 21:13:20.298505046 +0000 UTC m=+660.051227768"
Jul 20 21:13:22.216315 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.216278    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:22.424528 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.424481    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"]
Jul 20 21:13:22.429280 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.429257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.431786 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.431764    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 20 21:13:22.431967 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.431835    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 20 21:13:22.431967 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.431853    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7cj5x\""
Jul 20 21:13:22.437043 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.437019    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"]
Jul 20 21:13:22.573788 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.573752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/775299f0-3154-4d27-a2b5-7887516b7406-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xvhqw\" (UID: \"775299f0-3154-4d27-a2b5-7887516b7406\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.573983 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.573806    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktfvr\" (UniqueName: \"kubernetes.io/projected/775299f0-3154-4d27-a2b5-7887516b7406-kube-api-access-ktfvr\") pod \"kuadrant-console-plugin-66b5774985-xvhqw\" (UID: \"775299f0-3154-4d27-a2b5-7887516b7406\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.573983 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.573863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/775299f0-3154-4d27-a2b5-7887516b7406-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xvhqw\" (UID: \"775299f0-3154-4d27-a2b5-7887516b7406\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.674684 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.674643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/775299f0-3154-4d27-a2b5-7887516b7406-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xvhqw\" (UID: \"775299f0-3154-4d27-a2b5-7887516b7406\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.674880 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.674702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktfvr\" (UniqueName: \"kubernetes.io/projected/775299f0-3154-4d27-a2b5-7887516b7406-kube-api-access-ktfvr\") pod \"kuadrant-console-plugin-66b5774985-xvhqw\" (UID: \"775299f0-3154-4d27-a2b5-7887516b7406\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.674880 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.674733    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/775299f0-3154-4d27-a2b5-7887516b7406-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xvhqw\" (UID: \"775299f0-3154-4d27-a2b5-7887516b7406\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.675457 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.675436    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/775299f0-3154-4d27-a2b5-7887516b7406-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xvhqw\" (UID: \"775299f0-3154-4d27-a2b5-7887516b7406\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.677089 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.677050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/775299f0-3154-4d27-a2b5-7887516b7406-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xvhqw\" (UID: \"775299f0-3154-4d27-a2b5-7887516b7406\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.684787 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.684760    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktfvr\" (UniqueName: \"kubernetes.io/projected/775299f0-3154-4d27-a2b5-7887516b7406-kube-api-access-ktfvr\") pod \"kuadrant-console-plugin-66b5774985-xvhqw\" (UID: \"775299f0-3154-4d27-a2b5-7887516b7406\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.739622 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.739593    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"
Jul 20 21:13:22.890506 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:22.890473    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw"]
Jul 20 21:13:22.892965 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:13:22.892938    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod775299f0_3154_4d27_a2b5_7887516b7406.slice/crio-6dc9f0d54e77f6f510b7f1d5cae765f43911cb93587f2ad1ee1a6b71bb1af964 WatchSource:0}: Error finding container 6dc9f0d54e77f6f510b7f1d5cae765f43911cb93587f2ad1ee1a6b71bb1af964: Status 404 returned error can't find the container with id 6dc9f0d54e77f6f510b7f1d5cae765f43911cb93587f2ad1ee1a6b71bb1af964
Jul 20 21:13:23.288598 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:23.288554    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw" event={"ID":"775299f0-3154-4d27-a2b5-7887516b7406","Type":"ContainerStarted","Data":"6dc9f0d54e77f6f510b7f1d5cae765f43911cb93587f2ad1ee1a6b71bb1af964"}
Jul 20 21:13:30.274346 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:30.274308    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-97nt5"
Jul 20 21:13:31.280451 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:31.280390    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:33.238238 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.237896    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"]
Jul 20 21:13:33.265133 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.265100    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:33.272003 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.271933    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"]
Jul 20 21:13:33.371509 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.371471    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac9bfb02-d946-4c23-a623-bc4d216c519f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" (UID: \"ac9bfb02-d946-4c23-a623-bc4d216c519f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:33.371685 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.371527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvlc\" (UniqueName: \"kubernetes.io/projected/ac9bfb02-d946-4c23-a623-bc4d216c519f-kube-api-access-pwvlc\") pod \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" (UID: \"ac9bfb02-d946-4c23-a623-bc4d216c519f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:33.472404 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.472372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac9bfb02-d946-4c23-a623-bc4d216c519f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" (UID: \"ac9bfb02-d946-4c23-a623-bc4d216c519f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:33.472610 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.472420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvlc\" (UniqueName: \"kubernetes.io/projected/ac9bfb02-d946-4c23-a623-bc4d216c519f-kube-api-access-pwvlc\") pod \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" (UID: \"ac9bfb02-d946-4c23-a623-bc4d216c519f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:33.472872 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.472849    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac9bfb02-d946-4c23-a623-bc4d216c519f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" (UID: \"ac9bfb02-d946-4c23-a623-bc4d216c519f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:33.482220 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.482191    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvlc\" (UniqueName: \"kubernetes.io/projected/ac9bfb02-d946-4c23-a623-bc4d216c519f-kube-api-access-pwvlc\") pod \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" (UID: \"ac9bfb02-d946-4c23-a623-bc4d216c519f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:33.532542 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.532457    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"]
Jul 20 21:13:33.532777 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.532754    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:33.543185 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.543156    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"]
Jul 20 21:13:33.556013 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.555987    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"]
Jul 20 21:13:33.556236 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.556204    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" containerName="manager" containerID="cri-o://25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af" gracePeriod=2
Jul 20 21:13:33.560090 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.560030    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"]
Jul 20 21:13:33.563641 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.563622    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:33.571516 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.571485    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"]
Jul 20 21:13:33.575340 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:33.575306    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4999245a-e74f-4dc0-b706-b87fb6a4014c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\": pods \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:33.579136 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:33.578882    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:33.579813 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.579788    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"]
Jul 20 21:13:33.589486 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.589456    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"]
Jul 20 21:13:33.589786 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.589758    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" containerName="manager" containerID="cri-o://ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059" gracePeriod=2
Jul 20 21:13:33.594463 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.593453    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"]
Jul 20 21:13:33.596304 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.596154    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" containerName="manager"
Jul 20 21:13:33.596304 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.596178    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" containerName="manager"
Jul 20 21:13:33.599290 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.596627    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" containerName="manager"
Jul 20 21:13:33.605279 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.605209    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:33.605491 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.605328    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"]
Jul 20 21:13:33.613386 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.613362    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"]
Jul 20 21:13:33.613521 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:33.613416    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:33.615777 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:33.615751    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h49v6\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:33.674692 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.674661    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-79pd5\" (UID: \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:33.674873 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.674710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqfpf\" (UniqueName: \"kubernetes.io/projected/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-kube-api-access-kqfpf\") pod \"kuadrant-operator-controller-manager-55467d9f7-79pd5\" (UID: \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:33.776042 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.776002    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b567371-62f6-4a07-a004-869a90324e30-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9vf2l\" (UID: \"0b567371-62f6-4a07-a004-869a90324e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:33.776244 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.776065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-79pd5\" (UID: \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:33.776244 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.776145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfpf\" (UniqueName: \"kubernetes.io/projected/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-kube-api-access-kqfpf\") pod \"kuadrant-operator-controller-manager-55467d9f7-79pd5\" (UID: \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:33.776244 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.776198    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9fqd\" (UniqueName: \"kubernetes.io/projected/0b567371-62f6-4a07-a004-869a90324e30-kube-api-access-n9fqd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9vf2l\" (UID: \"0b567371-62f6-4a07-a004-869a90324e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:33.776492 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.776468    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-79pd5\" (UID: \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:33.785667 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.785601    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqfpf\" (UniqueName: \"kubernetes.io/projected/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-kube-api-access-kqfpf\") pod \"kuadrant-operator-controller-manager-55467d9f7-79pd5\" (UID: \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:33.877232 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.877183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b567371-62f6-4a07-a004-869a90324e30-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9vf2l\" (UID: \"0b567371-62f6-4a07-a004-869a90324e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:33.877407 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.877305    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fqd\" (UniqueName: \"kubernetes.io/projected/0b567371-62f6-4a07-a004-869a90324e30-kube-api-access-n9fqd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9vf2l\" (UID: \"0b567371-62f6-4a07-a004-869a90324e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:33.877622 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.877596    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b567371-62f6-4a07-a004-869a90324e30-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9vf2l\" (UID: \"0b567371-62f6-4a07-a004-869a90324e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:33.891343 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.891314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9fqd\" (UniqueName: \"kubernetes.io/projected/0b567371-62f6-4a07-a004-869a90324e30-kube-api-access-n9fqd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9vf2l\" (UID: \"0b567371-62f6-4a07-a004-869a90324e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:33.957862 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.957819    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:33.966004 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:33.965974    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:44.981744 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:44.981583    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"]
Jul 20 21:13:44.983578 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:44.983499    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:44.983809 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:13:44.983767    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbabfb0ad_aa89_4cb4_b0c6_75badb16bf9a.slice/crio-65dd0cd6a0a0cd169f3ff3ce879cc89668ff55205cdc020a8c2a22409d7b8d31 WatchSource:0}: Error finding container 65dd0cd6a0a0cd169f3ff3ce879cc89668ff55205cdc020a8c2a22409d7b8d31: Status 404 returned error can't find the container with id 65dd0cd6a0a0cd169f3ff3ce879cc89668ff55205cdc020a8c2a22409d7b8d31
Jul 20 21:13:44.986414 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:44.985994    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h49v6\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:44.997678 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:44.997653    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:45.000159 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.000132    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:45.002191 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.002163    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h49v6\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:45.010721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.010702    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"]
Jul 20 21:13:45.070462 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.070439    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999245a-e74f-4dc0-b706-b87fb6a4014c-extensions-socket-volume\") pod \"4999245a-e74f-4dc0-b706-b87fb6a4014c\" (UID: \"4999245a-e74f-4dc0-b706-b87fb6a4014c\") "
Jul 20 21:13:45.070561 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.070515    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvq6l\" (UniqueName: \"kubernetes.io/projected/4999245a-e74f-4dc0-b706-b87fb6a4014c-kube-api-access-jvq6l\") pod \"4999245a-e74f-4dc0-b706-b87fb6a4014c\" (UID: \"4999245a-e74f-4dc0-b706-b87fb6a4014c\") "
Jul 20 21:13:45.070561 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.070536    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg275\" (UniqueName: \"kubernetes.io/projected/c2db77b9-8670-45bc-96b5-90d76cf359fb-kube-api-access-zg275\") pod \"c2db77b9-8670-45bc-96b5-90d76cf359fb\" (UID: \"c2db77b9-8670-45bc-96b5-90d76cf359fb\") "
Jul 20 21:13:45.070814 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.070791    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4999245a-e74f-4dc0-b706-b87fb6a4014c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4999245a-e74f-4dc0-b706-b87fb6a4014c" (UID: "4999245a-e74f-4dc0-b706-b87fb6a4014c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:13:45.072424 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.072404    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4999245a-e74f-4dc0-b706-b87fb6a4014c-kube-api-access-jvq6l" (OuterVolumeSpecName: "kube-api-access-jvq6l") pod "4999245a-e74f-4dc0-b706-b87fb6a4014c" (UID: "4999245a-e74f-4dc0-b706-b87fb6a4014c"). InnerVolumeSpecName "kube-api-access-jvq6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:13:45.072498 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.072442    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2db77b9-8670-45bc-96b5-90d76cf359fb-kube-api-access-zg275" (OuterVolumeSpecName: "kube-api-access-zg275") pod "c2db77b9-8670-45bc-96b5-90d76cf359fb" (UID: "c2db77b9-8670-45bc-96b5-90d76cf359fb"). InnerVolumeSpecName "kube-api-access-zg275". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:13:45.171584 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.171541    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4999245a-e74f-4dc0-b706-b87fb6a4014c-extensions-socket-volume\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:13:45.171584 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.171580    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvq6l\" (UniqueName: \"kubernetes.io/projected/4999245a-e74f-4dc0-b706-b87fb6a4014c-kube-api-access-jvq6l\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:13:45.171584 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.171592    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg275\" (UniqueName: \"kubernetes.io/projected/c2db77b9-8670-45bc-96b5-90d76cf359fb-kube-api-access-zg275\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:13:45.417132 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.417017    2573 generic.go:356] "Generic (PLEG): container finished" podID="c2db77b9-8670-45bc-96b5-90d76cf359fb" containerID="ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059" exitCode=0
Jul 20 21:13:45.417132 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.417092    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:45.417368 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.417130    2573 scope.go:117] "RemoveContainer" containerID="ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059"
Jul 20 21:13:45.418980 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.418955    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5" event={"ID":"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a","Type":"ContainerStarted","Data":"9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6"}
Jul 20 21:13:45.419487 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.419029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5" event={"ID":"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a","Type":"ContainerStarted","Data":"65dd0cd6a0a0cd169f3ff3ce879cc89668ff55205cdc020a8c2a22409d7b8d31"}
Jul 20 21:13:45.419487 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.419059    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:45.420468 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.420444    2573 generic.go:356] "Generic (PLEG): container finished" podID="4999245a-e74f-4dc0-b706-b87fb6a4014c" containerID="25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af" exitCode=0
Jul 20 21:13:45.420584 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.420515    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:45.422429 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.422403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l" event={"ID":"0b567371-62f6-4a07-a004-869a90324e30","Type":"ContainerStarted","Data":"d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb"}
Jul 20 21:13:45.422529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.422452    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l" event={"ID":"0b567371-62f6-4a07-a004-869a90324e30","Type":"ContainerStarted","Data":"33831c43d6714e28e7be966f480e115ccb4d566599542f182b4c83ce883baf52"}
Jul 20 21:13:45.422529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.422504    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:45.423878 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.423842    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:45.424264 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.424242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw" event={"ID":"775299f0-3154-4d27-a2b5-7887516b7406","Type":"ContainerStarted","Data":"c1eddb0a87952df95680a261b93553a5086a3dc520693f54942f7dacd34342f9"}
Jul 20 21:13:45.427525 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.427348    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h49v6\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:45.427525 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.427493    2573 scope.go:117] "RemoveContainer" containerID="ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059"
Jul 20 21:13:45.427989 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.427899    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059\": container with ID starting with ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059 not found: ID does not exist" containerID="ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059"
Jul 20 21:13:45.427989 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.427949    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059"} err="failed to get container status \"ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059\": rpc error: code = NotFound desc = could not find container \"ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059\": container with ID starting with ff3b392b75c4af1f109021ef4abb6df81de06f3622c3b858789115cc3df9d059 not found: ID does not exist"
Jul 20 21:13:45.427989 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.427973    2573 scope.go:117] "RemoveContainer" containerID="25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af"
Jul 20 21:13:45.431628 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.431602    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:45.445533 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.445508    2573 scope.go:117] "RemoveContainer" containerID="25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af"
Jul 20 21:13:45.446329 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.446056    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af\": container with ID starting with 25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af not found: ID does not exist" containerID="25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af"
Jul 20 21:13:45.446329 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.446097    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af"} err="failed to get container status \"25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af\": rpc error: code = NotFound desc = could not find container \"25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af\": container with ID starting with 25020d4c12c9b36a2536bf09bf64ee183b0a1b32f22038d405b4d18654d711af not found: ID does not exist"
Jul 20 21:13:45.469696 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.469648    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5" podStartSLOduration=12.469635319 podStartE2EDuration="12.469635319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:13:45.467464028 +0000 UTC m=+685.220186751" watchObservedRunningTime="2026-07-20 21:13:45.469635319 +0000 UTC m=+685.222358041"
Jul 20 21:13:45.473115 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.473088    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h49v6\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:45.504268 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.504206    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvhqw" podStartSLOduration=1.498214516 podStartE2EDuration="23.504185898s" totalImagesPullingTime="22.005971382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:13:45.502936871 +0000 UTC m=+685.255659613" watchObservedRunningTime="2026-07-20 21:13:45.504185898 +0000 UTC m=+685.256908702"
Jul 20 21:13:45.549488 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:45.549438    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l" podStartSLOduration=12.549421371 podStartE2EDuration="12.549421371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:13:45.548814618 +0000 UTC m=+685.301537341" watchObservedRunningTime="2026-07-20 21:13:45.549421371 +0000 UTC m=+685.302144094"
Jul 20 21:13:45.551210 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.551174    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tbzd4\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tbzd4"
Jul 20 21:13:45.553372 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:45.553347    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h49v6\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h49v6"
Jul 20 21:13:46.771346 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:46.771286    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4999245a-e74f-4dc0-b706-b87fb6a4014c" path="/var/lib/kubelet/pods/4999245a-e74f-4dc0-b706-b87fb6a4014c/volumes"
Jul 20 21:13:46.771941 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:46.771881    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" path="/var/lib/kubelet/pods/c2db77b9-8670-45bc-96b5-90d76cf359fb/volumes"
Jul 20 21:13:47.349037 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:47.348994    2573 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-bf2s8_kuadrant-system_ac9bfb02-d946-4c23-a623-bc4d216c519f_0(d59f17a4541049e250151a88024415e41cca76fef70e33141ef6f51968f64e61): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-bf2s8 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 20 21:13:47.349138 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:47.349064    2573 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-bf2s8_kuadrant-system_ac9bfb02-d946-4c23-a623-bc4d216c519f_0(d59f17a4541049e250151a88024415e41cca76fef70e33141ef6f51968f64e61): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-bf2s8 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:47.436442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:47.436410    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:47.439010 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:47.438974    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="ac9bfb02-d946-4c23-a623-bc4d216c519f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:47.444455 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:47.444437    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:47.447277 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:47.447251    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="ac9bfb02-d946-4c23-a623-bc4d216c519f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:47.489635 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:47.489593    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac9bfb02-d946-4c23-a623-bc4d216c519f-extensions-socket-volume\") pod \"ac9bfb02-d946-4c23-a623-bc4d216c519f\" (UID: \"ac9bfb02-d946-4c23-a623-bc4d216c519f\") "
Jul 20 21:13:47.489756 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:47.489666    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwvlc\" (UniqueName: \"kubernetes.io/projected/ac9bfb02-d946-4c23-a623-bc4d216c519f-kube-api-access-pwvlc\") pod \"ac9bfb02-d946-4c23-a623-bc4d216c519f\" (UID: \"ac9bfb02-d946-4c23-a623-bc4d216c519f\") "
Jul 20 21:13:47.489912 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:47.489893    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac9bfb02-d946-4c23-a623-bc4d216c519f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac9bfb02-d946-4c23-a623-bc4d216c519f" (UID: "ac9bfb02-d946-4c23-a623-bc4d216c519f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:13:47.491797 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:47.491764    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac9bfb02-d946-4c23-a623-bc4d216c519f-kube-api-access-pwvlc" (OuterVolumeSpecName: "kube-api-access-pwvlc") pod "ac9bfb02-d946-4c23-a623-bc4d216c519f" (UID: "ac9bfb02-d946-4c23-a623-bc4d216c519f"). InnerVolumeSpecName "kube-api-access-pwvlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:13:47.590699 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:47.590608    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac9bfb02-d946-4c23-a623-bc4d216c519f-extensions-socket-volume\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:13:47.590699 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:47.590644    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwvlc\" (UniqueName: \"kubernetes.io/projected/ac9bfb02-d946-4c23-a623-bc4d216c519f-kube-api-access-pwvlc\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:13:48.440993 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:48.440957    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:48.443781 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:48.443750    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="ac9bfb02-d946-4c23-a623-bc4d216c519f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:48.450730 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:48.450704    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bf2s8\" is forbidden: User \"system:node:ip-10-0-136-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-242.ec2.internal' and this object" podUID="ac9bfb02-d946-4c23-a623-bc4d216c519f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bf2s8"
Jul 20 21:13:48.769406 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:48.769374    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac9bfb02-d946-4c23-a623-bc4d216c519f" path="/var/lib/kubelet/pods/ac9bfb02-d946-4c23-a623-bc4d216c519f/volumes"
Jul 20 21:13:56.437479 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.437447    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:13:56.437960 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.437516    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:56.544100 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.544043    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"]
Jul 20 21:13:56.544288 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.544250    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l" podUID="0b567371-62f6-4a07-a004-869a90324e30" containerName="manager" containerID="cri-o://d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb" gracePeriod=10
Jul 20 21:13:56.784832 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.784807    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:56.863252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.863228    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b567371-62f6-4a07-a004-869a90324e30-extensions-socket-volume\") pod \"0b567371-62f6-4a07-a004-869a90324e30\" (UID: \"0b567371-62f6-4a07-a004-869a90324e30\") "
Jul 20 21:13:56.863381 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.863283    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9fqd\" (UniqueName: \"kubernetes.io/projected/0b567371-62f6-4a07-a004-869a90324e30-kube-api-access-n9fqd\") pod \"0b567371-62f6-4a07-a004-869a90324e30\" (UID: \"0b567371-62f6-4a07-a004-869a90324e30\") "
Jul 20 21:13:56.863593 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.863570    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b567371-62f6-4a07-a004-869a90324e30-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0b567371-62f6-4a07-a004-869a90324e30" (UID: "0b567371-62f6-4a07-a004-869a90324e30"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:13:56.865244 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.865223    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b567371-62f6-4a07-a004-869a90324e30-kube-api-access-n9fqd" (OuterVolumeSpecName: "kube-api-access-n9fqd") pod "0b567371-62f6-4a07-a004-869a90324e30" (UID: "0b567371-62f6-4a07-a004-869a90324e30"). InnerVolumeSpecName "kube-api-access-n9fqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:13:56.963898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.963835    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b567371-62f6-4a07-a004-869a90324e30-extensions-socket-volume\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:13:56.963898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:56.963857    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9fqd\" (UniqueName: \"kubernetes.io/projected/0b567371-62f6-4a07-a004-869a90324e30-kube-api-access-n9fqd\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:13:57.448039 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.448006    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"]
Jul 20 21:13:57.448413 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.448337    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" containerName="manager"
Jul 20 21:13:57.448413 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.448350    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" containerName="manager"
Jul 20 21:13:57.448413 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.448365    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b567371-62f6-4a07-a004-869a90324e30" containerName="manager"
Jul 20 21:13:57.448413 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.448371    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b567371-62f6-4a07-a004-869a90324e30" containerName="manager"
Jul 20 21:13:57.448545 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.448422    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b567371-62f6-4a07-a004-869a90324e30" containerName="manager"
Jul 20 21:13:57.448545 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.448432    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2db77b9-8670-45bc-96b5-90d76cf359fb" containerName="manager"
Jul 20 21:13:57.450259 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.450243    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:13:57.465904 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.465880    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"]
Jul 20 21:13:57.486423 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.486399    2573 generic.go:356] "Generic (PLEG): container finished" podID="0b567371-62f6-4a07-a004-869a90324e30" containerID="d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb" exitCode=0
Jul 20 21:13:57.486545 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.486440    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"
Jul 20 21:13:57.486545 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.486453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l" event={"ID":"0b567371-62f6-4a07-a004-869a90324e30","Type":"ContainerDied","Data":"d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb"}
Jul 20 21:13:57.486545 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.486497    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l" event={"ID":"0b567371-62f6-4a07-a004-869a90324e30","Type":"ContainerDied","Data":"33831c43d6714e28e7be966f480e115ccb4d566599542f182b4c83ce883baf52"}
Jul 20 21:13:57.486545 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.486523    2573 scope.go:117] "RemoveContainer" containerID="d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb"
Jul 20 21:13:57.495957 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.495832    2573 scope.go:117] "RemoveContainer" containerID="d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb"
Jul 20 21:13:57.496200 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:13:57.496165    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb\": container with ID starting with d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb not found: ID does not exist" containerID="d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb"
Jul 20 21:13:57.496313 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.496196    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb"} err="failed to get container status \"d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb\": rpc error: code = NotFound desc = could not find container \"d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb\": container with ID starting with d30f18507e27c2f80b2e39de1d8b99ade6b4bcc8f601e6381fc383758a88dbcb not found: ID does not exist"
Jul 20 21:13:57.512665 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.512638    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"]
Jul 20 21:13:57.517553 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.517530    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9vf2l"]
Jul 20 21:13:57.569103 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.569065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr8t8\" (UniqueName: \"kubernetes.io/projected/6c07e380-0375-4db6-a41f-a95caa24d52c-kube-api-access-lr8t8\") pod \"kuadrant-operator-controller-manager-86878c769f-rhhlm\" (UID: \"6c07e380-0375-4db6-a41f-a95caa24d52c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:13:57.569211 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.569117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c07e380-0375-4db6-a41f-a95caa24d52c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rhhlm\" (UID: \"6c07e380-0375-4db6-a41f-a95caa24d52c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:13:57.669802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.669777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr8t8\" (UniqueName: \"kubernetes.io/projected/6c07e380-0375-4db6-a41f-a95caa24d52c-kube-api-access-lr8t8\") pod \"kuadrant-operator-controller-manager-86878c769f-rhhlm\" (UID: \"6c07e380-0375-4db6-a41f-a95caa24d52c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:13:57.669894 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.669813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c07e380-0375-4db6-a41f-a95caa24d52c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rhhlm\" (UID: \"6c07e380-0375-4db6-a41f-a95caa24d52c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:13:57.670154 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.670139    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c07e380-0375-4db6-a41f-a95caa24d52c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rhhlm\" (UID: \"6c07e380-0375-4db6-a41f-a95caa24d52c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:13:57.682161 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.682137    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr8t8\" (UniqueName: \"kubernetes.io/projected/6c07e380-0375-4db6-a41f-a95caa24d52c-kube-api-access-lr8t8\") pod \"kuadrant-operator-controller-manager-86878c769f-rhhlm\" (UID: \"6c07e380-0375-4db6-a41f-a95caa24d52c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:13:57.759902 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.759873    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:13:57.893725 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:57.893698    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"]
Jul 20 21:13:57.898304 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:13:57.898280    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c07e380_0375_4db6_a41f_a95caa24d52c.slice/crio-1f6b8dbf647d439ec268a8cf638ed167a9d19f59222e34a9af41271ec7543e4f WatchSource:0}: Error finding container 1f6b8dbf647d439ec268a8cf638ed167a9d19f59222e34a9af41271ec7543e4f: Status 404 returned error can't find the container with id 1f6b8dbf647d439ec268a8cf638ed167a9d19f59222e34a9af41271ec7543e4f
Jul 20 21:13:58.492721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:58.492683    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm" event={"ID":"6c07e380-0375-4db6-a41f-a95caa24d52c","Type":"ContainerStarted","Data":"ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1"}
Jul 20 21:13:58.493161 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:58.492745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm" event={"ID":"6c07e380-0375-4db6-a41f-a95caa24d52c","Type":"ContainerStarted","Data":"1f6b8dbf647d439ec268a8cf638ed167a9d19f59222e34a9af41271ec7543e4f"}
Jul 20 21:13:58.493161 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:58.492793    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:13:58.534010 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:58.533965    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm" podStartSLOduration=1.5339501439999998 podStartE2EDuration="1.533950144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:13:58.532556433 +0000 UTC m=+698.285279155" watchObservedRunningTime="2026-07-20 21:13:58.533950144 +0000 UTC m=+698.286672866"
Jul 20 21:13:58.770278 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:13:58.770208    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b567371-62f6-4a07-a004-869a90324e30" path="/var/lib/kubelet/pods/0b567371-62f6-4a07-a004-869a90324e30/volumes"
Jul 20 21:14:09.506486 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:09.506454    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:14:09.557068 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:09.557035    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"]
Jul 20 21:14:09.557329 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:09.557292    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5" podUID="babfb0ad-aa89-4cb4-b0c6-75badb16bf9a" containerName="manager" containerID="cri-o://9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6" gracePeriod=10
Jul 20 21:14:10.345153 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.345122    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:14:10.473812 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.473776    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-extensions-socket-volume\") pod \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\" (UID: \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\") "
Jul 20 21:14:10.474038 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.473853    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqfpf\" (UniqueName: \"kubernetes.io/projected/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-kube-api-access-kqfpf\") pod \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\" (UID: \"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a\") "
Jul 20 21:14:10.474292 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.474255    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "babfb0ad-aa89-4cb4-b0c6-75badb16bf9a" (UID: "babfb0ad-aa89-4cb4-b0c6-75badb16bf9a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:14:10.475994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.475965    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-kube-api-access-kqfpf" (OuterVolumeSpecName: "kube-api-access-kqfpf") pod "babfb0ad-aa89-4cb4-b0c6-75badb16bf9a" (UID: "babfb0ad-aa89-4cb4-b0c6-75badb16bf9a"). InnerVolumeSpecName "kube-api-access-kqfpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:14:10.562105 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.562054    2573 generic.go:356] "Generic (PLEG): container finished" podID="babfb0ad-aa89-4cb4-b0c6-75badb16bf9a" containerID="9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6" exitCode=0
Jul 20 21:14:10.562105 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.562112    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"
Jul 20 21:14:10.562577 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.562143    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5" event={"ID":"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a","Type":"ContainerDied","Data":"9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6"}
Jul 20 21:14:10.562577 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.562202    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5" event={"ID":"babfb0ad-aa89-4cb4-b0c6-75badb16bf9a","Type":"ContainerDied","Data":"65dd0cd6a0a0cd169f3ff3ce879cc89668ff55205cdc020a8c2a22409d7b8d31"}
Jul 20 21:14:10.562577 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.562232    2573 scope.go:117] "RemoveContainer" containerID="9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6"
Jul 20 21:14:10.572992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.572967    2573 scope.go:117] "RemoveContainer" containerID="9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6"
Jul 20 21:14:10.573316 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:14:10.573296    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6\": container with ID starting with 9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6 not found: ID does not exist" containerID="9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6"
Jul 20 21:14:10.573401 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.573326    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6"} err="failed to get container status \"9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6\": rpc error: code = NotFound desc = could not find container \"9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6\": container with ID starting with 9d78e4d08ca1bf4d3dab27aa9a310b71ea2ae8e45ae89ecf890b1a5132d80bf6 not found: ID does not exist"
Jul 20 21:14:10.574682 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.574660    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqfpf\" (UniqueName: \"kubernetes.io/projected/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-kube-api-access-kqfpf\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:14:10.574682 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.574682    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a-extensions-socket-volume\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:14:10.587741 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.587708    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"]
Jul 20 21:14:10.592765 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.592738    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-79pd5"]
Jul 20 21:14:10.769091 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:10.768990    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="babfb0ad-aa89-4cb4-b0c6-75badb16bf9a" path="/var/lib/kubelet/pods/babfb0ad-aa89-4cb4-b0c6-75badb16bf9a/volumes"
Jul 20 21:14:13.246096 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.245993    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"]
Jul 20 21:14:13.246508 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.246343    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="babfb0ad-aa89-4cb4-b0c6-75badb16bf9a" containerName="manager"
Jul 20 21:14:13.246508 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.246354    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="babfb0ad-aa89-4cb4-b0c6-75badb16bf9a" containerName="manager"
Jul 20 21:14:13.246508 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.246426    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="babfb0ad-aa89-4cb4-b0c6-75badb16bf9a" containerName="manager"
Jul 20 21:14:13.301847 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.301808    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"]
Jul 20 21:14:13.302012 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.301933    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.304556 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.304530    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 21:14:13.304701 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.304595    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-k5fsf\""
Jul 20 21:14:13.399607 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.399559    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.399607 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.399607    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.399831 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.399639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.399831 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.399670    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.399831 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.399726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnbfh\" (UniqueName: \"kubernetes.io/projected/160bec94-7fb5-4d02-a1b5-deeffc2c9109-kube-api-access-nnbfh\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.399831 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.399744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.399831 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.399765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.399831 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.399822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.400066 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.399847    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.500703 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.500618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.500703 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.500664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.500703 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.500694    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnbfh\" (UniqueName: \"kubernetes.io/projected/160bec94-7fb5-4d02-a1b5-deeffc2c9109-kube-api-access-nnbfh\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.500960 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.500717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.500960 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.500737    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.500960 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.500756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.500960 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.500778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.500960 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.500824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.500960 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.500849    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.501295 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.501208    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.501295 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.501286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.501402 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.501331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.501544 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.501524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.501608 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.501539    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.503007 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.502974    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.503350 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.503325    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.509203 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.509169    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/160bec94-7fb5-4d02-a1b5-deeffc2c9109-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.509343 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.509327    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnbfh\" (UniqueName: \"kubernetes.io/projected/160bec94-7fb5-4d02-a1b5-deeffc2c9109-kube-api-access-nnbfh\") pod \"maas-default-gateway-openshift-default-56654dcf7-qcshl\" (UID: \"160bec94-7fb5-4d02-a1b5-deeffc2c9109\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.612961 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.612914    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:13.757765 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:13.757736    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"]
Jul 20 21:14:13.759356 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:14:13.759309    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160bec94_7fb5_4d02_a1b5_deeffc2c9109.slice/crio-b39c1b9e34e24c69b95cbcabb19a50a4bdd00e76bc446c6e691f8dd3985cd24c WatchSource:0}: Error finding container b39c1b9e34e24c69b95cbcabb19a50a4bdd00e76bc446c6e691f8dd3985cd24c: Status 404 returned error can't find the container with id b39c1b9e34e24c69b95cbcabb19a50a4bdd00e76bc446c6e691f8dd3985cd24c
Jul 20 21:14:14.588248 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:14.588213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl" event={"ID":"160bec94-7fb5-4d02-a1b5-deeffc2c9109","Type":"ContainerStarted","Data":"b39c1b9e34e24c69b95cbcabb19a50a4bdd00e76bc446c6e691f8dd3985cd24c"}
Jul 20 21:14:16.454233 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:16.454173    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:14:16.454646 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:16.454290    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:14:16.454646 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:16.454325    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:14:16.602916 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:16.602874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl" event={"ID":"160bec94-7fb5-4d02-a1b5-deeffc2c9109","Type":"ContainerStarted","Data":"d86052079c91a6f904b70d9be18f13a6dc195c3779e1930e6fbd1a66acb007e4"}
Jul 20 21:14:16.613416 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:16.613384    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:16.625582 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:16.625524    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl" podStartSLOduration=0.933143863 podStartE2EDuration="3.625506798s" totalImagesPullingTime="2.692362935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:14:16.623547504 +0000 UTC m=+716.376270254" watchObservedRunningTime="2026-07-20 21:14:16.625506798 +0000 UTC m=+716.378229521"
Jul 20 21:14:17.618205 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:17.618173    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:18.616493 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:18.615248    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:18.618019 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:18.617992    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:14:29.805700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:29.805667    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"]
Jul 20 21:14:29.822262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:29.822227    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"]
Jul 20 21:14:29.822422 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:29.822333    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:29.825277 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:29.825257    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 21:14:29.897461 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:29.897424    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"]
Jul 20 21:14:29.951280 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:29.951251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxfl\" (UniqueName: \"kubernetes.io/projected/09b439f8-35c2-4727-b100-efa12c3069cd-kube-api-access-mtxfl\") pod \"limitador-limitador-64c94fd64f-6mhz2\" (UID: \"09b439f8-35c2-4727-b100-efa12c3069cd\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:29.951441 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:29.951359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09b439f8-35c2-4727-b100-efa12c3069cd-config-file\") pod \"limitador-limitador-64c94fd64f-6mhz2\" (UID: \"09b439f8-35c2-4727-b100-efa12c3069cd\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:30.051956 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.051915    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09b439f8-35c2-4727-b100-efa12c3069cd-config-file\") pod \"limitador-limitador-64c94fd64f-6mhz2\" (UID: \"09b439f8-35c2-4727-b100-efa12c3069cd\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:30.052143 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.051979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxfl\" (UniqueName: \"kubernetes.io/projected/09b439f8-35c2-4727-b100-efa12c3069cd-kube-api-access-mtxfl\") pod \"limitador-limitador-64c94fd64f-6mhz2\" (UID: \"09b439f8-35c2-4727-b100-efa12c3069cd\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:30.052613 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.052594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09b439f8-35c2-4727-b100-efa12c3069cd-config-file\") pod \"limitador-limitador-64c94fd64f-6mhz2\" (UID: \"09b439f8-35c2-4727-b100-efa12c3069cd\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:30.060683 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.060630    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxfl\" (UniqueName: \"kubernetes.io/projected/09b439f8-35c2-4727-b100-efa12c3069cd-kube-api-access-mtxfl\") pod \"limitador-limitador-64c94fd64f-6mhz2\" (UID: \"09b439f8-35c2-4727-b100-efa12c3069cd\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:30.132985 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.132952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:30.266913 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.266889    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"]
Jul 20 21:14:30.268991 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:14:30.268960    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b439f8_35c2_4727_b100_efa12c3069cd.slice/crio-ca0da9db15d1d27a13af05e4725be5ae25ad3311de7156b65d4cd6d74c62acfe WatchSource:0}: Error finding container ca0da9db15d1d27a13af05e4725be5ae25ad3311de7156b65d4cd6d74c62acfe: Status 404 returned error can't find the container with id ca0da9db15d1d27a13af05e4725be5ae25ad3311de7156b65d4cd6d74c62acfe
Jul 20 21:14:30.627711 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.627676    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-f6zfv"]
Jul 20 21:14:30.632591 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.632567    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f6zfv"
Jul 20 21:14:30.635509 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.635484    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kn45b\""
Jul 20 21:14:30.646108 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.645105    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f6zfv"]
Jul 20 21:14:30.676995 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.676961    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2" event={"ID":"09b439f8-35c2-4727-b100-efa12c3069cd","Type":"ContainerStarted","Data":"ca0da9db15d1d27a13af05e4725be5ae25ad3311de7156b65d4cd6d74c62acfe"}
Jul 20 21:14:30.757715 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.757685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvtdj\" (UniqueName: \"kubernetes.io/projected/3f0ba208-6a35-41e8-8869-1e33509a8aee-kube-api-access-hvtdj\") pod \"authorino-58cd955675-f6zfv\" (UID: \"3f0ba208-6a35-41e8-8869-1e33509a8aee\") " pod="kuadrant-system/authorino-58cd955675-f6zfv"
Jul 20 21:14:30.858720 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.858686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvtdj\" (UniqueName: \"kubernetes.io/projected/3f0ba208-6a35-41e8-8869-1e33509a8aee-kube-api-access-hvtdj\") pod \"authorino-58cd955675-f6zfv\" (UID: \"3f0ba208-6a35-41e8-8869-1e33509a8aee\") " pod="kuadrant-system/authorino-58cd955675-f6zfv"
Jul 20 21:14:30.867680 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.867651    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvtdj\" (UniqueName: \"kubernetes.io/projected/3f0ba208-6a35-41e8-8869-1e33509a8aee-kube-api-access-hvtdj\") pod \"authorino-58cd955675-f6zfv\" (UID: \"3f0ba208-6a35-41e8-8869-1e33509a8aee\") " pod="kuadrant-system/authorino-58cd955675-f6zfv"
Jul 20 21:14:30.947183 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:30.947114    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f6zfv"
Jul 20 21:14:31.088836 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:31.088794    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f6zfv"]
Jul 20 21:14:31.090607 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:14:31.090579    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f0ba208_6a35_41e8_8869_1e33509a8aee.slice/crio-ed45de0f6f715acd86b4b24458b0701c7927b3e69080db41e06427183eecc819 WatchSource:0}: Error finding container ed45de0f6f715acd86b4b24458b0701c7927b3e69080db41e06427183eecc819: Status 404 returned error can't find the container with id ed45de0f6f715acd86b4b24458b0701c7927b3e69080db41e06427183eecc819
Jul 20 21:14:31.683641 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:31.683598    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f6zfv" event={"ID":"3f0ba208-6a35-41e8-8869-1e33509a8aee","Type":"ContainerStarted","Data":"ed45de0f6f715acd86b4b24458b0701c7927b3e69080db41e06427183eecc819"}
Jul 20 21:14:33.698324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:33.698277    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2" event={"ID":"09b439f8-35c2-4727-b100-efa12c3069cd","Type":"ContainerStarted","Data":"a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c"}
Jul 20 21:14:33.698767 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:33.698350    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:33.715917 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:33.715807    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2" podStartSLOduration=1.8039032160000001 podStartE2EDuration="4.715788231s" totalImagesPullingTime="2.911885015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:14:33.715720059 +0000 UTC m=+733.468442785" watchObservedRunningTime="2026-07-20 21:14:33.715788231 +0000 UTC m=+733.468510955"
Jul 20 21:14:35.116854 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:35.116829    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f6zfv"]
Jul 20 21:14:35.710982 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:35.710949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f6zfv" event={"ID":"3f0ba208-6a35-41e8-8869-1e33509a8aee","Type":"ContainerStarted","Data":"a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54"}
Jul 20 21:14:35.711152 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:35.710949    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-f6zfv" podUID="3f0ba208-6a35-41e8-8869-1e33509a8aee" containerName="authorino" containerID="cri-o://a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54" gracePeriod=30
Jul 20 21:14:35.728202 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:35.728157    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-f6zfv" podStartSLOduration=1.740754782 podStartE2EDuration="5.728141751s" totalImagesPullingTime="3.987386969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:14:35.726602633 +0000 UTC m=+735.479325355" watchObservedRunningTime="2026-07-20 21:14:35.728141751 +0000 UTC m=+735.480864474"
Jul 20 21:14:35.951866 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:35.951843    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f6zfv"
Jul 20 21:14:36.003757 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.003726    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvtdj\" (UniqueName: \"kubernetes.io/projected/3f0ba208-6a35-41e8-8869-1e33509a8aee-kube-api-access-hvtdj\") pod \"3f0ba208-6a35-41e8-8869-1e33509a8aee\" (UID: \"3f0ba208-6a35-41e8-8869-1e33509a8aee\") "
Jul 20 21:14:36.005704 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.005676    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0ba208-6a35-41e8-8869-1e33509a8aee-kube-api-access-hvtdj" (OuterVolumeSpecName: "kube-api-access-hvtdj") pod "3f0ba208-6a35-41e8-8869-1e33509a8aee" (UID: "3f0ba208-6a35-41e8-8869-1e33509a8aee"). InnerVolumeSpecName "kube-api-access-hvtdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:14:36.104812 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.104767    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvtdj\" (UniqueName: \"kubernetes.io/projected/3f0ba208-6a35-41e8-8869-1e33509a8aee-kube-api-access-hvtdj\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:14:36.716989 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.716951    2573 generic.go:356] "Generic (PLEG): container finished" podID="3f0ba208-6a35-41e8-8869-1e33509a8aee" containerID="a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54" exitCode=0
Jul 20 21:14:36.717426 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.717015    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f6zfv"
Jul 20 21:14:36.717426 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.717056    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f6zfv" event={"ID":"3f0ba208-6a35-41e8-8869-1e33509a8aee","Type":"ContainerDied","Data":"a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54"}
Jul 20 21:14:36.717426 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.717130    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f6zfv" event={"ID":"3f0ba208-6a35-41e8-8869-1e33509a8aee","Type":"ContainerDied","Data":"ed45de0f6f715acd86b4b24458b0701c7927b3e69080db41e06427183eecc819"}
Jul 20 21:14:36.717426 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.717152    2573 scope.go:117] "RemoveContainer" containerID="a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54"
Jul 20 21:14:36.728411 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.728389    2573 scope.go:117] "RemoveContainer" containerID="a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54"
Jul 20 21:14:36.728681 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:14:36.728661    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54\": container with ID starting with a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54 not found: ID does not exist" containerID="a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54"
Jul 20 21:14:36.728727 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.728690    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54"} err="failed to get container status \"a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54\": rpc error: code = NotFound desc = could not find container \"a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54\": container with ID starting with a2d392bfd9c2ae71d4a1ec3ec2f7f9fc8bf361963d7a67dd301f1c1b6f5ddc54 not found: ID does not exist"
Jul 20 21:14:36.742239 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.742216    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f6zfv"]
Jul 20 21:14:36.745650 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.745629    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-f6zfv"]
Jul 20 21:14:36.769339 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:36.769316    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0ba208-6a35-41e8-8869-1e33509a8aee" path="/var/lib/kubelet/pods/3f0ba208-6a35-41e8-8869-1e33509a8aee/volumes"
Jul 20 21:14:44.688466 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:44.688427    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"]
Jul 20 21:14:44.689006 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:44.688641    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2" podUID="09b439f8-35c2-4727-b100-efa12c3069cd" containerName="limitador" containerID="cri-o://a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c" gracePeriod=30
Jul 20 21:14:44.689409 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:44.689322    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:45.236475 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.236451    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:45.279014 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.278943    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtxfl\" (UniqueName: \"kubernetes.io/projected/09b439f8-35c2-4727-b100-efa12c3069cd-kube-api-access-mtxfl\") pod \"09b439f8-35c2-4727-b100-efa12c3069cd\" (UID: \"09b439f8-35c2-4727-b100-efa12c3069cd\") "
Jul 20 21:14:45.279014 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.278974    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09b439f8-35c2-4727-b100-efa12c3069cd-config-file\") pod \"09b439f8-35c2-4727-b100-efa12c3069cd\" (UID: \"09b439f8-35c2-4727-b100-efa12c3069cd\") "
Jul 20 21:14:45.279365 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.279341    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09b439f8-35c2-4727-b100-efa12c3069cd-config-file" (OuterVolumeSpecName: "config-file") pod "09b439f8-35c2-4727-b100-efa12c3069cd" (UID: "09b439f8-35c2-4727-b100-efa12c3069cd"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:14:45.281042 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.281013    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09b439f8-35c2-4727-b100-efa12c3069cd-kube-api-access-mtxfl" (OuterVolumeSpecName: "kube-api-access-mtxfl") pod "09b439f8-35c2-4727-b100-efa12c3069cd" (UID: "09b439f8-35c2-4727-b100-efa12c3069cd"). InnerVolumeSpecName "kube-api-access-mtxfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:14:45.380457 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.380424    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtxfl\" (UniqueName: \"kubernetes.io/projected/09b439f8-35c2-4727-b100-efa12c3069cd-kube-api-access-mtxfl\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:14:45.380457 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.380451    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09b439f8-35c2-4727-b100-efa12c3069cd-config-file\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:14:45.768296 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.768263    2573 generic.go:356] "Generic (PLEG): container finished" podID="09b439f8-35c2-4727-b100-efa12c3069cd" containerID="a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c" exitCode=0
Jul 20 21:14:45.768296 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.768292    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"
Jul 20 21:14:45.768734 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.768333    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2" event={"ID":"09b439f8-35c2-4727-b100-efa12c3069cd","Type":"ContainerDied","Data":"a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c"}
Jul 20 21:14:45.768734 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.768376    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6mhz2" event={"ID":"09b439f8-35c2-4727-b100-efa12c3069cd","Type":"ContainerDied","Data":"ca0da9db15d1d27a13af05e4725be5ae25ad3311de7156b65d4cd6d74c62acfe"}
Jul 20 21:14:45.768734 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.768397    2573 scope.go:117] "RemoveContainer" containerID="a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c"
Jul 20 21:14:45.777211 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.777194    2573 scope.go:117] "RemoveContainer" containerID="a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c"
Jul 20 21:14:45.777447 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:14:45.777430    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c\": container with ID starting with a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c not found: ID does not exist" containerID="a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c"
Jul 20 21:14:45.777504 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.777459    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c"} err="failed to get container status \"a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c\": rpc error: code = NotFound desc = could not find container \"a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c\": container with ID starting with a21ff0012ce5e5e2163818f1042c4fc04c22bbf123cad7e7c40905b24188ad0c not found: ID does not exist"
Jul 20 21:14:45.797045 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.797024    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"]
Jul 20 21:14:45.800317 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:45.800289    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6mhz2"]
Jul 20 21:14:46.769903 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:46.769867    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09b439f8-35c2-4727-b100-efa12c3069cd" path="/var/lib/kubelet/pods/09b439f8-35c2-4727-b100-efa12c3069cd/volumes"
Jul 20 21:14:50.313200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.313172    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dp672"]
Jul 20 21:14:50.313574 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.313491    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0ba208-6a35-41e8-8869-1e33509a8aee" containerName="authorino"
Jul 20 21:14:50.313574 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.313502    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0ba208-6a35-41e8-8869-1e33509a8aee" containerName="authorino"
Jul 20 21:14:50.313574 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.313515    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b439f8-35c2-4727-b100-efa12c3069cd" containerName="limitador"
Jul 20 21:14:50.313574 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.313520    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b439f8-35c2-4727-b100-efa12c3069cd" containerName="limitador"
Jul 20 21:14:50.313574 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.313574    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0ba208-6a35-41e8-8869-1e33509a8aee" containerName="authorino"
Jul 20 21:14:50.313737 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.313581    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="09b439f8-35c2-4727-b100-efa12c3069cd" containerName="limitador"
Jul 20 21:14:50.321327 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.321306    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:14:50.325009 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.324988    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lh4wq\""
Jul 20 21:14:50.325858 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.325842    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 21:14:50.326401 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.326379    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 20 21:14:50.327716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.327442    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 21:14:50.335270 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.335248    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dp672"]
Jul 20 21:14:50.420717 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.420689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73dca0ed-dced-4a5c-a82e-065461d58508-data\") pod \"postgres-69fb4594cf-dp672\" (UID: \"73dca0ed-dced-4a5c-a82e-065461d58508\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:14:50.420885 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.420736    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqbjm\" (UniqueName: \"kubernetes.io/projected/73dca0ed-dced-4a5c-a82e-065461d58508-kube-api-access-qqbjm\") pod \"postgres-69fb4594cf-dp672\" (UID: \"73dca0ed-dced-4a5c-a82e-065461d58508\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:14:50.521669 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.521634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73dca0ed-dced-4a5c-a82e-065461d58508-data\") pod \"postgres-69fb4594cf-dp672\" (UID: \"73dca0ed-dced-4a5c-a82e-065461d58508\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:14:50.521833 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.521676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqbjm\" (UniqueName: \"kubernetes.io/projected/73dca0ed-dced-4a5c-a82e-065461d58508-kube-api-access-qqbjm\") pod \"postgres-69fb4594cf-dp672\" (UID: \"73dca0ed-dced-4a5c-a82e-065461d58508\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:14:50.521992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.521974    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73dca0ed-dced-4a5c-a82e-065461d58508-data\") pod \"postgres-69fb4594cf-dp672\" (UID: \"73dca0ed-dced-4a5c-a82e-065461d58508\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:14:50.530984 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.530952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqbjm\" (UniqueName: \"kubernetes.io/projected/73dca0ed-dced-4a5c-a82e-065461d58508-kube-api-access-qqbjm\") pod \"postgres-69fb4594cf-dp672\" (UID: \"73dca0ed-dced-4a5c-a82e-065461d58508\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:14:50.631686 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.631601    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:14:50.760143 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.760117    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dp672"]
Jul 20 21:14:50.761942 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:14:50.761900    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73dca0ed_dced_4a5c_a82e_065461d58508.slice/crio-725ac4cd11eb9ebaa78ac1d1c5c9edd2a485e773adf430fbfd532ef6c29e280a WatchSource:0}: Error finding container 725ac4cd11eb9ebaa78ac1d1c5c9edd2a485e773adf430fbfd532ef6c29e280a: Status 404 returned error can't find the container with id 725ac4cd11eb9ebaa78ac1d1c5c9edd2a485e773adf430fbfd532ef6c29e280a
Jul 20 21:14:50.793395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:50.793366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672" event={"ID":"73dca0ed-dced-4a5c-a82e-065461d58508","Type":"ContainerStarted","Data":"725ac4cd11eb9ebaa78ac1d1c5c9edd2a485e773adf430fbfd532ef6c29e280a"}
Jul 20 21:14:55.825224 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:55.825139    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672" event={"ID":"73dca0ed-dced-4a5c-a82e-065461d58508","Type":"ContainerStarted","Data":"3adc814abfbcaee24fbc4af9086066b93b50f8fe9921f3fd1b1696301fcfa272"}
Jul 20 21:14:55.825599 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:55.825247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:14:55.843268 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:14:55.843218    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672" podStartSLOduration=1.06756689 podStartE2EDuration="5.843203964s" totalImagesPullingTime="4.775637074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:14:55.841725611 +0000 UTC m=+755.594448357" watchObservedRunningTime="2026-07-20 21:14:55.843203964 +0000 UTC m=+755.595926687"
Jul 20 21:15:01.861046 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:01.861011    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dp672"
Jul 20 21:15:02.530362 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.530327    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-477jz"]
Jul 20 21:15:02.533809 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.533789    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-477jz"
Jul 20 21:15:02.536644 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.536621    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kn45b\""
Jul 20 21:15:02.542904 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.542880    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-477jz"]
Jul 20 21:15:02.627263 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.627235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgh4h\" (UniqueName: \"kubernetes.io/projected/be03eab5-a6ed-47c8-bdfb-a8369d7bbaca-kube-api-access-vgh4h\") pod \"authorino-5d4b67c446-477jz\" (UID: \"be03eab5-a6ed-47c8-bdfb-a8369d7bbaca\") " pod="kuadrant-system/authorino-5d4b67c446-477jz"
Jul 20 21:15:02.721657 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.721627    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-477jz"]
Jul 20 21:15:02.721897 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:15:02.721877    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vgh4h], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-477jz" podUID="be03eab5-a6ed-47c8-bdfb-a8369d7bbaca"
Jul 20 21:15:02.727583 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.727556    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgh4h\" (UniqueName: \"kubernetes.io/projected/be03eab5-a6ed-47c8-bdfb-a8369d7bbaca-kube-api-access-vgh4h\") pod \"authorino-5d4b67c446-477jz\" (UID: \"be03eab5-a6ed-47c8-bdfb-a8369d7bbaca\") " pod="kuadrant-system/authorino-5d4b67c446-477jz"
Jul 20 21:15:02.741160 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.741135    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgh4h\" (UniqueName: \"kubernetes.io/projected/be03eab5-a6ed-47c8-bdfb-a8369d7bbaca-kube-api-access-vgh4h\") pod \"authorino-5d4b67c446-477jz\" (UID: \"be03eab5-a6ed-47c8-bdfb-a8369d7bbaca\") " pod="kuadrant-system/authorino-5d4b67c446-477jz"
Jul 20 21:15:02.752399 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.752377    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-95x4h"]
Jul 20 21:15:02.755858 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.755841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:02.758755 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.758734    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 21:15:02.770156 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.770137    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-95x4h"]
Jul 20 21:15:02.817834 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.817753    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-95x4h"]
Jul 20 21:15:02.818050 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:15:02.818026    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5z9bl tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-95x4h" podUID="4f27a40c-21b2-405d-b8b7-71d7d38fab78"
Jul 20 21:15:02.828219 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.828192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z9bl\" (UniqueName: \"kubernetes.io/projected/4f27a40c-21b2-405d-b8b7-71d7d38fab78-kube-api-access-5z9bl\") pod \"authorino-76877994-95x4h\" (UID: \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\") " pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:02.828314 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.828301    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4f27a40c-21b2-405d-b8b7-71d7d38fab78-tls-cert\") pod \"authorino-76877994-95x4h\" (UID: \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\") " pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:02.845695 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.845665    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66fc8b4b67-q7h54"]
Jul 20 21:15:02.849120 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.849103    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:15:02.858983 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.858960    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66fc8b4b67-q7h54"]
Jul 20 21:15:02.859832 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.859809    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:02.859918 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.859833    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-477jz"
Jul 20 21:15:02.866678 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.866656    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:02.870967 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.870948    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-477jz"
Jul 20 21:15:02.929305 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.929272    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgh4h\" (UniqueName: \"kubernetes.io/projected/be03eab5-a6ed-47c8-bdfb-a8369d7bbaca-kube-api-access-vgh4h\") pod \"be03eab5-a6ed-47c8-bdfb-a8369d7bbaca\" (UID: \"be03eab5-a6ed-47c8-bdfb-a8369d7bbaca\") "
Jul 20 21:15:02.929428 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.929415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4f27a40c-21b2-405d-b8b7-71d7d38fab78-tls-cert\") pod \"authorino-76877994-95x4h\" (UID: \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\") " pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:02.929493 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.929456    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z9bl\" (UniqueName: \"kubernetes.io/projected/4f27a40c-21b2-405d-b8b7-71d7d38fab78-kube-api-access-5z9bl\") pod \"authorino-76877994-95x4h\" (UID: \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\") " pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:02.929548 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.929493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c197eac8-08b9-425b-9a20-4cc6a9360ab2-tls-cert\") pod \"authorino-66fc8b4b67-q7h54\" (UID: \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\") " pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:15:02.929548 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.929543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knhnx\" (UniqueName: \"kubernetes.io/projected/c197eac8-08b9-425b-9a20-4cc6a9360ab2-kube-api-access-knhnx\") pod \"authorino-66fc8b4b67-q7h54\" (UID: \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\") " pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:15:02.931260 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.931234    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be03eab5-a6ed-47c8-bdfb-a8369d7bbaca-kube-api-access-vgh4h" (OuterVolumeSpecName: "kube-api-access-vgh4h") pod "be03eab5-a6ed-47c8-bdfb-a8369d7bbaca" (UID: "be03eab5-a6ed-47c8-bdfb-a8369d7bbaca"). InnerVolumeSpecName "kube-api-access-vgh4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:15:02.931862 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.931844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4f27a40c-21b2-405d-b8b7-71d7d38fab78-tls-cert\") pod \"authorino-76877994-95x4h\" (UID: \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\") " pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:02.937838 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:02.937815    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z9bl\" (UniqueName: \"kubernetes.io/projected/4f27a40c-21b2-405d-b8b7-71d7d38fab78-kube-api-access-5z9bl\") pod \"authorino-76877994-95x4h\" (UID: \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\") " pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:03.029970 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.029938    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4f27a40c-21b2-405d-b8b7-71d7d38fab78-tls-cert\") pod \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\" (UID: \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\") "
Jul 20 21:15:03.030135 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.029990    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z9bl\" (UniqueName: \"kubernetes.io/projected/4f27a40c-21b2-405d-b8b7-71d7d38fab78-kube-api-access-5z9bl\") pod \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\" (UID: \"4f27a40c-21b2-405d-b8b7-71d7d38fab78\") "
Jul 20 21:15:03.030135 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.030111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knhnx\" (UniqueName: \"kubernetes.io/projected/c197eac8-08b9-425b-9a20-4cc6a9360ab2-kube-api-access-knhnx\") pod \"authorino-66fc8b4b67-q7h54\" (UID: \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\") " pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:15:03.030221 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.030164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c197eac8-08b9-425b-9a20-4cc6a9360ab2-tls-cert\") pod \"authorino-66fc8b4b67-q7h54\" (UID: \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\") " pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:15:03.030221 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.030198    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgh4h\" (UniqueName: \"kubernetes.io/projected/be03eab5-a6ed-47c8-bdfb-a8369d7bbaca-kube-api-access-vgh4h\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:15:03.032089 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.032048    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f27a40c-21b2-405d-b8b7-71d7d38fab78-kube-api-access-5z9bl" (OuterVolumeSpecName: "kube-api-access-5z9bl") pod "4f27a40c-21b2-405d-b8b7-71d7d38fab78" (UID: "4f27a40c-21b2-405d-b8b7-71d7d38fab78"). InnerVolumeSpecName "kube-api-access-5z9bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:15:03.032089 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.032057    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f27a40c-21b2-405d-b8b7-71d7d38fab78-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4f27a40c-21b2-405d-b8b7-71d7d38fab78" (UID: "4f27a40c-21b2-405d-b8b7-71d7d38fab78"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:15:03.032425 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.032408    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c197eac8-08b9-425b-9a20-4cc6a9360ab2-tls-cert\") pod \"authorino-66fc8b4b67-q7h54\" (UID: \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\") " pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:15:03.038907 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.038884    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knhnx\" (UniqueName: \"kubernetes.io/projected/c197eac8-08b9-425b-9a20-4cc6a9360ab2-kube-api-access-knhnx\") pod \"authorino-66fc8b4b67-q7h54\" (UID: \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\") " pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:15:03.131402 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.131333    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4f27a40c-21b2-405d-b8b7-71d7d38fab78-tls-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:15:03.131402 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.131359    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z9bl\" (UniqueName: \"kubernetes.io/projected/4f27a40c-21b2-405d-b8b7-71d7d38fab78-kube-api-access-5z9bl\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:15:03.158410 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.158383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:15:03.287828 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.287797    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66fc8b4b67-q7h54"]
Jul 20 21:15:03.289257 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:15:03.289223    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc197eac8_08b9_425b_9a20_4cc6a9360ab2.slice/crio-147161e5e96272aa24e3506e389e3e0e800ef74e3cbb5792456b24a416a55163 WatchSource:0}: Error finding container 147161e5e96272aa24e3506e389e3e0e800ef74e3cbb5792456b24a416a55163: Status 404 returned error can't find the container with id 147161e5e96272aa24e3506e389e3e0e800ef74e3cbb5792456b24a416a55163
Jul 20 21:15:03.866276 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.866235    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66fc8b4b67-q7h54" event={"ID":"c197eac8-08b9-425b-9a20-4cc6a9360ab2","Type":"ContainerStarted","Data":"250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4"}
Jul 20 21:15:03.866455 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.866289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66fc8b4b67-q7h54" event={"ID":"c197eac8-08b9-425b-9a20-4cc6a9360ab2","Type":"ContainerStarted","Data":"147161e5e96272aa24e3506e389e3e0e800ef74e3cbb5792456b24a416a55163"}
Jul 20 21:15:03.866455 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.866425    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-477jz"
Jul 20 21:15:03.866541 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.866520    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-95x4h"
Jul 20 21:15:03.883863 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.883817    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66fc8b4b67-q7h54" podStartSLOduration=1.5193699139999999 podStartE2EDuration="1.8838031s" totalImagesPullingTime="364.433186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:15:03.882289875 +0000 UTC m=+763.635012598" watchObservedRunningTime="2026-07-20 21:15:03.8838031 +0000 UTC m=+763.636525822"
Jul 20 21:15:03.907681 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.907613    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-95x4h"]
Jul 20 21:15:03.912045 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.912014    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-95x4h"]
Jul 20 21:15:03.937851 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.937824    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-477jz"]
Jul 20 21:15:03.944870 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:03.944840    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-477jz"]
Jul 20 21:15:04.769457 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:04.769425    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f27a40c-21b2-405d-b8b7-71d7d38fab78" path="/var/lib/kubelet/pods/4f27a40c-21b2-405d-b8b7-71d7d38fab78/volumes"
Jul 20 21:15:04.769660 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:04.769648    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be03eab5-a6ed-47c8-bdfb-a8369d7bbaca" path="/var/lib/kubelet/pods/be03eab5-a6ed-47c8-bdfb-a8369d7bbaca/volumes"
Jul 20 21:15:09.559395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.559360    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c47f4b457-mtzqj"]
Jul 20 21:15:09.567418 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.567385    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:09.574289 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.574266    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 21:15:09.574389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.574268    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 21:15:09.575005 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.574987    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j9s86\""
Jul 20 21:15:09.607968 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.607932    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c47f4b457-mtzqj"]
Jul 20 21:15:09.685507 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.685475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4376cded-f86b-4e3d-8e13-0371726cbb75-webhook-cert\") pod \"maas-controller-5c47f4b457-mtzqj\" (UID: \"4376cded-f86b-4e3d-8e13-0371726cbb75\") " pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:09.685654 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.685550    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc6sx\" (UniqueName: \"kubernetes.io/projected/4376cded-f86b-4e3d-8e13-0371726cbb75-kube-api-access-sc6sx\") pod \"maas-controller-5c47f4b457-mtzqj\" (UID: \"4376cded-f86b-4e3d-8e13-0371726cbb75\") " pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:09.786596 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.786558    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc6sx\" (UniqueName: \"kubernetes.io/projected/4376cded-f86b-4e3d-8e13-0371726cbb75-kube-api-access-sc6sx\") pod \"maas-controller-5c47f4b457-mtzqj\" (UID: \"4376cded-f86b-4e3d-8e13-0371726cbb75\") " pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:09.786770 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.786613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4376cded-f86b-4e3d-8e13-0371726cbb75-webhook-cert\") pod \"maas-controller-5c47f4b457-mtzqj\" (UID: \"4376cded-f86b-4e3d-8e13-0371726cbb75\") " pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:09.786770 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:15:09.786750    2573 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 20 21:15:09.786858 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:15:09.786826    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4376cded-f86b-4e3d-8e13-0371726cbb75-webhook-cert podName:4376cded-f86b-4e3d-8e13-0371726cbb75 nodeName:}" failed. No retries permitted until 2026-07-20 21:15:10.286809109 +0000 UTC m=+770.039531810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4376cded-f86b-4e3d-8e13-0371726cbb75-webhook-cert") pod "maas-controller-5c47f4b457-mtzqj" (UID: "4376cded-f86b-4e3d-8e13-0371726cbb75") : secret "maas-controller-webhook-cert" not found
Jul 20 21:15:09.799997 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.799964    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84bff768b5-nt95c"]
Jul 20 21:15:09.802332 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.802310    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:09.803224 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.803198    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc6sx\" (UniqueName: \"kubernetes.io/projected/4376cded-f86b-4e3d-8e13-0371726cbb75-kube-api-access-sc6sx\") pod \"maas-controller-5c47f4b457-mtzqj\" (UID: \"4376cded-f86b-4e3d-8e13-0371726cbb75\") " pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:09.819937 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.819913    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84bff768b5-nt95c"]
Jul 20 21:15:09.887437 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.887405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fc650a0-f269-4c4a-a377-b25e35c9ce02-webhook-cert\") pod \"maas-controller-84bff768b5-nt95c\" (UID: \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\") " pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:09.887598 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.887470    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftpv8\" (UniqueName: \"kubernetes.io/projected/1fc650a0-f269-4c4a-a377-b25e35c9ce02-kube-api-access-ftpv8\") pod \"maas-controller-84bff768b5-nt95c\" (UID: \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\") " pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:09.988297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.988264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fc650a0-f269-4c4a-a377-b25e35c9ce02-webhook-cert\") pod \"maas-controller-84bff768b5-nt95c\" (UID: \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\") " pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:09.988465 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.988317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftpv8\" (UniqueName: \"kubernetes.io/projected/1fc650a0-f269-4c4a-a377-b25e35c9ce02-kube-api-access-ftpv8\") pod \"maas-controller-84bff768b5-nt95c\" (UID: \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\") " pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:09.990697 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.990665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fc650a0-f269-4c4a-a377-b25e35c9ce02-webhook-cert\") pod \"maas-controller-84bff768b5-nt95c\" (UID: \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\") " pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:09.997476 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:09.997454    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftpv8\" (UniqueName: \"kubernetes.io/projected/1fc650a0-f269-4c4a-a377-b25e35c9ce02-kube-api-access-ftpv8\") pod \"maas-controller-84bff768b5-nt95c\" (UID: \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\") " pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:10.121799 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:10.121715    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:10.258725 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:10.258702    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84bff768b5-nt95c"]
Jul 20 21:15:10.260262 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:15:10.260236    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc650a0_f269_4c4a_a377_b25e35c9ce02.slice/crio-47f60a1cec45909e95a68613a3b582517003de6a7d5128ee54b9159b09bf27aa WatchSource:0}: Error finding container 47f60a1cec45909e95a68613a3b582517003de6a7d5128ee54b9159b09bf27aa: Status 404 returned error can't find the container with id 47f60a1cec45909e95a68613a3b582517003de6a7d5128ee54b9159b09bf27aa
Jul 20 21:15:10.291543 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:10.291519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4376cded-f86b-4e3d-8e13-0371726cbb75-webhook-cert\") pod \"maas-controller-5c47f4b457-mtzqj\" (UID: \"4376cded-f86b-4e3d-8e13-0371726cbb75\") " pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:10.293736 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:10.293718    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4376cded-f86b-4e3d-8e13-0371726cbb75-webhook-cert\") pod \"maas-controller-5c47f4b457-mtzqj\" (UID: \"4376cded-f86b-4e3d-8e13-0371726cbb75\") " pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:10.477683 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:10.477648    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:10.613138 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:10.613105    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c47f4b457-mtzqj"]
Jul 20 21:15:10.614780 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:15:10.614753    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4376cded_f86b_4e3d_8e13_0371726cbb75.slice/crio-f0b0173b32b350cb44d10f6b46c29b1176f656cdcdf6fd1e417c9b29ddcce66d WatchSource:0}: Error finding container f0b0173b32b350cb44d10f6b46c29b1176f656cdcdf6fd1e417c9b29ddcce66d: Status 404 returned error can't find the container with id f0b0173b32b350cb44d10f6b46c29b1176f656cdcdf6fd1e417c9b29ddcce66d
Jul 20 21:15:10.902399 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:10.902308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c47f4b457-mtzqj" event={"ID":"4376cded-f86b-4e3d-8e13-0371726cbb75","Type":"ContainerStarted","Data":"f0b0173b32b350cb44d10f6b46c29b1176f656cdcdf6fd1e417c9b29ddcce66d"}
Jul 20 21:15:10.903591 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:10.903557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-nt95c" event={"ID":"1fc650a0-f269-4c4a-a377-b25e35c9ce02","Type":"ContainerStarted","Data":"47f60a1cec45909e95a68613a3b582517003de6a7d5128ee54b9159b09bf27aa"}
Jul 20 21:15:12.917269 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:12.917222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c47f4b457-mtzqj" event={"ID":"4376cded-f86b-4e3d-8e13-0371726cbb75","Type":"ContainerStarted","Data":"762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7"}
Jul 20 21:15:12.918028 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:12.917988    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:12.919458 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:12.919432    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-nt95c" event={"ID":"1fc650a0-f269-4c4a-a377-b25e35c9ce02","Type":"ContainerStarted","Data":"80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef"}
Jul 20 21:15:12.919592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:12.919570    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:12.974599 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:12.974518    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c47f4b457-mtzqj" podStartSLOduration=1.8652515840000001 podStartE2EDuration="3.974503906s" totalImagesPullingTime="2.109252322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:15:12.944264773 +0000 UTC m=+772.696987475" watchObservedRunningTime="2026-07-20 21:15:12.974503906 +0000 UTC m=+772.727226629"
Jul 20 21:15:12.975723 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:12.975683    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84bff768b5-nt95c" podStartSLOduration=1.50937728 podStartE2EDuration="3.975672318s" totalImagesPullingTime="2.466295038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:15:12.973400972 +0000 UTC m=+772.726123715" watchObservedRunningTime="2026-07-20 21:15:12.975672318 +0000 UTC m=+772.728395040"
Jul 20 21:15:23.926807 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:23.926775    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:23.927220 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:23.926871    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:15:23.991291 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:23.991254    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c47f4b457-mtzqj"]
Jul 20 21:15:23.991534 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:23.991508    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c47f4b457-mtzqj" podUID="4376cded-f86b-4e3d-8e13-0371726cbb75" containerName="manager" containerID="cri-o://762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7" gracePeriod=30
Jul 20 21:15:24.234593 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.234559    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:24.411473 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.411436    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4376cded-f86b-4e3d-8e13-0371726cbb75-webhook-cert\") pod \"4376cded-f86b-4e3d-8e13-0371726cbb75\" (UID: \"4376cded-f86b-4e3d-8e13-0371726cbb75\") "
Jul 20 21:15:24.411633 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.411538    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc6sx\" (UniqueName: \"kubernetes.io/projected/4376cded-f86b-4e3d-8e13-0371726cbb75-kube-api-access-sc6sx\") pod \"4376cded-f86b-4e3d-8e13-0371726cbb75\" (UID: \"4376cded-f86b-4e3d-8e13-0371726cbb75\") "
Jul 20 21:15:24.413643 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.413615    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4376cded-f86b-4e3d-8e13-0371726cbb75-kube-api-access-sc6sx" (OuterVolumeSpecName: "kube-api-access-sc6sx") pod "4376cded-f86b-4e3d-8e13-0371726cbb75" (UID: "4376cded-f86b-4e3d-8e13-0371726cbb75"). InnerVolumeSpecName "kube-api-access-sc6sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:15:24.413643 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.413633    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4376cded-f86b-4e3d-8e13-0371726cbb75-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4376cded-f86b-4e3d-8e13-0371726cbb75" (UID: "4376cded-f86b-4e3d-8e13-0371726cbb75"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:15:24.512424 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.512385    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4376cded-f86b-4e3d-8e13-0371726cbb75-webhook-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:15:24.512424 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.512413    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc6sx\" (UniqueName: \"kubernetes.io/projected/4376cded-f86b-4e3d-8e13-0371726cbb75-kube-api-access-sc6sx\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:15:24.982612 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.982577    2573 generic.go:356] "Generic (PLEG): container finished" podID="4376cded-f86b-4e3d-8e13-0371726cbb75" containerID="762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7" exitCode=0
Jul 20 21:15:24.983057 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.982626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c47f4b457-mtzqj" event={"ID":"4376cded-f86b-4e3d-8e13-0371726cbb75","Type":"ContainerDied","Data":"762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7"}
Jul 20 21:15:24.983057 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.982627    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c47f4b457-mtzqj"
Jul 20 21:15:24.983057 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.982672    2573 scope.go:117] "RemoveContainer" containerID="762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7"
Jul 20 21:15:24.983057 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.982663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c47f4b457-mtzqj" event={"ID":"4376cded-f86b-4e3d-8e13-0371726cbb75","Type":"ContainerDied","Data":"f0b0173b32b350cb44d10f6b46c29b1176f656cdcdf6fd1e417c9b29ddcce66d"}
Jul 20 21:15:24.991457 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.991442    2573 scope.go:117] "RemoveContainer" containerID="762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7"
Jul 20 21:15:24.991743 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:15:24.991710    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7\": container with ID starting with 762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7 not found: ID does not exist" containerID="762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7"
Jul 20 21:15:24.991812 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:24.991750    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7"} err="failed to get container status \"762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7\": rpc error: code = NotFound desc = could not find container \"762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7\": container with ID starting with 762c1ce03f86cd0569eb3554d6e9d32442aaa4d51aeab96bb8adee149a7225f7 not found: ID does not exist"
Jul 20 21:15:25.002959 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:25.002936    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c47f4b457-mtzqj"]
Jul 20 21:15:25.006572 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:25.006549    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c47f4b457-mtzqj"]
Jul 20 21:15:26.769636 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:26.769599    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4376cded-f86b-4e3d-8e13-0371726cbb75" path="/var/lib/kubelet/pods/4376cded-f86b-4e3d-8e13-0371726cbb75/volumes"
Jul 20 21:15:45.285059 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.284985    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"]
Jul 20 21:15:45.285442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.285333    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4376cded-f86b-4e3d-8e13-0371726cbb75" containerName="manager"
Jul 20 21:15:45.285442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.285344    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4376cded-f86b-4e3d-8e13-0371726cbb75" containerName="manager"
Jul 20 21:15:45.285442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.285406    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4376cded-f86b-4e3d-8e13-0371726cbb75" containerName="manager"
Jul 20 21:15:45.311226 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.311200    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"]
Jul 20 21:15:45.311388 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.311330    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.314253 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.314229    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4pmwd\""
Jul 20 21:15:45.314583 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.314562    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 21:15:45.385169 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.385134    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk87b\" (UniqueName: \"kubernetes.io/projected/44a1d39b-4e7d-4061-9fbd-c1414475373f-kube-api-access-lk87b\") pod \"maas-api-664b6b5859-4rzwn\" (UID: \"44a1d39b-4e7d-4061-9fbd-c1414475373f\") " pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.385330 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.385195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a1d39b-4e7d-4061-9fbd-c1414475373f-maas-api-tls\") pod \"maas-api-664b6b5859-4rzwn\" (UID: \"44a1d39b-4e7d-4061-9fbd-c1414475373f\") " pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.385330 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.385220    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a1d39b-4e7d-4061-9fbd-c1414475373f-openshift-service-ca\") pod \"maas-api-664b6b5859-4rzwn\" (UID: \"44a1d39b-4e7d-4061-9fbd-c1414475373f\") " pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.486016 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.485984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a1d39b-4e7d-4061-9fbd-c1414475373f-maas-api-tls\") pod \"maas-api-664b6b5859-4rzwn\" (UID: \"44a1d39b-4e7d-4061-9fbd-c1414475373f\") " pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.486016 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.486019    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a1d39b-4e7d-4061-9fbd-c1414475373f-openshift-service-ca\") pod \"maas-api-664b6b5859-4rzwn\" (UID: \"44a1d39b-4e7d-4061-9fbd-c1414475373f\") " pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.486285 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.486218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk87b\" (UniqueName: \"kubernetes.io/projected/44a1d39b-4e7d-4061-9fbd-c1414475373f-kube-api-access-lk87b\") pod \"maas-api-664b6b5859-4rzwn\" (UID: \"44a1d39b-4e7d-4061-9fbd-c1414475373f\") " pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.486630 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.486611    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a1d39b-4e7d-4061-9fbd-c1414475373f-openshift-service-ca\") pod \"maas-api-664b6b5859-4rzwn\" (UID: \"44a1d39b-4e7d-4061-9fbd-c1414475373f\") " pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.488440 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.488420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a1d39b-4e7d-4061-9fbd-c1414475373f-maas-api-tls\") pod \"maas-api-664b6b5859-4rzwn\" (UID: \"44a1d39b-4e7d-4061-9fbd-c1414475373f\") " pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.501130 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.501102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk87b\" (UniqueName: \"kubernetes.io/projected/44a1d39b-4e7d-4061-9fbd-c1414475373f-kube-api-access-lk87b\") pod \"maas-api-664b6b5859-4rzwn\" (UID: \"44a1d39b-4e7d-4061-9fbd-c1414475373f\") " pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.624600 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.624525    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:45.780552 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.780523    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"]
Jul 20 21:15:45.782669 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:15:45.782641    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a1d39b_4e7d_4061_9fbd_c1414475373f.slice/crio-b5f3020c497f33f23a75e3abffc6cc6c9dd0d863cce7a4e3d2c39d748ebc5379 WatchSource:0}: Error finding container b5f3020c497f33f23a75e3abffc6cc6c9dd0d863cce7a4e3d2c39d748ebc5379: Status 404 returned error can't find the container with id b5f3020c497f33f23a75e3abffc6cc6c9dd0d863cce7a4e3d2c39d748ebc5379
Jul 20 21:15:45.998466 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:45.998437    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-dp276"]
Jul 20 21:15:46.001655 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.001636    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:15:46.005794 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.005775    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 20 21:15:46.014784 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.014762    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-dp276"]
Jul 20 21:15:46.090901 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.090866    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn" event={"ID":"44a1d39b-4e7d-4061-9fbd-c1414475373f","Type":"ContainerStarted","Data":"b5f3020c497f33f23a75e3abffc6cc6c9dd0d863cce7a4e3d2c39d748ebc5379"}
Jul 20 21:15:46.091053 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.091030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-478rw\" (UniqueName: \"kubernetes.io/projected/90fe6e8f-3769-43ca-8f56-370cb996b0ae-kube-api-access-478rw\") pod \"payload-processing-5bf47cd988-dp276\" (UID: \"90fe6e8f-3769-43ca-8f56-370cb996b0ae\") " pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:15:46.091138 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.091123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90fe6e8f-3769-43ca-8f56-370cb996b0ae-plugins-config-volume\") pod \"payload-processing-5bf47cd988-dp276\" (UID: \"90fe6e8f-3769-43ca-8f56-370cb996b0ae\") " pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:15:46.192373 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.192338    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90fe6e8f-3769-43ca-8f56-370cb996b0ae-plugins-config-volume\") pod \"payload-processing-5bf47cd988-dp276\" (UID: \"90fe6e8f-3769-43ca-8f56-370cb996b0ae\") " pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:15:46.192561 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.192392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-478rw\" (UniqueName: \"kubernetes.io/projected/90fe6e8f-3769-43ca-8f56-370cb996b0ae-kube-api-access-478rw\") pod \"payload-processing-5bf47cd988-dp276\" (UID: \"90fe6e8f-3769-43ca-8f56-370cb996b0ae\") " pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:15:46.193043 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.193017    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90fe6e8f-3769-43ca-8f56-370cb996b0ae-plugins-config-volume\") pod \"payload-processing-5bf47cd988-dp276\" (UID: \"90fe6e8f-3769-43ca-8f56-370cb996b0ae\") " pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:15:46.203512 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.203485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-478rw\" (UniqueName: \"kubernetes.io/projected/90fe6e8f-3769-43ca-8f56-370cb996b0ae-kube-api-access-478rw\") pod \"payload-processing-5bf47cd988-dp276\" (UID: \"90fe6e8f-3769-43ca-8f56-370cb996b0ae\") " pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:15:46.312631 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.312546    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:15:46.475120 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:46.475062    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-dp276"]
Jul 20 21:15:46.478067 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:15:46.478022    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90fe6e8f_3769_43ca_8f56_370cb996b0ae.slice/crio-fe6e2b6da8fc79ab18904d5ad628b1fa846b580b511eea09221e46f1b8a124c5 WatchSource:0}: Error finding container fe6e2b6da8fc79ab18904d5ad628b1fa846b580b511eea09221e46f1b8a124c5: Status 404 returned error can't find the container with id fe6e2b6da8fc79ab18904d5ad628b1fa846b580b511eea09221e46f1b8a124c5
Jul 20 21:15:47.099503 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:47.099466    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-dp276" event={"ID":"90fe6e8f-3769-43ca-8f56-370cb996b0ae","Type":"ContainerStarted","Data":"fe6e2b6da8fc79ab18904d5ad628b1fa846b580b511eea09221e46f1b8a124c5"}
Jul 20 21:15:48.107938 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:48.107902    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn" event={"ID":"44a1d39b-4e7d-4061-9fbd-c1414475373f","Type":"ContainerStarted","Data":"a6af3bad38b21f3f5c5f651e72aff383957e0db02039d96be8f9e1aaca01d5b5"}
Jul 20 21:15:48.108433 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:48.108054    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:48.147099 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:48.146369    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn" podStartSLOduration=1.374729372 podStartE2EDuration="3.146344319s" totalImagesPullingTime="1.771614947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:15:48.143549951 +0000 UTC m=+807.896272691" watchObservedRunningTime="2026-07-20 21:15:48.146344319 +0000 UTC m=+807.899067042"
Jul 20 21:15:49.115902 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:49.115862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-dp276" event={"ID":"90fe6e8f-3769-43ca-8f56-370cb996b0ae","Type":"ContainerStarted","Data":"f93a70cfa5c3b9a0c8c2dc486fe03d18a5b7468230c3a0f45c7b11e2b6787e8a"}
Jul 20 21:15:49.116343 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:49.115975    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:15:49.132175 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:49.132115    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-dp276" podStartSLOduration=1.622540987 podStartE2EDuration="4.132094494s" totalImagesPullingTime="2.509553507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:15:49.130766377 +0000 UTC m=+808.883489120" watchObservedRunningTime="2026-07-20 21:15:49.132094494 +0000 UTC m=+808.884817212"
Jul 20 21:15:54.121856 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:54.121821    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-664b6b5859-4rzwn"
Jul 20 21:15:54.144389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:54.144357    2573 generic.go:356] "Generic (PLEG): container finished" podID="160bec94-7fb5-4d02-a1b5-deeffc2c9109" containerID="d86052079c91a6f904b70d9be18f13a6dc195c3779e1930e6fbd1a66acb007e4" exitCode=0
Jul 20 21:15:54.144542 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:54.144412    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl" event={"ID":"160bec94-7fb5-4d02-a1b5-deeffc2c9109","Type":"ContainerDied","Data":"d86052079c91a6f904b70d9be18f13a6dc195c3779e1930e6fbd1a66acb007e4"}
Jul 20 21:15:54.144809 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:54.144790    2573 scope.go:117] "RemoveContainer" containerID="d86052079c91a6f904b70d9be18f13a6dc195c3779e1930e6fbd1a66acb007e4"
Jul 20 21:15:54.145739 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:54.145706    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:15:54.145809 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:54.145793    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:15:54.145845 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:54.145834    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:15:55.154711 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:55.154669    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl" event={"ID":"160bec94-7fb5-4d02-a1b5-deeffc2c9109","Type":"ContainerStarted","Data":"0176c4b287479f6aecf7ad0571eea97de87342492821224804ab5ec41d7cee71"}
Jul 20 21:15:55.614130 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:55.614065    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:15:55.614407 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:55.614381    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qcshl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 20 21:15:55.614454 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:55.614439    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl" podUID="160bec94-7fb5-4d02-a1b5-deeffc2c9109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 20 21:15:56.614349 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:56.614307    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qcshl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 20 21:15:56.614744 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:56.614367    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl" podUID="160bec94-7fb5-4d02-a1b5-deeffc2c9109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 20 21:15:57.613649 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:57.613607    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qcshl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 20 21:15:57.613858 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:57.613673    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl" podUID="160bec94-7fb5-4d02-a1b5-deeffc2c9109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 20 21:15:58.613333 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:58.613295    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qcshl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 20 21:15:58.613710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:58.613357    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl" podUID="160bec94-7fb5-4d02-a1b5-deeffc2c9109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 20 21:15:59.617784 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:59.617752    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:15:59.618320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:59.618070    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:15:59.618721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:15:59.618703    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qcshl"
Jul 20 21:16:00.123261 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:00.123225    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-dp276"
Jul 20 21:16:10.975482 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:10.975448    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"]
Jul 20 21:16:10.979901 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:10.979814    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:10.984947 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:10.984918    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 21:16:10.984947 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:10.984944    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 20 21:16:10.985191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:10.984996    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fmhkv\""
Jul 20 21:16:10.985191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:10.985006    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 21:16:10.995270 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:10.995246    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"]
Jul 20 21:16:11.122862 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.122830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.122862 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.122865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b821fc70-079b-4843-9fe1-facb8113a313-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.123070 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.122901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.123070 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.122974    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.123070 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.123021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkwbr\" (UniqueName: \"kubernetes.io/projected/b821fc70-079b-4843-9fe1-facb8113a313-kube-api-access-tkwbr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.123070 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.123054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.224497 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.224461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.224673 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.224503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkwbr\" (UniqueName: \"kubernetes.io/projected/b821fc70-079b-4843-9fe1-facb8113a313-kube-api-access-tkwbr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.224673 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.224542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.224673 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.224604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.224673 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.224626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b821fc70-079b-4843-9fe1-facb8113a313-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.224881 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.224681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.224952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.224925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.225017 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.225001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.225120 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.225031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.227481 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.227416    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b821fc70-079b-4843-9fe1-facb8113a313-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.227481 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.227430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b821fc70-079b-4843-9fe1-facb8113a313-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.232559 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.232532    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkwbr\" (UniqueName: \"kubernetes.io/projected/b821fc70-079b-4843-9fe1-facb8113a313-kube-api-access-tkwbr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk\" (UID: \"b821fc70-079b-4843-9fe1-facb8113a313\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.290871 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.290832    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:11.449925 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:11.449894    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"]
Jul 20 21:16:11.451464 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:16:11.451426    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb821fc70_079b_4843_9fe1_facb8113a313.slice/crio-e918c3cc6a068a01d87b0354a335d6f5fda856d08453171f8b08713b82e52df5 WatchSource:0}: Error finding container e918c3cc6a068a01d87b0354a335d6f5fda856d08453171f8b08713b82e52df5: Status 404 returned error can't find the container with id e918c3cc6a068a01d87b0354a335d6f5fda856d08453171f8b08713b82e52df5
Jul 20 21:16:12.249928 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:12.249895    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk" event={"ID":"b821fc70-079b-4843-9fe1-facb8113a313","Type":"ContainerStarted","Data":"e918c3cc6a068a01d87b0354a335d6f5fda856d08453171f8b08713b82e52df5"}
Jul 20 21:16:13.257184 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:13.257148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk" event={"ID":"b821fc70-079b-4843-9fe1-facb8113a313","Type":"ContainerStarted","Data":"195177e2ac8fa3c62cc4b784e5dd4fdb443e3d32d4d83c4b3ad8c17d4ab6540f"}
Jul 20 21:16:13.275209 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:13.275166    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk" podStartSLOduration=2.126736541 podStartE2EDuration="3.275149831s" totalImagesPullingTime="1.14841329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:16:13.274880258 +0000 UTC m=+833.027603007" watchObservedRunningTime="2026-07-20 21:16:13.275149831 +0000 UTC m=+833.027872553"
Jul 20 21:16:21.291461 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.291420    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:21.292019 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.291491    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:21.304218 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.304191    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:21.315396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.315377    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk"
Jul 20 21:16:21.791766 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.791722    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"]
Jul 20 21:16:21.798042 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.798020    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:21.800940 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.800923    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 20 21:16:21.806135 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.806114    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"]
Jul 20 21:16:21.930529 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.930495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66be4ed-f156-4b23-9be0-25f7a3cfc595-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:21.930716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.930543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zr8\" (UniqueName: \"kubernetes.io/projected/b66be4ed-f156-4b23-9be0-25f7a3cfc595-kube-api-access-v2zr8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:21.930716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.930567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:21.930716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.930650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:21.930716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.930690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:21.930716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:21.930713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.032148 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.032107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.032148 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.032151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.032396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.032193    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66be4ed-f156-4b23-9be0-25f7a3cfc595-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.032396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.032220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zr8\" (UniqueName: \"kubernetes.io/projected/b66be4ed-f156-4b23-9be0-25f7a3cfc595-kube-api-access-v2zr8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.032396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.032247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.032396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.032292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.032643 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.032617    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.032643 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.032635    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.032750 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.032727    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.034592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.034549    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b66be4ed-f156-4b23-9be0-25f7a3cfc595-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.035046 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.035026    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66be4ed-f156-4b23-9be0-25f7a3cfc595-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.039697 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.039674    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zr8\" (UniqueName: \"kubernetes.io/projected/b66be4ed-f156-4b23-9be0-25f7a3cfc595-kube-api-access-v2zr8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hdn7h\" (UID: \"b66be4ed-f156-4b23-9be0-25f7a3cfc595\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.109186 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.109103    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:22.247765 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.247742    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"]
Jul 20 21:16:22.250495 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:16:22.250461    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66be4ed_f156_4b23_9be0_25f7a3cfc595.slice/crio-413769b5874f08d4614098c428aec48bcc7b17f22d322db13c951444f662d564 WatchSource:0}: Error finding container 413769b5874f08d4614098c428aec48bcc7b17f22d322db13c951444f662d564: Status 404 returned error can't find the container with id 413769b5874f08d4614098c428aec48bcc7b17f22d322db13c951444f662d564
Jul 20 21:16:22.305493 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:22.305459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h" event={"ID":"b66be4ed-f156-4b23-9be0-25f7a3cfc595","Type":"ContainerStarted","Data":"413769b5874f08d4614098c428aec48bcc7b17f22d322db13c951444f662d564"}
Jul 20 21:16:23.312343 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:23.312303    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h" event={"ID":"b66be4ed-f156-4b23-9be0-25f7a3cfc595","Type":"ContainerStarted","Data":"1f92bf8840f7c9d9aa2c099a35bb99883ced919e6639dcd8c6100d3a0c1b7cbd"}
Jul 20 21:16:23.333453 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:23.333395    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h" podStartSLOduration=2.138780255 podStartE2EDuration="2.333378758s" totalImagesPullingTime="194.598503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:16:23.33067017 +0000 UTC m=+843.083392903" watchObservedRunningTime="2026-07-20 21:16:23.333378758 +0000 UTC m=+843.086101480"
Jul 20 21:16:32.109893 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:32.109857    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:32.110377 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:32.109922    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:32.122268 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:32.122247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:16:32.371334 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:16:32.371249    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hdn7h"
Jul 20 21:17:20.927706 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:17:20.927677    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:17:20.930267 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:17:20.930244    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:18:10.149686 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.149641    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84dfd759db-6mzdk"]
Jul 20 21:18:10.153375 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.153350    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84dfd759db-6mzdk"
Jul 20 21:18:10.160403 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.160367    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84dfd759db-6mzdk"]
Jul 20 21:18:10.169702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.169663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qd49\" (UniqueName: \"kubernetes.io/projected/1457c9a2-933f-4542-8f1a-b37cb83c6b04-kube-api-access-9qd49\") pod \"authorino-84dfd759db-6mzdk\" (UID: \"1457c9a2-933f-4542-8f1a-b37cb83c6b04\") " pod="kuadrant-system/authorino-84dfd759db-6mzdk"
Jul 20 21:18:10.169865 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.169777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1457c9a2-933f-4542-8f1a-b37cb83c6b04-tls-cert\") pod \"authorino-84dfd759db-6mzdk\" (UID: \"1457c9a2-933f-4542-8f1a-b37cb83c6b04\") " pod="kuadrant-system/authorino-84dfd759db-6mzdk"
Jul 20 21:18:10.271128 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.271069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qd49\" (UniqueName: \"kubernetes.io/projected/1457c9a2-933f-4542-8f1a-b37cb83c6b04-kube-api-access-9qd49\") pod \"authorino-84dfd759db-6mzdk\" (UID: \"1457c9a2-933f-4542-8f1a-b37cb83c6b04\") " pod="kuadrant-system/authorino-84dfd759db-6mzdk"
Jul 20 21:18:10.271284 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.271135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1457c9a2-933f-4542-8f1a-b37cb83c6b04-tls-cert\") pod \"authorino-84dfd759db-6mzdk\" (UID: \"1457c9a2-933f-4542-8f1a-b37cb83c6b04\") " pod="kuadrant-system/authorino-84dfd759db-6mzdk"
Jul 20 21:18:10.273583 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.273552    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1457c9a2-933f-4542-8f1a-b37cb83c6b04-tls-cert\") pod \"authorino-84dfd759db-6mzdk\" (UID: \"1457c9a2-933f-4542-8f1a-b37cb83c6b04\") " pod="kuadrant-system/authorino-84dfd759db-6mzdk"
Jul 20 21:18:10.279064 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.279044    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qd49\" (UniqueName: \"kubernetes.io/projected/1457c9a2-933f-4542-8f1a-b37cb83c6b04-kube-api-access-9qd49\") pod \"authorino-84dfd759db-6mzdk\" (UID: \"1457c9a2-933f-4542-8f1a-b37cb83c6b04\") " pod="kuadrant-system/authorino-84dfd759db-6mzdk"
Jul 20 21:18:10.464416 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.464343    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84dfd759db-6mzdk"
Jul 20 21:18:10.595819 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.595796    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84dfd759db-6mzdk"]
Jul 20 21:18:10.597617 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:18:10.597593    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1457c9a2_933f_4542_8f1a_b37cb83c6b04.slice/crio-2e47155f6071b00078b3a07df22d1969cddd4a42de32d2016d5daf2cebacc029 WatchSource:0}: Error finding container 2e47155f6071b00078b3a07df22d1969cddd4a42de32d2016d5daf2cebacc029: Status 404 returned error can't find the container with id 2e47155f6071b00078b3a07df22d1969cddd4a42de32d2016d5daf2cebacc029
Jul 20 21:18:10.598847 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.598830    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 21:18:10.889367 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:10.889333    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84dfd759db-6mzdk" event={"ID":"1457c9a2-933f-4542-8f1a-b37cb83c6b04","Type":"ContainerStarted","Data":"2e47155f6071b00078b3a07df22d1969cddd4a42de32d2016d5daf2cebacc029"}
Jul 20 21:18:11.900145 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:11.900101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84dfd759db-6mzdk" event={"ID":"1457c9a2-933f-4542-8f1a-b37cb83c6b04","Type":"ContainerStarted","Data":"80ca0c0dd8c52f0ba19b130d327ecb067846c3a7e670890a1d6f786d56bf7122"}
Jul 20 21:18:11.919519 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:11.919458    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84dfd759db-6mzdk" podStartSLOduration=1.085253918 podStartE2EDuration="1.91943597s" totalImagesPullingTime="834.182052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:18:11.916921761 +0000 UTC m=+951.669644484" watchObservedRunningTime="2026-07-20 21:18:11.91943597 +0000 UTC m=+951.672158694"
Jul 20 21:18:11.951183 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:11.951148    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66fc8b4b67-q7h54"]
Jul 20 21:18:11.951387 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:11.951360    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-66fc8b4b67-q7h54" podUID="c197eac8-08b9-425b-9a20-4cc6a9360ab2" containerName="authorino" containerID="cri-o://250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4" gracePeriod=30
Jul 20 21:18:12.214817 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.214793    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:18:12.289156 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.289122    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knhnx\" (UniqueName: \"kubernetes.io/projected/c197eac8-08b9-425b-9a20-4cc6a9360ab2-kube-api-access-knhnx\") pod \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\" (UID: \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\") "
Jul 20 21:18:12.289361 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.289215    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c197eac8-08b9-425b-9a20-4cc6a9360ab2-tls-cert\") pod \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\" (UID: \"c197eac8-08b9-425b-9a20-4cc6a9360ab2\") "
Jul 20 21:18:12.291434 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.291398    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c197eac8-08b9-425b-9a20-4cc6a9360ab2-kube-api-access-knhnx" (OuterVolumeSpecName: "kube-api-access-knhnx") pod "c197eac8-08b9-425b-9a20-4cc6a9360ab2" (UID: "c197eac8-08b9-425b-9a20-4cc6a9360ab2"). InnerVolumeSpecName "kube-api-access-knhnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:18:12.300020 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.299994    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c197eac8-08b9-425b-9a20-4cc6a9360ab2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c197eac8-08b9-425b-9a20-4cc6a9360ab2" (UID: "c197eac8-08b9-425b-9a20-4cc6a9360ab2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:18:12.390297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.390264    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knhnx\" (UniqueName: \"kubernetes.io/projected/c197eac8-08b9-425b-9a20-4cc6a9360ab2-kube-api-access-knhnx\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:18:12.390297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.390292    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c197eac8-08b9-425b-9a20-4cc6a9360ab2-tls-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:18:12.908113 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.908059    2573 generic.go:356] "Generic (PLEG): container finished" podID="c197eac8-08b9-425b-9a20-4cc6a9360ab2" containerID="250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4" exitCode=0
Jul 20 21:18:12.908567 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.908110    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66fc8b4b67-q7h54" event={"ID":"c197eac8-08b9-425b-9a20-4cc6a9360ab2","Type":"ContainerDied","Data":"250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4"}
Jul 20 21:18:12.908567 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.908163    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66fc8b4b67-q7h54" event={"ID":"c197eac8-08b9-425b-9a20-4cc6a9360ab2","Type":"ContainerDied","Data":"147161e5e96272aa24e3506e389e3e0e800ef74e3cbb5792456b24a416a55163"}
Jul 20 21:18:12.908567 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.908183    2573 scope.go:117] "RemoveContainer" containerID="250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4"
Jul 20 21:18:12.908567 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.908124    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66fc8b4b67-q7h54"
Jul 20 21:18:12.917705 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.917679    2573 scope.go:117] "RemoveContainer" containerID="250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4"
Jul 20 21:18:12.918008 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:18:12.917988    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4\": container with ID starting with 250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4 not found: ID does not exist" containerID="250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4"
Jul 20 21:18:12.918114 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.918020    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4"} err="failed to get container status \"250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4\": rpc error: code = NotFound desc = could not find container \"250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4\": container with ID starting with 250dafa0b2e67a73e32ce6380f80c36f926dab9af9d9217c340fcecfda4038c4 not found: ID does not exist"
Jul 20 21:18:12.928323 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.928299    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66fc8b4b67-q7h54"]
Jul 20 21:18:12.930335 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:12.930314    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66fc8b4b67-q7h54"]
Jul 20 21:18:14.770669 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:18:14.770630    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c197eac8-08b9-425b-9a20-4cc6a9360ab2" path="/var/lib/kubelet/pods/c197eac8-08b9-425b-9a20-4cc6a9360ab2/volumes"
Jul 20 21:19:00.160527 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:00.160430    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84bff768b5-nt95c"]
Jul 20 21:19:00.161153 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:00.160692    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84bff768b5-nt95c" podUID="1fc650a0-f269-4c4a-a377-b25e35c9ce02" containerName="manager" containerID="cri-o://80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef" gracePeriod=30
Jul 20 21:19:00.419812 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:00.419743    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:19:00.515130 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:00.515095    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fc650a0-f269-4c4a-a377-b25e35c9ce02-webhook-cert\") pod \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\" (UID: \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\") "
Jul 20 21:19:00.515311 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:00.515172    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftpv8\" (UniqueName: \"kubernetes.io/projected/1fc650a0-f269-4c4a-a377-b25e35c9ce02-kube-api-access-ftpv8\") pod \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\" (UID: \"1fc650a0-f269-4c4a-a377-b25e35c9ce02\") "
Jul 20 21:19:00.517299 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:00.517267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc650a0-f269-4c4a-a377-b25e35c9ce02-kube-api-access-ftpv8" (OuterVolumeSpecName: "kube-api-access-ftpv8") pod "1fc650a0-f269-4c4a-a377-b25e35c9ce02" (UID: "1fc650a0-f269-4c4a-a377-b25e35c9ce02"). InnerVolumeSpecName "kube-api-access-ftpv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:19:00.517427 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:00.517267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc650a0-f269-4c4a-a377-b25e35c9ce02-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1fc650a0-f269-4c4a-a377-b25e35c9ce02" (UID: "1fc650a0-f269-4c4a-a377-b25e35c9ce02"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:19:00.615964 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:00.615930    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fc650a0-f269-4c4a-a377-b25e35c9ce02-webhook-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:19:00.615964 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:00.615958    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftpv8\" (UniqueName: \"kubernetes.io/projected/1fc650a0-f269-4c4a-a377-b25e35c9ce02-kube-api-access-ftpv8\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:19:01.175528 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:01.175433    2573 generic.go:356] "Generic (PLEG): container finished" podID="1fc650a0-f269-4c4a-a377-b25e35c9ce02" containerID="80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef" exitCode=0
Jul 20 21:19:01.175528 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:01.175482    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-nt95c"
Jul 20 21:19:01.175528 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:01.175511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-nt95c" event={"ID":"1fc650a0-f269-4c4a-a377-b25e35c9ce02","Type":"ContainerDied","Data":"80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef"}
Jul 20 21:19:01.176066 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:01.175567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-nt95c" event={"ID":"1fc650a0-f269-4c4a-a377-b25e35c9ce02","Type":"ContainerDied","Data":"47f60a1cec45909e95a68613a3b582517003de6a7d5128ee54b9159b09bf27aa"}
Jul 20 21:19:01.176066 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:01.175589    2573 scope.go:117] "RemoveContainer" containerID="80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef"
Jul 20 21:19:01.184435 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:01.184417    2573 scope.go:117] "RemoveContainer" containerID="80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef"
Jul 20 21:19:01.184694 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:19:01.184674    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef\": container with ID starting with 80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef not found: ID does not exist" containerID="80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef"
Jul 20 21:19:01.184762 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:01.184705    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef"} err="failed to get container status \"80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef\": rpc error: code = NotFound desc = could not find container \"80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef\": container with ID starting with 80bf8c0400c16f2c63788b0529857eb8eb4cd6bb1ad4101d9c241682edd4fbef not found: ID does not exist"
Jul 20 21:19:01.196982 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:01.196954    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84bff768b5-nt95c"]
Jul 20 21:19:01.201952 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:01.201928    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84bff768b5-nt95c"]
Jul 20 21:19:02.769734 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:19:02.769701    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fc650a0-f269-4c4a-a377-b25e35c9ce02" path="/var/lib/kubelet/pods/1fc650a0-f269-4c4a-a377-b25e35c9ce02/volumes"
Jul 20 21:20:02.053740 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.053706    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84bff768b5-lqrbv"]
Jul 20 21:20:02.054262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.054106    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c197eac8-08b9-425b-9a20-4cc6a9360ab2" containerName="authorino"
Jul 20 21:20:02.054262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.054120    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c197eac8-08b9-425b-9a20-4cc6a9360ab2" containerName="authorino"
Jul 20 21:20:02.054262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.054133    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc650a0-f269-4c4a-a377-b25e35c9ce02" containerName="manager"
Jul 20 21:20:02.054262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.054138    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc650a0-f269-4c4a-a377-b25e35c9ce02" containerName="manager"
Jul 20 21:20:02.054262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.054200    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c197eac8-08b9-425b-9a20-4cc6a9360ab2" containerName="authorino"
Jul 20 21:20:02.054262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.054210    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fc650a0-f269-4c4a-a377-b25e35c9ce02" containerName="manager"
Jul 20 21:20:02.057301 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.057283    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:02.060252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.060232    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 21:20:02.061373 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.061353    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j9s86\""
Jul 20 21:20:02.061486 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.061377    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 21:20:02.080046 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.080018    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84bff768b5-lqrbv"]
Jul 20 21:20:02.135312 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.135277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20214c5-f04c-4833-ae18-1b872fa8e0af-webhook-cert\") pod \"maas-controller-84bff768b5-lqrbv\" (UID: \"a20214c5-f04c-4833-ae18-1b872fa8e0af\") " pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:02.135479 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.135334    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c79r5\" (UniqueName: \"kubernetes.io/projected/a20214c5-f04c-4833-ae18-1b872fa8e0af-kube-api-access-c79r5\") pod \"maas-controller-84bff768b5-lqrbv\" (UID: \"a20214c5-f04c-4833-ae18-1b872fa8e0af\") " pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:02.235978 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.235946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20214c5-f04c-4833-ae18-1b872fa8e0af-webhook-cert\") pod \"maas-controller-84bff768b5-lqrbv\" (UID: \"a20214c5-f04c-4833-ae18-1b872fa8e0af\") " pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:02.236193 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.235998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c79r5\" (UniqueName: \"kubernetes.io/projected/a20214c5-f04c-4833-ae18-1b872fa8e0af-kube-api-access-c79r5\") pod \"maas-controller-84bff768b5-lqrbv\" (UID: \"a20214c5-f04c-4833-ae18-1b872fa8e0af\") " pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:02.238415 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.238391    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20214c5-f04c-4833-ae18-1b872fa8e0af-webhook-cert\") pod \"maas-controller-84bff768b5-lqrbv\" (UID: \"a20214c5-f04c-4833-ae18-1b872fa8e0af\") " pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:02.245295 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.245270    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c79r5\" (UniqueName: \"kubernetes.io/projected/a20214c5-f04c-4833-ae18-1b872fa8e0af-kube-api-access-c79r5\") pod \"maas-controller-84bff768b5-lqrbv\" (UID: \"a20214c5-f04c-4833-ae18-1b872fa8e0af\") " pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:02.366928 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.366831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:02.508172 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:02.508144    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84bff768b5-lqrbv"]
Jul 20 21:20:02.509371 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:20:02.509341    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20214c5_f04c_4833_ae18_1b872fa8e0af.slice/crio-72e97522f62ff44477ff8334157802702fa8b3cad02a9af80cefa96ca7cb5bdb WatchSource:0}: Error finding container 72e97522f62ff44477ff8334157802702fa8b3cad02a9af80cefa96ca7cb5bdb: Status 404 returned error can't find the container with id 72e97522f62ff44477ff8334157802702fa8b3cad02a9af80cefa96ca7cb5bdb
Jul 20 21:20:03.516976 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:03.516930    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-lqrbv" event={"ID":"a20214c5-f04c-4833-ae18-1b872fa8e0af","Type":"ContainerStarted","Data":"017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983"}
Jul 20 21:20:03.517375 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:03.517134    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:03.517375 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:03.517171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-lqrbv" event={"ID":"a20214c5-f04c-4833-ae18-1b872fa8e0af","Type":"ContainerStarted","Data":"72e97522f62ff44477ff8334157802702fa8b3cad02a9af80cefa96ca7cb5bdb"}
Jul 20 21:20:03.543130 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:03.543058    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84bff768b5-lqrbv" podStartSLOduration=1.066094811 podStartE2EDuration="1.543039635s" totalImagesPullingTime="476.944824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:20:03.539233778 +0000 UTC m=+1063.291956500" watchObservedRunningTime="2026-07-20 21:20:03.543039635 +0000 UTC m=+1063.295762357"
Jul 20 21:20:14.530950 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:14.530863    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:19.238034 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.238000    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84bff768b5-lqrbv"]
Jul 20 21:20:19.238490 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.238252    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84bff768b5-lqrbv" podUID="a20214c5-f04c-4833-ae18-1b872fa8e0af" containerName="manager" containerID="cri-o://017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983" gracePeriod=30
Jul 20 21:20:19.491839 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.491782    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:19.598570 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.598538    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20214c5-f04c-4833-ae18-1b872fa8e0af-webhook-cert\") pod \"a20214c5-f04c-4833-ae18-1b872fa8e0af\" (UID: \"a20214c5-f04c-4833-ae18-1b872fa8e0af\") "
Jul 20 21:20:19.598740 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.598616    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c79r5\" (UniqueName: \"kubernetes.io/projected/a20214c5-f04c-4833-ae18-1b872fa8e0af-kube-api-access-c79r5\") pod \"a20214c5-f04c-4833-ae18-1b872fa8e0af\" (UID: \"a20214c5-f04c-4833-ae18-1b872fa8e0af\") "
Jul 20 21:20:19.600641 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.600604    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20214c5-f04c-4833-ae18-1b872fa8e0af-kube-api-access-c79r5" (OuterVolumeSpecName: "kube-api-access-c79r5") pod "a20214c5-f04c-4833-ae18-1b872fa8e0af" (UID: "a20214c5-f04c-4833-ae18-1b872fa8e0af"). InnerVolumeSpecName "kube-api-access-c79r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:20:19.600641 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.600618    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20214c5-f04c-4833-ae18-1b872fa8e0af-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a20214c5-f04c-4833-ae18-1b872fa8e0af" (UID: "a20214c5-f04c-4833-ae18-1b872fa8e0af"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:20:19.608903 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.608879    2573 generic.go:356] "Generic (PLEG): container finished" podID="a20214c5-f04c-4833-ae18-1b872fa8e0af" containerID="017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983" exitCode=0
Jul 20 21:20:19.609004 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.608919    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-lqrbv"
Jul 20 21:20:19.609004 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.608965    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-lqrbv" event={"ID":"a20214c5-f04c-4833-ae18-1b872fa8e0af","Type":"ContainerDied","Data":"017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983"}
Jul 20 21:20:19.609109 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.609021    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-lqrbv" event={"ID":"a20214c5-f04c-4833-ae18-1b872fa8e0af","Type":"ContainerDied","Data":"72e97522f62ff44477ff8334157802702fa8b3cad02a9af80cefa96ca7cb5bdb"}
Jul 20 21:20:19.609109 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.609049    2573 scope.go:117] "RemoveContainer" containerID="017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983"
Jul 20 21:20:19.621381 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.621360    2573 scope.go:117] "RemoveContainer" containerID="017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983"
Jul 20 21:20:19.621647 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:20:19.621621    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983\": container with ID starting with 017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983 not found: ID does not exist" containerID="017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983"
Jul 20 21:20:19.621706 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.621663    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983"} err="failed to get container status \"017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983\": rpc error: code = NotFound desc = could not find container \"017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983\": container with ID starting with 017f200b8205a80f636e5ae6c95910bec3f84ae23c80e7d07d70e37b1f8d5983 not found: ID does not exist"
Jul 20 21:20:19.632685 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.632658    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84bff768b5-lqrbv"]
Jul 20 21:20:19.636671 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.636649    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84bff768b5-lqrbv"]
Jul 20 21:20:19.700026 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.699980    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c79r5\" (UniqueName: \"kubernetes.io/projected/a20214c5-f04c-4833-ae18-1b872fa8e0af-kube-api-access-c79r5\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:20:19.700026 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:19.700009    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20214c5-f04c-4833-ae18-1b872fa8e0af-webhook-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:20:20.431399 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.431353    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84bff768b5-4j2h9"]
Jul 20 21:20:20.431870 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.431733    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20214c5-f04c-4833-ae18-1b872fa8e0af" containerName="manager"
Jul 20 21:20:20.431870 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.431744    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20214c5-f04c-4833-ae18-1b872fa8e0af" containerName="manager"
Jul 20 21:20:20.431870 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.431823    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20214c5-f04c-4833-ae18-1b872fa8e0af" containerName="manager"
Jul 20 21:20:20.436230 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.436212    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:20.438752 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.438728    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 21:20:20.439936 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.439909    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 21:20:20.439936 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.439924    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j9s86\""
Jul 20 21:20:20.444097 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.443844    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84bff768b5-4j2h9"]
Jul 20 21:20:20.508502 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.508466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba26e5be-734e-4bbf-9f54-be22ec3b73e7-webhook-cert\") pod \"maas-controller-84bff768b5-4j2h9\" (UID: \"ba26e5be-734e-4bbf-9f54-be22ec3b73e7\") " pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:20.508502 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.508503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sn2j\" (UniqueName: \"kubernetes.io/projected/ba26e5be-734e-4bbf-9f54-be22ec3b73e7-kube-api-access-4sn2j\") pod \"maas-controller-84bff768b5-4j2h9\" (UID: \"ba26e5be-734e-4bbf-9f54-be22ec3b73e7\") " pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:20.610096 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.610038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba26e5be-734e-4bbf-9f54-be22ec3b73e7-webhook-cert\") pod \"maas-controller-84bff768b5-4j2h9\" (UID: \"ba26e5be-734e-4bbf-9f54-be22ec3b73e7\") " pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:20.610096 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.610096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sn2j\" (UniqueName: \"kubernetes.io/projected/ba26e5be-734e-4bbf-9f54-be22ec3b73e7-kube-api-access-4sn2j\") pod \"maas-controller-84bff768b5-4j2h9\" (UID: \"ba26e5be-734e-4bbf-9f54-be22ec3b73e7\") " pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:20.613051 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.613026    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba26e5be-734e-4bbf-9f54-be22ec3b73e7-webhook-cert\") pod \"maas-controller-84bff768b5-4j2h9\" (UID: \"ba26e5be-734e-4bbf-9f54-be22ec3b73e7\") " pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:20.618685 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.618658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sn2j\" (UniqueName: \"kubernetes.io/projected/ba26e5be-734e-4bbf-9f54-be22ec3b73e7-kube-api-access-4sn2j\") pod \"maas-controller-84bff768b5-4j2h9\" (UID: \"ba26e5be-734e-4bbf-9f54-be22ec3b73e7\") " pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:20.750346 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.750315    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j9s86\""
Jul 20 21:20:20.757628 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.757603    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:20.772152 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.772122    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a20214c5-f04c-4833-ae18-1b872fa8e0af" path="/var/lib/kubelet/pods/a20214c5-f04c-4833-ae18-1b872fa8e0af/volumes"
Jul 20 21:20:20.896129 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:20.896103    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84bff768b5-4j2h9"]
Jul 20 21:20:20.897650 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:20:20.897625    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba26e5be_734e_4bbf_9f54_be22ec3b73e7.slice/crio-209814858ccfb270141bf56efde81777be76204fe8ac7d107872266581144e24 WatchSource:0}: Error finding container 209814858ccfb270141bf56efde81777be76204fe8ac7d107872266581144e24: Status 404 returned error can't find the container with id 209814858ccfb270141bf56efde81777be76204fe8ac7d107872266581144e24
Jul 20 21:20:21.375483 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:21.375464    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 21:20:21.623308 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:21.623213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-4j2h9" event={"ID":"ba26e5be-734e-4bbf-9f54-be22ec3b73e7","Type":"ContainerStarted","Data":"1c875f9413f035b67f1ebfb1996231f9abc81d05053dd6c8a221bc38876e3c82"}
Jul 20 21:20:21.623308 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:21.623266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bff768b5-4j2h9" event={"ID":"ba26e5be-734e-4bbf-9f54-be22ec3b73e7","Type":"ContainerStarted","Data":"209814858ccfb270141bf56efde81777be76204fe8ac7d107872266581144e24"}
Jul 20 21:20:21.623714 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:21.623342    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:32.631732 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:32.631701    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84bff768b5-4j2h9"
Jul 20 21:20:32.650983 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:20:32.650923    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84bff768b5-4j2h9" podStartSLOduration=12.177145746 podStartE2EDuration="12.650905545s" totalImagesPullingTime="473.759799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:20:21.668433082 +0000 UTC m=+1081.421155806" watchObservedRunningTime="2026-07-20 21:20:32.650905545 +0000 UTC m=+1092.403628269"
Jul 20 21:22:20.962578 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:22:20.962545    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:22:20.966495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:22:20.966473    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:25:02.463864 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:02.463772    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"]
Jul 20 21:25:02.464403 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:02.464000    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm" podUID="6c07e380-0375-4db6-a41f-a95caa24d52c" containerName="manager" containerID="cri-o://ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1" gracePeriod=10
Jul 20 21:25:06.419782 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:06.419756    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:25:06.572992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:06.572910    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c07e380-0375-4db6-a41f-a95caa24d52c-extensions-socket-volume\") pod \"6c07e380-0375-4db6-a41f-a95caa24d52c\" (UID: \"6c07e380-0375-4db6-a41f-a95caa24d52c\") "
Jul 20 21:25:06.572992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:06.572955    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr8t8\" (UniqueName: \"kubernetes.io/projected/6c07e380-0375-4db6-a41f-a95caa24d52c-kube-api-access-lr8t8\") pod \"6c07e380-0375-4db6-a41f-a95caa24d52c\" (UID: \"6c07e380-0375-4db6-a41f-a95caa24d52c\") "
Jul 20 21:25:06.573375 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:06.573348    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c07e380-0375-4db6-a41f-a95caa24d52c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6c07e380-0375-4db6-a41f-a95caa24d52c" (UID: "6c07e380-0375-4db6-a41f-a95caa24d52c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:25:06.574934 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:06.574908    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c07e380-0375-4db6-a41f-a95caa24d52c-kube-api-access-lr8t8" (OuterVolumeSpecName: "kube-api-access-lr8t8") pod "6c07e380-0375-4db6-a41f-a95caa24d52c" (UID: "6c07e380-0375-4db6-a41f-a95caa24d52c"). InnerVolumeSpecName "kube-api-access-lr8t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:25:06.673994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:06.673961    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c07e380-0375-4db6-a41f-a95caa24d52c-extensions-socket-volume\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:25:06.673994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:06.673989    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr8t8\" (UniqueName: \"kubernetes.io/projected/6c07e380-0375-4db6-a41f-a95caa24d52c-kube-api-access-lr8t8\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:25:07.160980 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:07.160948    2573 generic.go:356] "Generic (PLEG): container finished" podID="6c07e380-0375-4db6-a41f-a95caa24d52c" containerID="ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1" exitCode=0
Jul 20 21:25:07.161190 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:07.160991    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"
Jul 20 21:25:07.161190 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:07.161041    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm" event={"ID":"6c07e380-0375-4db6-a41f-a95caa24d52c","Type":"ContainerDied","Data":"ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1"}
Jul 20 21:25:07.161190 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:07.161113    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm" event={"ID":"6c07e380-0375-4db6-a41f-a95caa24d52c","Type":"ContainerDied","Data":"1f6b8dbf647d439ec268a8cf638ed167a9d19f59222e34a9af41271ec7543e4f"}
Jul 20 21:25:07.161190 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:07.161141    2573 scope.go:117] "RemoveContainer" containerID="ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1"
Jul 20 21:25:07.170627 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:07.170590    2573 scope.go:117] "RemoveContainer" containerID="ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1"
Jul 20 21:25:07.170875 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:25:07.170857    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1\": container with ID starting with ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1 not found: ID does not exist" containerID="ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1"
Jul 20 21:25:07.170930 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:07.170884    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1"} err="failed to get container status \"ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1\": rpc error: code = NotFound desc = could not find container \"ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1\": container with ID starting with ac4ffcc04812038b71b9afbd056273a69ec233ae139acea2b9a49729e70243a1 not found: ID does not exist"
Jul 20 21:25:07.182357 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:07.182332    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"]
Jul 20 21:25:07.190743 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:07.187662    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rhhlm"]
Jul 20 21:25:08.769428 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:25:08.769389    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c07e380-0375-4db6-a41f-a95caa24d52c" path="/var/lib/kubelet/pods/6c07e380-0375-4db6-a41f-a95caa24d52c/volumes"
Jul 20 21:26:03.854416 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:03.854381    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"]
Jul 20 21:26:03.854913 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:03.854769    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c07e380-0375-4db6-a41f-a95caa24d52c" containerName="manager"
Jul 20 21:26:03.854913 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:03.854780    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c07e380-0375-4db6-a41f-a95caa24d52c" containerName="manager"
Jul 20 21:26:03.854913 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:03.854839    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c07e380-0375-4db6-a41f-a95caa24d52c" containerName="manager"
Jul 20 21:26:03.857833 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:03.857816    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:26:03.861265 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:03.861238    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mwmn7\""
Jul 20 21:26:03.869283 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:03.869261    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"]
Jul 20 21:26:03.907497 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:03.907465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ed3a11-a469-42da-808e-951c563e63bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbtd\" (UID: \"16ed3a11-a469-42da-808e-951c563e63bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:26:03.907636 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:03.907503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7vc\" (UniqueName: \"kubernetes.io/projected/16ed3a11-a469-42da-808e-951c563e63bd-kube-api-access-jj7vc\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbtd\" (UID: \"16ed3a11-a469-42da-808e-951c563e63bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:26:04.008752 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.008717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ed3a11-a469-42da-808e-951c563e63bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbtd\" (UID: \"16ed3a11-a469-42da-808e-951c563e63bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:26:04.008899 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.008765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7vc\" (UniqueName: \"kubernetes.io/projected/16ed3a11-a469-42da-808e-951c563e63bd-kube-api-access-jj7vc\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbtd\" (UID: \"16ed3a11-a469-42da-808e-951c563e63bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:26:04.009139 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.009120    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ed3a11-a469-42da-808e-951c563e63bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbtd\" (UID: \"16ed3a11-a469-42da-808e-951c563e63bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:26:04.018055 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.018022    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7vc\" (UniqueName: \"kubernetes.io/projected/16ed3a11-a469-42da-808e-951c563e63bd-kube-api-access-jj7vc\") pod \"kuadrant-operator-controller-manager-86878c769f-tpbtd\" (UID: \"16ed3a11-a469-42da-808e-951c563e63bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:26:04.168961 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.168812    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:26:04.312060 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.312031    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"]
Jul 20 21:26:04.314857 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:26:04.314831    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ed3a11_a469_42da_808e_951c563e63bd.slice/crio-223726503be0850de105891554dfbb74efaeb05f2f58c5fe464c164e864bdd0d WatchSource:0}: Error finding container 223726503be0850de105891554dfbb74efaeb05f2f58c5fe464c164e864bdd0d: Status 404 returned error can't find the container with id 223726503be0850de105891554dfbb74efaeb05f2f58c5fe464c164e864bdd0d
Jul 20 21:26:04.459182 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.459097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd" event={"ID":"16ed3a11-a469-42da-808e-951c563e63bd","Type":"ContainerStarted","Data":"651e1ec21c0a6cbfb3f63c53e12780b28c5efadb790fc5fb5720c7c46e29505f"}
Jul 20 21:26:04.459182 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.459148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd" event={"ID":"16ed3a11-a469-42da-808e-951c563e63bd","Type":"ContainerStarted","Data":"223726503be0850de105891554dfbb74efaeb05f2f58c5fe464c164e864bdd0d"}
Jul 20 21:26:04.459356 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.459247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:26:04.479427 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:04.479382    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd" podStartSLOduration=1.479367251 podStartE2EDuration="1.479367251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:26:04.478772832 +0000 UTC m=+1424.231495572" watchObservedRunningTime="2026-07-20 21:26:04.479367251 +0000 UTC m=+1424.232089973"
Jul 20 21:26:15.467055 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:26:15.466970    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpbtd"
Jul 20 21:27:20.997800 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:27:20.997770    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:27:21.004267 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:27:21.004248    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:32:21.035885 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:32:21.035855    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:32:21.043001 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:32:21.042981    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:33:26.305835 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.305801    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"]
Jul 20 21:33:26.309296 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.309278    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.312084 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.312054    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c9d06801-openshift-default-dockercfg-8bpnz\""
Jul 20 21:33:26.331945 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.331914    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"]
Jul 20 21:33:26.379712 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.379667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-envoy\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.379712 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.379709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7e83e01-d166-48c8-9cec-203f341cefa1-istiod-ca-cert\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.379962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.379750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlx8f\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-kube-api-access-dlx8f\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.379962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.379793    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-credential-socket\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.379962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.379851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-socket\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.379962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.379871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-certs\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.379962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.379903    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-token\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.379962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.379931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-podinfo\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.379962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.379950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-data\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481253 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-envoy\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481253 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7e83e01-d166-48c8-9cec-203f341cefa1-istiod-ca-cert\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481510 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlx8f\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-kube-api-access-dlx8f\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481510 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-credential-socket\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481510 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-socket\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481510 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-certs\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481510 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-token\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481510 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-podinfo\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481510 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-data\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481897 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481857    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-data\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.481897 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.481890    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-socket\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.482121 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.482069    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-certs\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.482192 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.482159    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-credential-socket\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.482192 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.482180    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7e83e01-d166-48c8-9cec-203f341cefa1-istiod-ca-cert\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.483857 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.483830    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-envoy\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.484086 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.484060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-podinfo\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.492686 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.492663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-token\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.493516 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.493495    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlx8f\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-kube-api-access-dlx8f\") pod \"e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") " pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.620025 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.619940    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:26.769958 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:33:26.769928    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e83e01_d166_48c8_9cec_203f341cefa1.slice/crio-0b720c7dd326389cf69bbbcdd9532bbaa0ebf48ee7eabf5e39a188becd9a7a4e WatchSource:0}: Error finding container 0b720c7dd326389cf69bbbcdd9532bbaa0ebf48ee7eabf5e39a188becd9a7a4e: Status 404 returned error can't find the container with id 0b720c7dd326389cf69bbbcdd9532bbaa0ebf48ee7eabf5e39a188becd9a7a4e
Jul 20 21:33:26.771994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.771962    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:33:26.772067 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.772030    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:33:26.772067 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.772058    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:33:26.772171 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.772108    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"]
Jul 20 21:33:26.844710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:26.844675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" event={"ID":"a7e83e01-d166-48c8-9cec-203f341cefa1","Type":"ContainerStarted","Data":"0b720c7dd326389cf69bbbcdd9532bbaa0ebf48ee7eabf5e39a188becd9a7a4e"}
Jul 20 21:33:27.852114 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:27.852065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" event={"ID":"a7e83e01-d166-48c8-9cec-203f341cefa1","Type":"ContainerStarted","Data":"d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f"}
Jul 20 21:33:27.875394 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:27.875341    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" podStartSLOduration=1.875323783 podStartE2EDuration="1.875323783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:33:27.872565405 +0000 UTC m=+1867.625288128" watchObservedRunningTime="2026-07-20 21:33:27.875323783 +0000 UTC m=+1867.628046505"
Jul 20 21:33:28.620470 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:28.620433    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:28.625223 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:28.625197    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:28.857259 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:28.857224    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:28.858112 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:28.858089    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:29.340056 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.340025    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"]
Jul 20 21:33:29.343778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.343757    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:29.346387 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.346369    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c9d06801-serving-cert\""
Jul 20 21:33:29.357184 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.357159    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"]
Jul 20 21:33:29.512262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.512218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d5aab8-f87f-4714-9797-0c89172abae1-maas-api-tls\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:29.512262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.512268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d5aab8-f87f-4714-9797-0c89172abae1-openshift-service-ca\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:29.512490 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.512345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcgk9\" (UniqueName: \"kubernetes.io/projected/69d5aab8-f87f-4714-9797-0c89172abae1-kube-api-access-wcgk9\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:29.613815 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.613718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d5aab8-f87f-4714-9797-0c89172abae1-maas-api-tls\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:29.613815 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.613768    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d5aab8-f87f-4714-9797-0c89172abae1-openshift-service-ca\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:29.613815 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.613799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcgk9\" (UniqueName: \"kubernetes.io/projected/69d5aab8-f87f-4714-9797-0c89172abae1-kube-api-access-wcgk9\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:29.614062 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:33:29.613902    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-serving-cert: secret "maas-api-e2e-ait-c9d06801-serving-cert" not found
Jul 20 21:33:29.614062 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:33:29.613990    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d5aab8-f87f-4714-9797-0c89172abae1-maas-api-tls podName:69d5aab8-f87f-4714-9797-0c89172abae1 nodeName:}" failed. No retries permitted until 2026-07-20 21:33:30.113967189 +0000 UTC m=+1869.866689904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/69d5aab8-f87f-4714-9797-0c89172abae1-maas-api-tls") pod "maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v" (UID: "69d5aab8-f87f-4714-9797-0c89172abae1") : secret "maas-api-e2e-ait-c9d06801-serving-cert" not found
Jul 20 21:33:29.614437 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.614420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d5aab8-f87f-4714-9797-0c89172abae1-openshift-service-ca\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:29.625718 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:29.625696    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcgk9\" (UniqueName: \"kubernetes.io/projected/69d5aab8-f87f-4714-9797-0c89172abae1-kube-api-access-wcgk9\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:30.119021 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:30.118977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d5aab8-f87f-4714-9797-0c89172abae1-maas-api-tls\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:30.121580 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:30.121556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d5aab8-f87f-4714-9797-0c89172abae1-maas-api-tls\") pod \"maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:30.254407 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:30.254371    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:30.407859 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:30.407829    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"]
Jul 20 21:33:30.409816 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:33:30.409785    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d5aab8_f87f_4714_9797_0c89172abae1.slice/crio-2e7814f3f81dd6d907e559404e8385d3eadf8631cddbe03f740c86cddf970e57 WatchSource:0}: Error finding container 2e7814f3f81dd6d907e559404e8385d3eadf8631cddbe03f740c86cddf970e57: Status 404 returned error can't find the container with id 2e7814f3f81dd6d907e559404e8385d3eadf8631cddbe03f740c86cddf970e57
Jul 20 21:33:30.411049 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:30.411031    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 21:33:30.869588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:30.869556    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v" event={"ID":"69d5aab8-f87f-4714-9797-0c89172abae1","Type":"ContainerStarted","Data":"2e7814f3f81dd6d907e559404e8385d3eadf8631cddbe03f740c86cddf970e57"}
Jul 20 21:33:31.876763 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:31.876731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v" event={"ID":"69d5aab8-f87f-4714-9797-0c89172abae1","Type":"ContainerStarted","Data":"db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362"}
Jul 20 21:33:31.877174 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:31.876817    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:31.896289 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:31.896236    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v" podStartSLOduration=2.435278185 podStartE2EDuration="2.896218067s" totalImagesPullingTime="460.939882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:33:31.895430075 +0000 UTC m=+1871.648152803" watchObservedRunningTime="2026-07-20 21:33:31.896218067 +0000 UTC m=+1871.648940789"
Jul 20 21:33:37.889171 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:37.889132    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:33:44.900247 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:44.900205    2573 patch_prober.go:28] interesting pod/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 21:33:44.902547 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:44.900305    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 21:33:44.951349 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:44.951316    2573 generic.go:356] "Generic (PLEG): container finished" podID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerID="d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f" exitCode=0
Jul 20 21:33:44.951519 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:44.951394    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" event={"ID":"a7e83e01-d166-48c8-9cec-203f341cefa1","Type":"ContainerDied","Data":"d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f"}
Jul 20 21:33:44.951811 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:44.951797    2573 scope.go:117] "RemoveContainer" containerID="d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f"
Jul 20 21:33:44.952826 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:44.952797    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:33:44.952883 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:44.952868    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:33:44.952919 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:44.952901    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:33:45.960286 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:45.960248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" event={"ID":"a7e83e01-d166-48c8-9cec-203f341cefa1","Type":"ContainerStarted","Data":"abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe"}
Jul 20 21:33:46.620539 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:46.620494    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:46.620741 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:46.620700    2573 patch_prober.go:28] interesting pod/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 20 21:33:46.620790 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:46.620746    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 20 21:33:47.620482 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:47.620440    2573 patch_prober.go:28] interesting pod/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 20 21:33:47.620882 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:47.620513    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 20 21:33:48.621155 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:48.621114    2573 patch_prober.go:28] interesting pod/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 20 21:33:48.621595 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:48.621171    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 20 21:33:49.620936 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:49.620890    2573 patch_prober.go:28] interesting pod/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 20 21:33:49.621176 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:49.620962    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 20 21:33:50.625165 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:50.625122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:50.625719 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:50.625500    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:33:50.626699 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:33:50.626669    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:34:05.566113 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:05.566062    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"]
Jul 20 21:34:05.566701 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:05.566307    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v" podUID="69d5aab8-f87f-4714-9797-0c89172abae1" containerName="maas-api" containerID="cri-o://db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362" gracePeriod=30
Jul 20 21:34:05.823433 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:05.823368    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:34:05.967054 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:05.967012    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d5aab8-f87f-4714-9797-0c89172abae1-openshift-service-ca\") pod \"69d5aab8-f87f-4714-9797-0c89172abae1\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") "
Jul 20 21:34:05.967267 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:05.967190    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcgk9\" (UniqueName: \"kubernetes.io/projected/69d5aab8-f87f-4714-9797-0c89172abae1-kube-api-access-wcgk9\") pod \"69d5aab8-f87f-4714-9797-0c89172abae1\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") "
Jul 20 21:34:05.967267 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:05.967244    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d5aab8-f87f-4714-9797-0c89172abae1-maas-api-tls\") pod \"69d5aab8-f87f-4714-9797-0c89172abae1\" (UID: \"69d5aab8-f87f-4714-9797-0c89172abae1\") "
Jul 20 21:34:05.967514 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:05.967493    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69d5aab8-f87f-4714-9797-0c89172abae1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69d5aab8-f87f-4714-9797-0c89172abae1" (UID: "69d5aab8-f87f-4714-9797-0c89172abae1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:34:05.969487 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:05.969459    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69d5aab8-f87f-4714-9797-0c89172abae1-kube-api-access-wcgk9" (OuterVolumeSpecName: "kube-api-access-wcgk9") pod "69d5aab8-f87f-4714-9797-0c89172abae1" (UID: "69d5aab8-f87f-4714-9797-0c89172abae1"). InnerVolumeSpecName "kube-api-access-wcgk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:34:05.969487 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:05.969466    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69d5aab8-f87f-4714-9797-0c89172abae1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69d5aab8-f87f-4714-9797-0c89172abae1" (UID: "69d5aab8-f87f-4714-9797-0c89172abae1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:34:06.066711 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.066666    2573 generic.go:356] "Generic (PLEG): container finished" podID="69d5aab8-f87f-4714-9797-0c89172abae1" containerID="db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362" exitCode=0
Jul 20 21:34:06.066711 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.066713    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"
Jul 20 21:34:06.066930 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.066744    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v" event={"ID":"69d5aab8-f87f-4714-9797-0c89172abae1","Type":"ContainerDied","Data":"db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362"}
Jul 20 21:34:06.066930 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.066798    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v" event={"ID":"69d5aab8-f87f-4714-9797-0c89172abae1","Type":"ContainerDied","Data":"2e7814f3f81dd6d907e559404e8385d3eadf8631cddbe03f740c86cddf970e57"}
Jul 20 21:34:06.066930 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.066820    2573 scope.go:117] "RemoveContainer" containerID="db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362"
Jul 20 21:34:06.067963 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.067942    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d5aab8-f87f-4714-9797-0c89172abae1-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:06.067963 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.067961    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcgk9\" (UniqueName: \"kubernetes.io/projected/69d5aab8-f87f-4714-9797-0c89172abae1-kube-api-access-wcgk9\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:06.068122 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.067972    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d5aab8-f87f-4714-9797-0c89172abae1-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:06.076547 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.076527    2573 scope.go:117] "RemoveContainer" containerID="db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362"
Jul 20 21:34:06.076798 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:34:06.076778    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362\": container with ID starting with db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362 not found: ID does not exist" containerID="db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362"
Jul 20 21:34:06.076866 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.076807    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362"} err="failed to get container status \"db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362\": rpc error: code = NotFound desc = could not find container \"db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362\": container with ID starting with db7b75f2798f0684a7c74efad3efbcf51447563840c5e6f60403432c36b6c362 not found: ID does not exist"
Jul 20 21:34:06.091353 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.091321    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"]
Jul 20 21:34:06.095627 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.095602    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9d06801-86b47d4869-mxf4v"]
Jul 20 21:34:06.770658 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:06.770616    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69d5aab8-f87f-4714-9797-0c89172abae1" path="/var/lib/kubelet/pods/69d5aab8-f87f-4714-9797-0c89172abae1/volumes"
Jul 20 21:34:10.242425 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:10.242387    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"]
Jul 20 21:34:10.242971 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:10.242612    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy" containerID="cri-o://abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe" gracePeriod=30
Jul 20 21:34:13.971014 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:13.970971    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"]
Jul 20 21:34:13.971448 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:13.971405    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69d5aab8-f87f-4714-9797-0c89172abae1" containerName="maas-api"
Jul 20 21:34:13.971448 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:13.971423    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="69d5aab8-f87f-4714-9797-0c89172abae1" containerName="maas-api"
Jul 20 21:34:13.971535 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:13.971498    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="69d5aab8-f87f-4714-9797-0c89172abae1" containerName="maas-api"
Jul 20 21:34:13.975793 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:13.975774    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:13.982846 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:13.982823    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-cffb604b-serving-cert\""
Jul 20 21:34:13.997033 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:13.997004    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"]
Jul 20 21:34:14.141463 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.141430    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9812c8f5-b73c-49ec-8d2d-0d779cff6841-openshift-service-ca\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.141663 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.141494    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9812c8f5-b73c-49ec-8d2d-0d779cff6841-maas-api-tls\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.141663 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.141540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5kr2\" (UniqueName: \"kubernetes.io/projected/9812c8f5-b73c-49ec-8d2d-0d779cff6841-kube-api-access-m5kr2\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.242956 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.242914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9812c8f5-b73c-49ec-8d2d-0d779cff6841-openshift-service-ca\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.243167 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.243009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9812c8f5-b73c-49ec-8d2d-0d779cff6841-maas-api-tls\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.243167 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.243035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5kr2\" (UniqueName: \"kubernetes.io/projected/9812c8f5-b73c-49ec-8d2d-0d779cff6841-kube-api-access-m5kr2\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.243300 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:34:14.243243    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-serving-cert: secret "maas-api-e2e-migrate-cffb604b-serving-cert" not found
Jul 20 21:34:14.243354 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:34:14.243304    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9812c8f5-b73c-49ec-8d2d-0d779cff6841-maas-api-tls podName:9812c8f5-b73c-49ec-8d2d-0d779cff6841 nodeName:}" failed. No retries permitted until 2026-07-20 21:34:14.743288854 +0000 UTC m=+1914.496011555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9812c8f5-b73c-49ec-8d2d-0d779cff6841-maas-api-tls") pod "maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv" (UID: "9812c8f5-b73c-49ec-8d2d-0d779cff6841") : secret "maas-api-e2e-migrate-cffb604b-serving-cert" not found
Jul 20 21:34:14.243658 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.243638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9812c8f5-b73c-49ec-8d2d-0d779cff6841-openshift-service-ca\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.257650 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.257618    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5kr2\" (UniqueName: \"kubernetes.io/projected/9812c8f5-b73c-49ec-8d2d-0d779cff6841-kube-api-access-m5kr2\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.747854 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.747818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9812c8f5-b73c-49ec-8d2d-0d779cff6841-maas-api-tls\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.750259 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.750230    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9812c8f5-b73c-49ec-8d2d-0d779cff6841-maas-api-tls\") pod \"maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:14.886435 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:14.886400    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:15.045129 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.045098    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"]
Jul 20 21:34:15.047630 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:34:15.047605    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9812c8f5_b73c_49ec_8d2d_0d779cff6841.slice/crio-56bcb1830df4b6a1b5f413e3e4a3f511dbbd87c1556f94b22fda344015015200 WatchSource:0}: Error finding container 56bcb1830df4b6a1b5f413e3e4a3f511dbbd87c1556f94b22fda344015015200: Status 404 returned error can't find the container with id 56bcb1830df4b6a1b5f413e3e4a3f511dbbd87c1556f94b22fda344015015200
Jul 20 21:34:15.119804 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.119768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv" event={"ID":"9812c8f5-b73c-49ec-8d2d-0d779cff6841","Type":"ContainerStarted","Data":"56bcb1830df4b6a1b5f413e3e4a3f511dbbd87c1556f94b22fda344015015200"}
Jul 20 21:34:15.498832 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.498810    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:34:15.658291 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658201    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlx8f\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-kube-api-access-dlx8f\") pod \"a7e83e01-d166-48c8-9cec-203f341cefa1\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") "
Jul 20 21:34:15.658291 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658238    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-socket\") pod \"a7e83e01-d166-48c8-9cec-203f341cefa1\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") "
Jul 20 21:34:15.658291 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-token\") pod \"a7e83e01-d166-48c8-9cec-203f341cefa1\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") "
Jul 20 21:34:15.658291 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658283    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-envoy\") pod \"a7e83e01-d166-48c8-9cec-203f341cefa1\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") "
Jul 20 21:34:15.658621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658326    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-credential-socket\") pod \"a7e83e01-d166-48c8-9cec-203f341cefa1\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") "
Jul 20 21:34:15.658621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658350    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-data\") pod \"a7e83e01-d166-48c8-9cec-203f341cefa1\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") "
Jul 20 21:34:15.658621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658457    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-certs\") pod \"a7e83e01-d166-48c8-9cec-203f341cefa1\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") "
Jul 20 21:34:15.658621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658481    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-podinfo\") pod \"a7e83e01-d166-48c8-9cec-203f341cefa1\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") "
Jul 20 21:34:15.658621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658544    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7e83e01-d166-48c8-9cec-203f341cefa1" (UID: "a7e83e01-d166-48c8-9cec-203f341cefa1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:34:15.658621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658587    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7e83e01-d166-48c8-9cec-203f341cefa1-istiod-ca-cert\") pod \"a7e83e01-d166-48c8-9cec-203f341cefa1\" (UID: \"a7e83e01-d166-48c8-9cec-203f341cefa1\") "
Jul 20 21:34:15.658927 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658659    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7e83e01-d166-48c8-9cec-203f341cefa1" (UID: "a7e83e01-d166-48c8-9cec-203f341cefa1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:34:15.658927 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658678    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7e83e01-d166-48c8-9cec-203f341cefa1" (UID: "a7e83e01-d166-48c8-9cec-203f341cefa1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:34:15.658927 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658876    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:15.658927 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658896    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:15.658927 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658912    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:15.659200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.658942    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7e83e01-d166-48c8-9cec-203f341cefa1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7e83e01-d166-48c8-9cec-203f341cefa1" (UID: "a7e83e01-d166-48c8-9cec-203f341cefa1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:34:15.659753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.659647    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7e83e01-d166-48c8-9cec-203f341cefa1" (UID: "a7e83e01-d166-48c8-9cec-203f341cefa1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:34:15.660686 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.660657    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7e83e01-d166-48c8-9cec-203f341cefa1" (UID: "a7e83e01-d166-48c8-9cec-203f341cefa1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:34:15.660994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.660963    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-kube-api-access-dlx8f" (OuterVolumeSpecName: "kube-api-access-dlx8f") pod "a7e83e01-d166-48c8-9cec-203f341cefa1" (UID: "a7e83e01-d166-48c8-9cec-203f341cefa1"). InnerVolumeSpecName "kube-api-access-dlx8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:34:15.661200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.661019    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7e83e01-d166-48c8-9cec-203f341cefa1" (UID: "a7e83e01-d166-48c8-9cec-203f341cefa1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 21:34:15.661200 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.661130    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7e83e01-d166-48c8-9cec-203f341cefa1" (UID: "a7e83e01-d166-48c8-9cec-203f341cefa1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:34:15.760336 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.760295    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7e83e01-d166-48c8-9cec-203f341cefa1-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:15.760336 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.760330    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlx8f\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-kube-api-access-dlx8f\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:15.760336 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.760344    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:15.760579 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.760356    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:15.760579 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.760368    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:15.760579 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:15.760380    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7e83e01-d166-48c8-9cec-203f341cefa1-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:16.128810 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.128770    2573 generic.go:356] "Generic (PLEG): container finished" podID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerID="abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe" exitCode=0
Jul 20 21:34:16.129324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.128819    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"
Jul 20 21:34:16.129324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.128850    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" event={"ID":"a7e83e01-d166-48c8-9cec-203f341cefa1","Type":"ContainerDied","Data":"abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe"}
Jul 20 21:34:16.129324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.128906    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b" event={"ID":"a7e83e01-d166-48c8-9cec-203f341cefa1","Type":"ContainerDied","Data":"0b720c7dd326389cf69bbbcdd9532bbaa0ebf48ee7eabf5e39a188becd9a7a4e"}
Jul 20 21:34:16.129324 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.128926    2573 scope.go:117] "RemoveContainer" containerID="abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe"
Jul 20 21:34:16.131177 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.131141    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv" event={"ID":"9812c8f5-b73c-49ec-8d2d-0d779cff6841","Type":"ContainerStarted","Data":"8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98"}
Jul 20 21:34:16.131318 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.131272    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:16.140104 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.140060    2573 scope.go:117] "RemoveContainer" containerID="d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f"
Jul 20 21:34:16.149769 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.149753    2573 scope.go:117] "RemoveContainer" containerID="abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe"
Jul 20 21:34:16.150010 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:34:16.149992    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe\": container with ID starting with abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe not found: ID does not exist" containerID="abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe"
Jul 20 21:34:16.150057 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.150018    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe"} err="failed to get container status \"abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe\": rpc error: code = NotFound desc = could not find container \"abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe\": container with ID starting with abe4dd27ba2e6604d2a2d7a90e378ed57bb0b695afc8471ddc780def1e591cbe not found: ID does not exist"
Jul 20 21:34:16.150057 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.150035    2573 scope.go:117] "RemoveContainer" containerID="d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f"
Jul 20 21:34:16.150331 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:34:16.150311    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f\": container with ID starting with d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f not found: ID does not exist" containerID="d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f"
Jul 20 21:34:16.150384 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.150338    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f"} err="failed to get container status \"d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f\": rpc error: code = NotFound desc = could not find container \"d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f\": container with ID starting with d199d59faedccbbee64a2f5cc7096c92b90ce0e11c1f5f5a670aa7c07362220f not found: ID does not exist"
Jul 20 21:34:16.197088 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.197023    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv" podStartSLOduration=2.886670317 podStartE2EDuration="3.197008516s" totalImagesPullingTime="310.338199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:34:16.169128399 +0000 UTC m=+1915.921851122" watchObservedRunningTime="2026-07-20 21:34:16.197008516 +0000 UTC m=+1915.949731239"
Jul 20 21:34:16.197620 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.197602    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"]
Jul 20 21:34:16.201575 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.201550    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c9d06801-openshift-default-5d654755d9-6wl2b"]
Jul 20 21:34:16.770386 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:16.770347    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" path="/var/lib/kubelet/pods/a7e83e01-d166-48c8-9cec-203f341cefa1/volumes"
Jul 20 21:34:22.143722 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:22.143696    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:49.328464 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.328426    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"]
Jul 20 21:34:49.328997 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.328665    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv" podUID="9812c8f5-b73c-49ec-8d2d-0d779cff6841" containerName="maas-api" containerID="cri-o://8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98" gracePeriod=30
Jul 20 21:34:49.582613 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.582541    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:49.635882 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.635836    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9812c8f5-b73c-49ec-8d2d-0d779cff6841-openshift-service-ca\") pod \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") "
Jul 20 21:34:49.636038 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.635931    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9812c8f5-b73c-49ec-8d2d-0d779cff6841-maas-api-tls\") pod \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") "
Jul 20 21:34:49.636038 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.635959    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5kr2\" (UniqueName: \"kubernetes.io/projected/9812c8f5-b73c-49ec-8d2d-0d779cff6841-kube-api-access-m5kr2\") pod \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\" (UID: \"9812c8f5-b73c-49ec-8d2d-0d779cff6841\") "
Jul 20 21:34:49.636272 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.636244    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9812c8f5-b73c-49ec-8d2d-0d779cff6841-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9812c8f5-b73c-49ec-8d2d-0d779cff6841" (UID: "9812c8f5-b73c-49ec-8d2d-0d779cff6841"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:34:49.638009 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.637983    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9812c8f5-b73c-49ec-8d2d-0d779cff6841-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9812c8f5-b73c-49ec-8d2d-0d779cff6841" (UID: "9812c8f5-b73c-49ec-8d2d-0d779cff6841"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:34:49.638009 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.637983    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9812c8f5-b73c-49ec-8d2d-0d779cff6841-kube-api-access-m5kr2" (OuterVolumeSpecName: "kube-api-access-m5kr2") pod "9812c8f5-b73c-49ec-8d2d-0d779cff6841" (UID: "9812c8f5-b73c-49ec-8d2d-0d779cff6841"). InnerVolumeSpecName "kube-api-access-m5kr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:34:49.737323 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.737297    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9812c8f5-b73c-49ec-8d2d-0d779cff6841-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:49.737323 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.737322    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9812c8f5-b73c-49ec-8d2d-0d779cff6841-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:49.737474 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:49.737338    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5kr2\" (UniqueName: \"kubernetes.io/projected/9812c8f5-b73c-49ec-8d2d-0d779cff6841-kube-api-access-m5kr2\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:34:50.312970 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.312935    2573 generic.go:356] "Generic (PLEG): container finished" podID="9812c8f5-b73c-49ec-8d2d-0d779cff6841" containerID="8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98" exitCode=0
Jul 20 21:34:50.313173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.312981    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"
Jul 20 21:34:50.313173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.312999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv" event={"ID":"9812c8f5-b73c-49ec-8d2d-0d779cff6841","Type":"ContainerDied","Data":"8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98"}
Jul 20 21:34:50.313173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.313043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv" event={"ID":"9812c8f5-b73c-49ec-8d2d-0d779cff6841","Type":"ContainerDied","Data":"56bcb1830df4b6a1b5f413e3e4a3f511dbbd87c1556f94b22fda344015015200"}
Jul 20 21:34:50.313173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.313067    2573 scope.go:117] "RemoveContainer" containerID="8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98"
Jul 20 21:34:50.325157 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.325130    2573 scope.go:117] "RemoveContainer" containerID="8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98"
Jul 20 21:34:50.325475 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:34:50.325440    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98\": container with ID starting with 8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98 not found: ID does not exist" containerID="8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98"
Jul 20 21:34:50.325548 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.325484    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98"} err="failed to get container status \"8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98\": rpc error: code = NotFound desc = could not find container \"8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98\": container with ID starting with 8ed7c5804eaa2eb324df3fb584c0c3ba29e772b2dd87dc8f4b9900048d280c98 not found: ID does not exist"
Jul 20 21:34:50.337616 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.337588    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"]
Jul 20 21:34:50.340180 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.340160    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cffb604b-86bc47c8d6-5zbwv"]
Jul 20 21:34:50.770834 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:50.770805    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9812c8f5-b73c-49ec-8d2d-0d779cff6841" path="/var/lib/kubelet/pods/9812c8f5-b73c-49ec-8d2d-0d779cff6841/volumes"
Jul 20 21:34:54.665113 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665057    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"]
Jul 20 21:34:54.665473 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665454    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy"
Jul 20 21:34:54.665473 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665466    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy"
Jul 20 21:34:54.665575 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665476    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9812c8f5-b73c-49ec-8d2d-0d779cff6841" containerName="maas-api"
Jul 20 21:34:54.665575 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665486    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9812c8f5-b73c-49ec-8d2d-0d779cff6841" containerName="maas-api"
Jul 20 21:34:54.665575 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665502    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy"
Jul 20 21:34:54.665575 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665509    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy"
Jul 20 21:34:54.665575 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665574    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy"
Jul 20 21:34:54.665744 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665584    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e83e01-d166-48c8-9cec-203f341cefa1" containerName="istio-proxy"
Jul 20 21:34:54.665744 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.665606    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9812c8f5-b73c-49ec-8d2d-0d779cff6841" containerName="maas-api"
Jul 20 21:34:54.668639 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.668621    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.671930 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.671912    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9ce63ea5-openshift-default-dockercfg-mgxxg\""
Jul 20 21:34:54.683032 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.683006    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"]
Jul 20 21:34:54.776673 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.776645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-token\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.776841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.776682    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-certs\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.776841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.776710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-data\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.776841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.776725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbslp\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-kube-api-access-jbslp\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.776841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.776762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97e85d7-a7a3-4454-be03-033e6eeec307-istiod-ca-cert\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.776841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.776786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-podinfo\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.776841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.776814    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-envoy\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.776841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.776832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-socket\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.777135 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.776921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-credential-socket\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.877700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.877660    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-podinfo\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.877892 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.877721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-envoy\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.877892 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.877748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-socket\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.877892 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.877840    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-credential-socket\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.877892 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.877887    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-token\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.878143 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.877923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-certs\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.878143 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.877949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-data\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.878143 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.877975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbslp\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-kube-api-access-jbslp\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.878143 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.878003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97e85d7-a7a3-4454-be03-033e6eeec307-istiod-ca-cert\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.878347 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.878266    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-socket\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.878347 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.878297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-credential-socket\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.878466 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.878344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-data\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.878565 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.878544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-certs\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.878686 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.878670    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97e85d7-a7a3-4454-be03-033e6eeec307-istiod-ca-cert\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.880564 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.880542    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-envoy\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.880718 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.880701    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-podinfo\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.886841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.886819    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-token\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.886950 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.886929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbslp\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-kube-api-access-jbslp\") pod \"e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") " pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:54.978888 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:54.978860    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:55.122419 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:55.122391    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"]
Jul 20 21:34:55.123836 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:34:55.123809    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97e85d7_a7a3_4454_be03_033e6eeec307.slice/crio-15ece4ab54c2028c9ed5339d3b6fac35c70aaac83be8f49d70ecbdaa3f349a12 WatchSource:0}: Error finding container 15ece4ab54c2028c9ed5339d3b6fac35c70aaac83be8f49d70ecbdaa3f349a12: Status 404 returned error can't find the container with id 15ece4ab54c2028c9ed5339d3b6fac35c70aaac83be8f49d70ecbdaa3f349a12
Jul 20 21:34:55.126244 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:55.126194    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:34:55.126361 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:55.126296    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:34:55.126361 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:55.126342    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:34:55.343459 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:55.343367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" event={"ID":"a97e85d7-a7a3-4454-be03-033e6eeec307","Type":"ContainerStarted","Data":"a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68"}
Jul 20 21:34:55.343459 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:55.343441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" event={"ID":"a97e85d7-a7a3-4454-be03-033e6eeec307","Type":"ContainerStarted","Data":"15ece4ab54c2028c9ed5339d3b6fac35c70aaac83be8f49d70ecbdaa3f349a12"}
Jul 20 21:34:55.368218 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:55.368162    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" podStartSLOduration=1.368136639 podStartE2EDuration="1.368136639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:34:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:34:55.365511562 +0000 UTC m=+1955.118234313" watchObservedRunningTime="2026-07-20 21:34:55.368136639 +0000 UTC m=+1955.120859363"
Jul 20 21:34:55.979570 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:55.979537    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:56.901114 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:56.901067    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"]
Jul 20 21:34:56.904710 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:56.904688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:56.907576 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:56.907554    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9ce63ea5-serving-cert\""
Jul 20 21:34:56.919511 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:56.919487    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"]
Jul 20 21:34:56.984279 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:56.984248    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:57.003056 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.003021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn44h\" (UniqueName: \"kubernetes.io/projected/277962ae-0b3b-4294-8e6a-fbae21505770-kube-api-access-dn44h\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.003214 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.003100    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277962ae-0b3b-4294-8e6a-fbae21505770-maas-api-tls\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.003214 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.003130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277962ae-0b3b-4294-8e6a-fbae21505770-openshift-service-ca\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.104438 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.104405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn44h\" (UniqueName: \"kubernetes.io/projected/277962ae-0b3b-4294-8e6a-fbae21505770-kube-api-access-dn44h\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.104588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.104458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277962ae-0b3b-4294-8e6a-fbae21505770-maas-api-tls\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.104588 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.104480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277962ae-0b3b-4294-8e6a-fbae21505770-openshift-service-ca\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.104685 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:34:57.104602    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-serving-cert: secret "maas-api-e2e-ait-9ce63ea5-serving-cert" not found
Jul 20 21:34:57.104721 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:34:57.104694    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/277962ae-0b3b-4294-8e6a-fbae21505770-maas-api-tls podName:277962ae-0b3b-4294-8e6a-fbae21505770 nodeName:}" failed. No retries permitted until 2026-07-20 21:34:57.604669009 +0000 UTC m=+1957.357391710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/277962ae-0b3b-4294-8e6a-fbae21505770-maas-api-tls") pod "maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f" (UID: "277962ae-0b3b-4294-8e6a-fbae21505770") : secret "maas-api-e2e-ait-9ce63ea5-serving-cert" not found
Jul 20 21:34:57.105088 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.105056    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277962ae-0b3b-4294-8e6a-fbae21505770-openshift-service-ca\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.113245 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.113228    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn44h\" (UniqueName: \"kubernetes.io/projected/277962ae-0b3b-4294-8e6a-fbae21505770-kube-api-access-dn44h\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.355224 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.355194    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:57.356176 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.356158    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:34:57.608432 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.608342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277962ae-0b3b-4294-8e6a-fbae21505770-maas-api-tls\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.610847 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.610824    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277962ae-0b3b-4294-8e6a-fbae21505770-maas-api-tls\") pod \"maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:57.815765 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:57.815731    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:58.187060 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:58.187029    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"]
Jul 20 21:34:58.188714 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:34:58.188687    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277962ae_0b3b_4294_8e6a_fbae21505770.slice/crio-f4c4496908b3c0f9cd8b392d318cda262d8764599a55d3b95848ab6b7c749bf6 WatchSource:0}: Error finding container f4c4496908b3c0f9cd8b392d318cda262d8764599a55d3b95848ab6b7c749bf6: Status 404 returned error can't find the container with id f4c4496908b3c0f9cd8b392d318cda262d8764599a55d3b95848ab6b7c749bf6
Jul 20 21:34:58.363800 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:58.363766    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f" event={"ID":"277962ae-0b3b-4294-8e6a-fbae21505770","Type":"ContainerStarted","Data":"f4c4496908b3c0f9cd8b392d318cda262d8764599a55d3b95848ab6b7c749bf6"}
Jul 20 21:34:59.370938 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:59.370899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f" event={"ID":"277962ae-0b3b-4294-8e6a-fbae21505770","Type":"ContainerStarted","Data":"9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9"}
Jul 20 21:34:59.371334 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:59.371178    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:34:59.397213 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:34:59.397169    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f" podStartSLOduration=3.01026117 podStartE2EDuration="3.397155014s" totalImagesPullingTime="386.893844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:34:59.394851742 +0000 UTC m=+1959.147574464" watchObservedRunningTime="2026-07-20 21:34:59.397155014 +0000 UTC m=+1959.149877736"
Jul 20 21:35:05.381976 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:05.381944    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:35:13.098634 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:13.097534    2573 patch_prober.go:28] interesting pod/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:42902->10.132.0.59:15021: read: connection reset by peer" start-of-body=
Jul 20 21:35:13.098634 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:13.097602    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:42902->10.132.0.59:15021: read: connection reset by peer"
Jul 20 21:35:13.449273 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:13.449171    2573 generic.go:356] "Generic (PLEG): container finished" podID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerID="a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68" exitCode=0
Jul 20 21:35:13.449273 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:13.449243    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" event={"ID":"a97e85d7-a7a3-4454-be03-033e6eeec307","Type":"ContainerDied","Data":"a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68"}
Jul 20 21:35:13.449608 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:13.449594    2573 scope.go:117] "RemoveContainer" containerID="a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68"
Jul 20 21:35:13.450595 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:13.450565    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:35:13.450650 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:13.450638    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:35:13.450689 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:13.450669    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:35:14.458592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:14.458557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" event={"ID":"a97e85d7-a7a3-4454-be03-033e6eeec307","Type":"ContainerStarted","Data":"073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6"}
Jul 20 21:35:14.979930 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:14.979885    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:35:14.980131 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:14.980098    2573 patch_prober.go:28] interesting pod/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 20 21:35:14.980179 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:14.980155    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 20 21:35:15.980211 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:15.980175    2573 patch_prober.go:28] interesting pod/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 20 21:35:15.980594 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:15.980233    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 20 21:35:16.980142 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:16.980107    2573 patch_prober.go:28] interesting pod/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 20 21:35:16.980327 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:16.980177    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 20 21:35:17.979840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:17.979806    2573 patch_prober.go:28] interesting pod/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 20 21:35:17.980020 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:17.979862    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 20 21:35:18.983241 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:18.983208    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:35:18.983697 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:18.983480    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:35:18.984368 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:18.984350    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:35:33.097535 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.097503    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"]
Jul 20 21:35:33.098107 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.097729    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f" podUID="277962ae-0b3b-4294-8e6a-fbae21505770" containerName="maas-api" containerID="cri-o://9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9" gracePeriod=30
Jul 20 21:35:33.353720 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.353666    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:35:33.424841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.424803    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277962ae-0b3b-4294-8e6a-fbae21505770-maas-api-tls\") pod \"277962ae-0b3b-4294-8e6a-fbae21505770\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") "
Jul 20 21:35:33.424989 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.424859    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn44h\" (UniqueName: \"kubernetes.io/projected/277962ae-0b3b-4294-8e6a-fbae21505770-kube-api-access-dn44h\") pod \"277962ae-0b3b-4294-8e6a-fbae21505770\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") "
Jul 20 21:35:33.424989 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.424916    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277962ae-0b3b-4294-8e6a-fbae21505770-openshift-service-ca\") pod \"277962ae-0b3b-4294-8e6a-fbae21505770\" (UID: \"277962ae-0b3b-4294-8e6a-fbae21505770\") "
Jul 20 21:35:33.425318 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.425290    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277962ae-0b3b-4294-8e6a-fbae21505770-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "277962ae-0b3b-4294-8e6a-fbae21505770" (UID: "277962ae-0b3b-4294-8e6a-fbae21505770"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:35:33.427134 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.427104    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/277962ae-0b3b-4294-8e6a-fbae21505770-kube-api-access-dn44h" (OuterVolumeSpecName: "kube-api-access-dn44h") pod "277962ae-0b3b-4294-8e6a-fbae21505770" (UID: "277962ae-0b3b-4294-8e6a-fbae21505770"). InnerVolumeSpecName "kube-api-access-dn44h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:35:33.427359 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.427327    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/277962ae-0b3b-4294-8e6a-fbae21505770-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "277962ae-0b3b-4294-8e6a-fbae21505770" (UID: "277962ae-0b3b-4294-8e6a-fbae21505770"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:35:33.526139 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.526114    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277962ae-0b3b-4294-8e6a-fbae21505770-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:33.526139 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.526136    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn44h\" (UniqueName: \"kubernetes.io/projected/277962ae-0b3b-4294-8e6a-fbae21505770-kube-api-access-dn44h\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:33.526279 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.526147    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277962ae-0b3b-4294-8e6a-fbae21505770-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:33.557702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.557667    2573 generic.go:356] "Generic (PLEG): container finished" podID="277962ae-0b3b-4294-8e6a-fbae21505770" containerID="9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9" exitCode=0
Jul 20 21:35:33.557837 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.557712    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"
Jul 20 21:35:33.557837 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.557745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f" event={"ID":"277962ae-0b3b-4294-8e6a-fbae21505770","Type":"ContainerDied","Data":"9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9"}
Jul 20 21:35:33.557837 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.557799    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f" event={"ID":"277962ae-0b3b-4294-8e6a-fbae21505770","Type":"ContainerDied","Data":"f4c4496908b3c0f9cd8b392d318cda262d8764599a55d3b95848ab6b7c749bf6"}
Jul 20 21:35:33.557837 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.557823    2573 scope.go:117] "RemoveContainer" containerID="9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9"
Jul 20 21:35:33.567020 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.567002    2573 scope.go:117] "RemoveContainer" containerID="9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9"
Jul 20 21:35:33.567363 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:35:33.567337    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9\": container with ID starting with 9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9 not found: ID does not exist" containerID="9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9"
Jul 20 21:35:33.567461 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.567387    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9"} err="failed to get container status \"9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9\": rpc error: code = NotFound desc = could not find container \"9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9\": container with ID starting with 9a45e6da4776f36dfe9c2abd0b69d6627fe79c1b687a8d1b50fd397643ee50c9 not found: ID does not exist"
Jul 20 21:35:33.579567 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.579544    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"]
Jul 20 21:35:33.583268 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:33.583248    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ce63ea5-7947d799c7-frb7f"]
Jul 20 21:35:34.769731 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:34.769701    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="277962ae-0b3b-4294-8e6a-fbae21505770" path="/var/lib/kubelet/pods/277962ae-0b3b-4294-8e6a-fbae21505770/volumes"
Jul 20 21:35:38.943987 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:38.943950    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"]
Jul 20 21:35:38.944442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:38.944191    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy" containerID="cri-o://073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6" gracePeriod=30
Jul 20 21:35:39.750963 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.750929    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"]
Jul 20 21:35:39.751319 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.751306    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277962ae-0b3b-4294-8e6a-fbae21505770" containerName="maas-api"
Jul 20 21:35:39.751371 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.751321    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="277962ae-0b3b-4294-8e6a-fbae21505770" containerName="maas-api"
Jul 20 21:35:39.751411 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.751380    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="277962ae-0b3b-4294-8e6a-fbae21505770" containerName="maas-api"
Jul 20 21:35:39.755606 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.755590    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.758682 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.758656    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5eb07c58-openshift-default-dockercfg-qqq4x\""
Jul 20 21:35:39.768955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.768929    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"]
Jul 20 21:35:39.876383 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.876352    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-token\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.876383 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.876386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fl9p\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-kube-api-access-8fl9p\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.876601 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.876413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-data\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.876601 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.876496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-envoy\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.876601 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.876540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istiod-ca-cert\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.876601 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.876572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-certs\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.876747 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.876604    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-credential-socket\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.876747 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.876622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-podinfo\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.876747 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.876676    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-socket\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978107 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-socket\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-token\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fl9p\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-kube-api-access-8fl9p\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978170    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-data\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-envoy\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istiod-ca-cert\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-certs\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-credential-socket\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-podinfo\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978487    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-socket\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978558 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978537    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-data\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978981 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978753    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-credential-socket\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978981 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978753    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-certs\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.978981 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.978861    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istiod-ca-cert\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.980512 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.980485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-envoy\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.980671 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.980655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-podinfo\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.987128 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.987109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-token\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:39.987286 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:39.987264    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fl9p\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-kube-api-access-8fl9p\") pod \"e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") " pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:40.066032 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:40.065952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:40.206918 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:40.206889    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"]
Jul 20 21:35:40.208099 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:35:40.208044    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode584a08f_f40d_4a67_ad1b_cbd3c27460ac.slice/crio-c49967ab606418319e84521af5f93dec07af9ff5d17d993f9e66d9785a836954 WatchSource:0}: Error finding container c49967ab606418319e84521af5f93dec07af9ff5d17d993f9e66d9785a836954: Status 404 returned error can't find the container with id c49967ab606418319e84521af5f93dec07af9ff5d17d993f9e66d9785a836954
Jul 20 21:35:40.210042 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:40.210013    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:35:40.210149 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:40.210100    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:35:40.210149 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:40.210129    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:35:40.596105 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:40.596038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" event={"ID":"e584a08f-f40d-4a67-ad1b-cbd3c27460ac","Type":"ContainerStarted","Data":"99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9"}
Jul 20 21:35:40.596311 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:40.596142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" event={"ID":"e584a08f-f40d-4a67-ad1b-cbd3c27460ac","Type":"ContainerStarted","Data":"c49967ab606418319e84521af5f93dec07af9ff5d17d993f9e66d9785a836954"}
Jul 20 21:35:40.617592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:40.617546    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" podStartSLOduration=1.61753473 podStartE2EDuration="1.61753473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:35:40.616628292 +0000 UTC m=+2000.369351013" watchObservedRunningTime="2026-07-20 21:35:40.61753473 +0000 UTC m=+2000.370257452"
Jul 20 21:35:41.066921 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:41.066889    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:41.071636 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:41.071612    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:41.601365 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:41.601333    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:41.602173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:41.602156    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:42.092020 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.091990    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"]
Jul 20 21:35:42.095434 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.095418    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.098760 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.098736    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5eb07c58-serving-cert\""
Jul 20 21:35:42.108716 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.108693    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"]
Jul 20 21:35:42.196444 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.196416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e194d2b8-a70d-4b81-8d32-96afbd0ea976-openshift-service-ca\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.196611 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.196473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e194d2b8-a70d-4b81-8d32-96afbd0ea976-maas-api-tls\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.196611 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.196504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djvbn\" (UniqueName: \"kubernetes.io/projected/e194d2b8-a70d-4b81-8d32-96afbd0ea976-kube-api-access-djvbn\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.297476 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.297443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e194d2b8-a70d-4b81-8d32-96afbd0ea976-openshift-service-ca\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.297725 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.297508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e194d2b8-a70d-4b81-8d32-96afbd0ea976-maas-api-tls\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.297725 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.297543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djvbn\" (UniqueName: \"kubernetes.io/projected/e194d2b8-a70d-4b81-8d32-96afbd0ea976-kube-api-access-djvbn\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.297725 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:35:42.297608    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-serving-cert: secret "maas-api-e2e-derive-5eb07c58-serving-cert" not found
Jul 20 21:35:42.297725 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:35:42.297674    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e194d2b8-a70d-4b81-8d32-96afbd0ea976-maas-api-tls podName:e194d2b8-a70d-4b81-8d32-96afbd0ea976 nodeName:}" failed. No retries permitted until 2026-07-20 21:35:42.79765856 +0000 UTC m=+2002.550381264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e194d2b8-a70d-4b81-8d32-96afbd0ea976-maas-api-tls") pod "maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw" (UID: "e194d2b8-a70d-4b81-8d32-96afbd0ea976") : secret "maas-api-e2e-derive-5eb07c58-serving-cert" not found
Jul 20 21:35:42.298245 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.298220    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e194d2b8-a70d-4b81-8d32-96afbd0ea976-openshift-service-ca\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.309120 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.309091    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djvbn\" (UniqueName: \"kubernetes.io/projected/e194d2b8-a70d-4b81-8d32-96afbd0ea976-kube-api-access-djvbn\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.802397 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.802361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e194d2b8-a70d-4b81-8d32-96afbd0ea976-maas-api-tls\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:42.804757 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:42.804736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e194d2b8-a70d-4b81-8d32-96afbd0ea976-maas-api-tls\") pod \"maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:43.006412 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:43.006371    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:43.146583 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:43.146559    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"]
Jul 20 21:35:43.148232 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:35:43.148206    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode194d2b8_a70d_4b81_8d32_96afbd0ea976.slice/crio-ee45273141fc563ac81b6491b6691478d6b411e515ac4be2a90b8cea0c1b9214 WatchSource:0}: Error finding container ee45273141fc563ac81b6491b6691478d6b411e515ac4be2a90b8cea0c1b9214: Status 404 returned error can't find the container with id ee45273141fc563ac81b6491b6691478d6b411e515ac4be2a90b8cea0c1b9214
Jul 20 21:35:43.613500 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:43.613467    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw" event={"ID":"e194d2b8-a70d-4b81-8d32-96afbd0ea976","Type":"ContainerStarted","Data":"19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772"}
Jul 20 21:35:43.613621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:43.613535    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw" event={"ID":"e194d2b8-a70d-4b81-8d32-96afbd0ea976","Type":"ContainerStarted","Data":"ee45273141fc563ac81b6491b6691478d6b411e515ac4be2a90b8cea0c1b9214"}
Jul 20 21:35:43.613815 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:43.613789    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:43.641220 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:43.641161    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw" podStartSLOduration=1.241548577 podStartE2EDuration="1.641141771s" totalImagesPullingTime="399.593194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:35:43.638844465 +0000 UTC m=+2003.391567206" watchObservedRunningTime="2026-07-20 21:35:43.641141771 +0000 UTC m=+2003.393864494"
Jul 20 21:35:44.195668 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.195645    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:35:44.316854 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.316822    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-token\") pod \"a97e85d7-a7a3-4454-be03-033e6eeec307\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") "
Jul 20 21:35:44.316854 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.316859    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbslp\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-kube-api-access-jbslp\") pod \"a97e85d7-a7a3-4454-be03-033e6eeec307\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") "
Jul 20 21:35:44.317128 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.316925    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97e85d7-a7a3-4454-be03-033e6eeec307-istiod-ca-cert\") pod \"a97e85d7-a7a3-4454-be03-033e6eeec307\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") "
Jul 20 21:35:44.317128 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.316961    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-podinfo\") pod \"a97e85d7-a7a3-4454-be03-033e6eeec307\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") "
Jul 20 21:35:44.317242 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317126    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-socket\") pod \"a97e85d7-a7a3-4454-be03-033e6eeec307\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") "
Jul 20 21:35:44.317242 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317229    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-credential-socket\") pod \"a97e85d7-a7a3-4454-be03-033e6eeec307\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") "
Jul 20 21:35:44.317352 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317259    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-data\") pod \"a97e85d7-a7a3-4454-be03-033e6eeec307\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") "
Jul 20 21:35:44.317352 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317288    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-certs\") pod \"a97e85d7-a7a3-4454-be03-033e6eeec307\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") "
Jul 20 21:35:44.317352 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317315    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-envoy\") pod \"a97e85d7-a7a3-4454-be03-033e6eeec307\" (UID: \"a97e85d7-a7a3-4454-be03-033e6eeec307\") "
Jul 20 21:35:44.317495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317376    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a97e85d7-a7a3-4454-be03-033e6eeec307" (UID: "a97e85d7-a7a3-4454-be03-033e6eeec307"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:35:44.317495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317424    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a97e85d7-a7a3-4454-be03-033e6eeec307" (UID: "a97e85d7-a7a3-4454-be03-033e6eeec307"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:35:44.317495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317462    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a97e85d7-a7a3-4454-be03-033e6eeec307-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a97e85d7-a7a3-4454-be03-033e6eeec307" (UID: "a97e85d7-a7a3-4454-be03-033e6eeec307"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:35:44.317675 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317653    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a97e85d7-a7a3-4454-be03-033e6eeec307" (UID: "a97e85d7-a7a3-4454-be03-033e6eeec307"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:35:44.317733 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317666    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97e85d7-a7a3-4454-be03-033e6eeec307-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:44.317733 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317697    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:44.317733 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317713    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:44.318002 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.317984    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-data" (OuterVolumeSpecName: "istio-data") pod "a97e85d7-a7a3-4454-be03-033e6eeec307" (UID: "a97e85d7-a7a3-4454-be03-033e6eeec307"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:35:44.319267 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.319235    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-kube-api-access-jbslp" (OuterVolumeSpecName: "kube-api-access-jbslp") pod "a97e85d7-a7a3-4454-be03-033e6eeec307" (UID: "a97e85d7-a7a3-4454-be03-033e6eeec307"). InnerVolumeSpecName "kube-api-access-jbslp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:35:44.319385 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.319332    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a97e85d7-a7a3-4454-be03-033e6eeec307" (UID: "a97e85d7-a7a3-4454-be03-033e6eeec307"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:35:44.319507 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.319490    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a97e85d7-a7a3-4454-be03-033e6eeec307" (UID: "a97e85d7-a7a3-4454-be03-033e6eeec307"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 21:35:44.319570 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.319501    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-token" (OuterVolumeSpecName: "istio-token") pod "a97e85d7-a7a3-4454-be03-033e6eeec307" (UID: "a97e85d7-a7a3-4454-be03-033e6eeec307"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:35:44.418540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.418514    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:44.418540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.418535    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:44.418540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.418544    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:44.418729 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.418553    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:44.418729 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.418561    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbslp\" (UniqueName: \"kubernetes.io/projected/a97e85d7-a7a3-4454-be03-033e6eeec307-kube-api-access-jbslp\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:44.418729 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.418569    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97e85d7-a7a3-4454-be03-033e6eeec307-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:35:44.620404 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.620303    2573 generic.go:356] "Generic (PLEG): container finished" podID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerID="073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6" exitCode=0
Jul 20 21:35:44.620404 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.620360    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"
Jul 20 21:35:44.620635 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.620402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" event={"ID":"a97e85d7-a7a3-4454-be03-033e6eeec307","Type":"ContainerDied","Data":"073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6"}
Jul 20 21:35:44.620635 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.620459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87" event={"ID":"a97e85d7-a7a3-4454-be03-033e6eeec307","Type":"ContainerDied","Data":"15ece4ab54c2028c9ed5339d3b6fac35c70aaac83be8f49d70ecbdaa3f349a12"}
Jul 20 21:35:44.620635 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.620480    2573 scope.go:117] "RemoveContainer" containerID="073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6"
Jul 20 21:35:44.636580 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.636561    2573 scope.go:117] "RemoveContainer" containerID="a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68"
Jul 20 21:35:44.644556 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.644539    2573 scope.go:117] "RemoveContainer" containerID="073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6"
Jul 20 21:35:44.644805 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:35:44.644783    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6\": container with ID starting with 073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6 not found: ID does not exist" containerID="073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6"
Jul 20 21:35:44.644875 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.644816    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6"} err="failed to get container status \"073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6\": rpc error: code = NotFound desc = could not find container \"073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6\": container with ID starting with 073b74a7b7e9e372a5104ee7ec3e43aaafcfc67a1404daeae61d0cc953fe31c6 not found: ID does not exist"
Jul 20 21:35:44.644875 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.644839    2573 scope.go:117] "RemoveContainer" containerID="a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68"
Jul 20 21:35:44.645120 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:35:44.645086    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68\": container with ID starting with a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68 not found: ID does not exist" containerID="a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68"
Jul 20 21:35:44.645248 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.645122    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68"} err="failed to get container status \"a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68\": rpc error: code = NotFound desc = could not find container \"a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68\": container with ID starting with a94d767fdf68012431f9546b437e9e8d0913e1b2be38872d5c1d2234a802df68 not found: ID does not exist"
Jul 20 21:35:44.647735 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.647714    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"]
Jul 20 21:35:44.652721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.652701    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9ce63ea5-openshift-default-6f59bf56cc-2pj87"]
Jul 20 21:35:44.769320 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:44.769292    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" path="/var/lib/kubelet/pods/a97e85d7-a7a3-4454-be03-033e6eeec307/volumes"
Jul 20 21:35:49.626365 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:49.626336    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:35:56.602699 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:56.602664    2573 patch_prober.go:28] interesting pod/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 20 21:35:56.603120 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:56.602748    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 20 21:35:56.689827 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:56.689738    2573 generic.go:356] "Generic (PLEG): container finished" podID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerID="99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9" exitCode=0
Jul 20 21:35:56.689827 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:56.689793    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" event={"ID":"e584a08f-f40d-4a67-ad1b-cbd3c27460ac","Type":"ContainerDied","Data":"99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9"}
Jul 20 21:35:56.690246 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:56.690230    2573 scope.go:117] "RemoveContainer" containerID="99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9"
Jul 20 21:35:56.691389 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:56.691356    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:35:56.691497 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:56.691441    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:35:56.691497 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:56.691491    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:35:57.696762 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:57.696727    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" event={"ID":"e584a08f-f40d-4a67-ad1b-cbd3c27460ac","Type":"ContainerStarted","Data":"296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34"}
Jul 20 21:35:58.066431 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:58.066389    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:35:58.066676 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:58.066651    2573 patch_prober.go:28] interesting pod/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 20 21:35:58.066730 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:58.066708    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 20 21:35:59.066719 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:59.066685    2573 patch_prober.go:28] interesting pod/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 20 21:35:59.067118 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:35:59.066739    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 20 21:36:00.066838 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:00.066796    2573 patch_prober.go:28] interesting pod/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 20 21:36:00.067336 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:00.066859    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 20 21:36:01.067141 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:01.067103    2573 patch_prober.go:28] interesting pod/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 20 21:36:01.067513 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:01.067173    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 20 21:36:02.070835 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:02.070803    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:36:02.071279 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:02.071198    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:36:02.071773 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:02.071756    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:36:17.293140 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.293102    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"]
Jul 20 21:36:17.293763 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.293349    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw" podUID="e194d2b8-a70d-4b81-8d32-96afbd0ea976" containerName="maas-api" containerID="cri-o://19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772" gracePeriod=30
Jul 20 21:36:17.542600 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.542578    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:36:17.605248 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.605183    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djvbn\" (UniqueName: \"kubernetes.io/projected/e194d2b8-a70d-4b81-8d32-96afbd0ea976-kube-api-access-djvbn\") pod \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") "
Jul 20 21:36:17.605248 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.605216    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e194d2b8-a70d-4b81-8d32-96afbd0ea976-maas-api-tls\") pod \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") "
Jul 20 21:36:17.605454 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.605250    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e194d2b8-a70d-4b81-8d32-96afbd0ea976-openshift-service-ca\") pod \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\" (UID: \"e194d2b8-a70d-4b81-8d32-96afbd0ea976\") "
Jul 20 21:36:17.605627 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.605602    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e194d2b8-a70d-4b81-8d32-96afbd0ea976-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e194d2b8-a70d-4b81-8d32-96afbd0ea976" (UID: "e194d2b8-a70d-4b81-8d32-96afbd0ea976"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:36:17.607156 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.607130    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e194d2b8-a70d-4b81-8d32-96afbd0ea976-kube-api-access-djvbn" (OuterVolumeSpecName: "kube-api-access-djvbn") pod "e194d2b8-a70d-4b81-8d32-96afbd0ea976" (UID: "e194d2b8-a70d-4b81-8d32-96afbd0ea976"). InnerVolumeSpecName "kube-api-access-djvbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:36:17.607262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.607237    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e194d2b8-a70d-4b81-8d32-96afbd0ea976-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e194d2b8-a70d-4b81-8d32-96afbd0ea976" (UID: "e194d2b8-a70d-4b81-8d32-96afbd0ea976"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:36:17.705962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.705932    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djvbn\" (UniqueName: \"kubernetes.io/projected/e194d2b8-a70d-4b81-8d32-96afbd0ea976-kube-api-access-djvbn\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:17.705962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.705957    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e194d2b8-a70d-4b81-8d32-96afbd0ea976-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:17.706127 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.705967    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e194d2b8-a70d-4b81-8d32-96afbd0ea976-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:17.812927 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.812895    2573 generic.go:356] "Generic (PLEG): container finished" podID="e194d2b8-a70d-4b81-8d32-96afbd0ea976" containerID="19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772" exitCode=0
Jul 20 21:36:17.813129 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.812944    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"
Jul 20 21:36:17.813129 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.812982    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw" event={"ID":"e194d2b8-a70d-4b81-8d32-96afbd0ea976","Type":"ContainerDied","Data":"19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772"}
Jul 20 21:36:17.813129 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.813031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw" event={"ID":"e194d2b8-a70d-4b81-8d32-96afbd0ea976","Type":"ContainerDied","Data":"ee45273141fc563ac81b6491b6691478d6b411e515ac4be2a90b8cea0c1b9214"}
Jul 20 21:36:17.813129 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.813052    2573 scope.go:117] "RemoveContainer" containerID="19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772"
Jul 20 21:36:17.822257 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.822242    2573 scope.go:117] "RemoveContainer" containerID="19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772"
Jul 20 21:36:17.822506 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:36:17.822474    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772\": container with ID starting with 19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772 not found: ID does not exist" containerID="19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772"
Jul 20 21:36:17.822571 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.822517    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772"} err="failed to get container status \"19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772\": rpc error: code = NotFound desc = could not find container \"19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772\": container with ID starting with 19be2fcb10724c6413480a945b41d40de84fec053ec4f6ea545d30941b0a3772 not found: ID does not exist"
Jul 20 21:36:17.835615 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.835589    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"]
Jul 20 21:36:17.839964 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:17.839941    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5eb07c58-ddd54fcb6-cb2pw"]
Jul 20 21:36:18.771087 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:18.771037    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e194d2b8-a70d-4b81-8d32-96afbd0ea976" path="/var/lib/kubelet/pods/e194d2b8-a70d-4b81-8d32-96afbd0ea976/volumes"
Jul 20 21:36:22.079858 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:22.079824    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"]
Jul 20 21:36:22.080345 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:22.080090    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy" containerID="cri-o://296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34" gracePeriod=30
Jul 20 21:36:27.358098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.358004    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:36:27.385708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.385678    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-podinfo\") pod \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") "
Jul 20 21:36:27.385708 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.385715    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-token\") pod \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") "
Jul 20 21:36:27.385951 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.385746    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fl9p\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-kube-api-access-8fl9p\") pod \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") "
Jul 20 21:36:27.385951 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.385767    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-credential-socket\") pod \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") "
Jul 20 21:36:27.385951 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.385793    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-data\") pod \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") "
Jul 20 21:36:27.385951 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.385813    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-socket\") pod \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") "
Jul 20 21:36:27.385951 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.385852    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-certs\") pod \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") "
Jul 20 21:36:27.385951 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.385906    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-envoy\") pod \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") "
Jul 20 21:36:27.385951 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.385934    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istiod-ca-cert\") pod \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\" (UID: \"e584a08f-f40d-4a67-ad1b-cbd3c27460ac\") "
Jul 20 21:36:27.386345 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.386288    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e584a08f-f40d-4a67-ad1b-cbd3c27460ac" (UID: "e584a08f-f40d-4a67-ad1b-cbd3c27460ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:36:27.386515 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.386491    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e584a08f-f40d-4a67-ad1b-cbd3c27460ac" (UID: "e584a08f-f40d-4a67-ad1b-cbd3c27460ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:36:27.386583 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.386528    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e584a08f-f40d-4a67-ad1b-cbd3c27460ac" (UID: "e584a08f-f40d-4a67-ad1b-cbd3c27460ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:36:27.386639 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.386603    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e584a08f-f40d-4a67-ad1b-cbd3c27460ac" (UID: "e584a08f-f40d-4a67-ad1b-cbd3c27460ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:36:27.387090 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.387048    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-data" (OuterVolumeSpecName: "istio-data") pod "e584a08f-f40d-4a67-ad1b-cbd3c27460ac" (UID: "e584a08f-f40d-4a67-ad1b-cbd3c27460ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:36:27.388273 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.388247    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-kube-api-access-8fl9p" (OuterVolumeSpecName: "kube-api-access-8fl9p") pod "e584a08f-f40d-4a67-ad1b-cbd3c27460ac" (UID: "e584a08f-f40d-4a67-ad1b-cbd3c27460ac"). InnerVolumeSpecName "kube-api-access-8fl9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:36:27.388533 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.388507    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-token" (OuterVolumeSpecName: "istio-token") pod "e584a08f-f40d-4a67-ad1b-cbd3c27460ac" (UID: "e584a08f-f40d-4a67-ad1b-cbd3c27460ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:36:27.388723 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.388692    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e584a08f-f40d-4a67-ad1b-cbd3c27460ac" (UID: "e584a08f-f40d-4a67-ad1b-cbd3c27460ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 21:36:27.388840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.388724    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e584a08f-f40d-4a67-ad1b-cbd3c27460ac" (UID: "e584a08f-f40d-4a67-ad1b-cbd3c27460ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:36:27.487366 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.487324    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:27.487366 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.487358    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:27.487366 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.487368    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:27.487366 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.487376    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:27.487644 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.487384    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:27.487644 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.487392    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:27.487644 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.487399    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:27.487644 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.487409    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fl9p\" (UniqueName: \"kubernetes.io/projected/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-kube-api-access-8fl9p\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:27.487644 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.487419    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e584a08f-f40d-4a67-ad1b-cbd3c27460ac-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:36:27.872980 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.872943    2573 generic.go:356] "Generic (PLEG): container finished" podID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerID="296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34" exitCode=0
Jul 20 21:36:27.873199 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.873010    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"
Jul 20 21:36:27.873199 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.873012    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" event={"ID":"e584a08f-f40d-4a67-ad1b-cbd3c27460ac","Type":"ContainerDied","Data":"296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34"}
Jul 20 21:36:27.873199 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.873098    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz" event={"ID":"e584a08f-f40d-4a67-ad1b-cbd3c27460ac","Type":"ContainerDied","Data":"c49967ab606418319e84521af5f93dec07af9ff5d17d993f9e66d9785a836954"}
Jul 20 21:36:27.873199 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.873108    2573 scope.go:117] "RemoveContainer" containerID="296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34"
Jul 20 21:36:27.883478 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.883450    2573 scope.go:117] "RemoveContainer" containerID="99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9"
Jul 20 21:36:27.892311 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.892293    2573 scope.go:117] "RemoveContainer" containerID="296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34"
Jul 20 21:36:27.892601 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:36:27.892580    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34\": container with ID starting with 296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34 not found: ID does not exist" containerID="296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34"
Jul 20 21:36:27.892655 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.892612    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34"} err="failed to get container status \"296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34\": rpc error: code = NotFound desc = could not find container \"296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34\": container with ID starting with 296d03b792cc998c958f02be72115eae162e8aa9d3fb40998f3df00efd8f6c34 not found: ID does not exist"
Jul 20 21:36:27.892655 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.892631    2573 scope.go:117] "RemoveContainer" containerID="99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9"
Jul 20 21:36:27.892878 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:36:27.892860    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9\": container with ID starting with 99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9 not found: ID does not exist" containerID="99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9"
Jul 20 21:36:27.892915 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.892884    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9"} err="failed to get container status \"99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9\": rpc error: code = NotFound desc = could not find container \"99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9\": container with ID starting with 99626d4930424026ac9a8e4295cbd70be1c4ba3f593e8bc1e62858967a8e75d9 not found: ID does not exist"
Jul 20 21:36:27.900459 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.900432    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"]
Jul 20 21:36:27.907531 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:27.907503    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5eb07c58-openshift-default-555cfdd86c-ztnwz"]
Jul 20 21:36:28.769594 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:36:28.769560    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" path="/var/lib/kubelet/pods/e584a08f-f40d-4a67-ad1b-cbd3c27460ac/volumes"
Jul 20 21:37:21.067735 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:37:21.067708    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:37:21.076199 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:37:21.076180    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:38:14.760035 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.759945    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"]
Jul 20 21:38:14.760664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760519    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e194d2b8-a70d-4b81-8d32-96afbd0ea976" containerName="maas-api"
Jul 20 21:38:14.760664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760540    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e194d2b8-a70d-4b81-8d32-96afbd0ea976" containerName="maas-api"
Jul 20 21:38:14.760664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760562    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy"
Jul 20 21:38:14.760664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760573    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy"
Jul 20 21:38:14.760664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760601    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy"
Jul 20 21:38:14.760664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760610    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy"
Jul 20 21:38:14.760664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760621    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy"
Jul 20 21:38:14.760664 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760630    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy"
Jul 20 21:38:14.761123 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760730    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy"
Jul 20 21:38:14.761123 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760742    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e584a08f-f40d-4a67-ad1b-cbd3c27460ac" containerName="istio-proxy"
Jul 20 21:38:14.761123 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760751    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e194d2b8-a70d-4b81-8d32-96afbd0ea976" containerName="maas-api"
Jul 20 21:38:14.761123 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760761    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy"
Jul 20 21:38:14.761123 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.760771    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy"
Jul 20 21:38:14.763726 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.763697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:14.770066 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.770043    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ff57b586-serving-cert\""
Jul 20 21:38:14.802414 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.802375    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2gmq\" (UniqueName: \"kubernetes.io/projected/8faf645f-19d0-4241-b648-7fd1a52df60b-kube-api-access-r2gmq\") pod \"maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:14.802553 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.802425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8faf645f-19d0-4241-b648-7fd1a52df60b-openshift-service-ca\") pod \"maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:14.802553 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.802520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8faf645f-19d0-4241-b648-7fd1a52df60b-maas-api-tls\") pod \"maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:14.883432 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.883384    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"]
Jul 20 21:38:14.903206 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.903177    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8faf645f-19d0-4241-b648-7fd1a52df60b-maas-api-tls\") pod \"maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:14.903358 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.903250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2gmq\" (UniqueName: \"kubernetes.io/projected/8faf645f-19d0-4241-b648-7fd1a52df60b-kube-api-access-r2gmq\") pod \"maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:14.903358 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.903281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8faf645f-19d0-4241-b648-7fd1a52df60b-openshift-service-ca\") pod \"maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:14.904018 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.903995    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8faf645f-19d0-4241-b648-7fd1a52df60b-openshift-service-ca\") pod \"maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:14.905696 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.905671    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8faf645f-19d0-4241-b648-7fd1a52df60b-maas-api-tls\") pod \"maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:14.922115 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:14.922065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2gmq\" (UniqueName: \"kubernetes.io/projected/8faf645f-19d0-4241-b648-7fd1a52df60b-kube-api-access-r2gmq\") pod \"maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:15.077709 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:15.077606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:15.280463 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:15.280421    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"]
Jul 20 21:38:15.284234 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:38:15.284204    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8faf645f_19d0_4241_b648_7fd1a52df60b.slice/crio-848479d72c461f6a63121ffee194d3271b1e9c6b9d44d5f993d9f12dc0832fe1 WatchSource:0}: Error finding container 848479d72c461f6a63121ffee194d3271b1e9c6b9d44d5f993d9f12dc0832fe1: Status 404 returned error can't find the container with id 848479d72c461f6a63121ffee194d3271b1e9c6b9d44d5f993d9f12dc0832fe1
Jul 20 21:38:15.462021 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:15.461924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz" event={"ID":"8faf645f-19d0-4241-b648-7fd1a52df60b","Type":"ContainerStarted","Data":"848479d72c461f6a63121ffee194d3271b1e9c6b9d44d5f993d9f12dc0832fe1"}
Jul 20 21:38:16.470590 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:16.470513    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz" event={"ID":"8faf645f-19d0-4241-b648-7fd1a52df60b","Type":"ContainerStarted","Data":"8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf"}
Jul 20 21:38:16.471068 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:16.470606    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:16.493160 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:16.493101    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz" podStartSLOduration=2.021227146 podStartE2EDuration="2.493063559s" totalImagesPullingTime="471.836413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:38:16.492194909 +0000 UTC m=+2156.244917645" watchObservedRunningTime="2026-07-20 21:38:16.493063559 +0000 UTC m=+2156.245786286"
Jul 20 21:38:22.481070 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:22.481037    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:26.596351 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.596312    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"]
Jul 20 21:38:26.596866 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.596848    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy"
Jul 20 21:38:26.596910 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.596869    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97e85d7-a7a3-4454-be03-033e6eeec307" containerName="istio-proxy"
Jul 20 21:38:26.600334 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.600316    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"
Jul 20 21:38:26.603099 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.603060    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qr6f9\""
Jul 20 21:38:26.606377 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.606354    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"]
Jul 20 21:38:26.702278 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.702245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5bd20e-d0c5-4ef4-a7bd-756822cccf54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2\" (UID: \"fd5bd20e-d0c5-4ef4-a7bd-756822cccf54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"
Jul 20 21:38:26.803348 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.803321    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5bd20e-d0c5-4ef4-a7bd-756822cccf54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2\" (UID: \"fd5bd20e-d0c5-4ef4-a7bd-756822cccf54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"
Jul 20 21:38:26.803947 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.803929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5bd20e-d0c5-4ef4-a7bd-756822cccf54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2\" (UID: \"fd5bd20e-d0c5-4ef4-a7bd-756822cccf54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"
Jul 20 21:38:26.911943 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:26.911870    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"
Jul 20 21:38:27.048318 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:27.048276    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"]
Jul 20 21:38:27.050501 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:38:27.050464    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5bd20e_d0c5_4ef4_a7bd_756822cccf54.slice/crio-faf88418bd1dec0138800286727d221480923bb1d6e0adb3a8c7f7b4e6a40ec2 WatchSource:0}: Error finding container faf88418bd1dec0138800286727d221480923bb1d6e0adb3a8c7f7b4e6a40ec2: Status 404 returned error can't find the container with id faf88418bd1dec0138800286727d221480923bb1d6e0adb3a8c7f7b4e6a40ec2
Jul 20 21:38:27.530537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:27.530497    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2" event={"ID":"fd5bd20e-d0c5-4ef4-a7bd-756822cccf54","Type":"ContainerStarted","Data":"faf88418bd1dec0138800286727d221480923bb1d6e0adb3a8c7f7b4e6a40ec2"}
Jul 20 21:38:30.547732 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:30.547696    2573 generic.go:356] "Generic (PLEG): container finished" podID="fd5bd20e-d0c5-4ef4-a7bd-756822cccf54" containerID="a598f890fba6c399cc97e1ca23c75390c974ccc5919df428210551db638efd92" exitCode=0
Jul 20 21:38:30.548143 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:30.547762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2" event={"ID":"fd5bd20e-d0c5-4ef4-a7bd-756822cccf54","Type":"ContainerDied","Data":"a598f890fba6c399cc97e1ca23c75390c974ccc5919df428210551db638efd92"}
Jul 20 21:38:31.685898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:31.685872    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"
Jul 20 21:38:31.748151 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:31.748127    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5bd20e-d0c5-4ef4-a7bd-756822cccf54-maas-api-service-ca\") pod \"fd5bd20e-d0c5-4ef4-a7bd-756822cccf54\" (UID: \"fd5bd20e-d0c5-4ef4-a7bd-756822cccf54\") "
Jul 20 21:38:31.748457 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:31.748437    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5bd20e-d0c5-4ef4-a7bd-756822cccf54-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd5bd20e-d0c5-4ef4-a7bd-756822cccf54" (UID: "fd5bd20e-d0c5-4ef4-a7bd-756822cccf54"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:38:31.849016 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:31.848931    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5bd20e-d0c5-4ef4-a7bd-756822cccf54-maas-api-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:38:32.559385 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:32.559356    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"
Jul 20 21:38:32.559540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:32.559402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2" event={"ID":"fd5bd20e-d0c5-4ef4-a7bd-756822cccf54","Type":"ContainerDied","Data":"faf88418bd1dec0138800286727d221480923bb1d6e0adb3a8c7f7b4e6a40ec2"}
Jul 20 21:38:32.559540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:32.559452    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="faf88418bd1dec0138800286727d221480923bb1d6e0adb3a8c7f7b4e6a40ec2"
Jul 20 21:38:37.203766 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.203727    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"]
Jul 20 21:38:37.204278 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.203980    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz" podUID="8faf645f-19d0-4241-b648-7fd1a52df60b" containerName="maas-api" containerID="cri-o://8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf" gracePeriod=30
Jul 20 21:38:37.451774 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.451748    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:37.586772 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.586739    2573 generic.go:356] "Generic (PLEG): container finished" podID="8faf645f-19d0-4241-b648-7fd1a52df60b" containerID="8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf" exitCode=0
Jul 20 21:38:37.586934 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.586782    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"
Jul 20 21:38:37.586934 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.586826    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz" event={"ID":"8faf645f-19d0-4241-b648-7fd1a52df60b","Type":"ContainerDied","Data":"8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf"}
Jul 20 21:38:37.586934 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.586877    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz" event={"ID":"8faf645f-19d0-4241-b648-7fd1a52df60b","Type":"ContainerDied","Data":"848479d72c461f6a63121ffee194d3271b1e9c6b9d44d5f993d9f12dc0832fe1"}
Jul 20 21:38:37.586934 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.586900    2573 scope.go:117] "RemoveContainer" containerID="8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf"
Jul 20 21:38:37.595822 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.595807    2573 scope.go:117] "RemoveContainer" containerID="8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf"
Jul 20 21:38:37.596094 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:38:37.596057    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf\": container with ID starting with 8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf not found: ID does not exist" containerID="8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf"
Jul 20 21:38:37.596165 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.596092    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf"} err="failed to get container status \"8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf\": rpc error: code = NotFound desc = could not find container \"8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf\": container with ID starting with 8d261ff38b9a6418e710cc6c8de66eb444653b3714605f81879e8e2368aa8edf not found: ID does not exist"
Jul 20 21:38:37.600374 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.600347    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8faf645f-19d0-4241-b648-7fd1a52df60b-maas-api-tls\") pod \"8faf645f-19d0-4241-b648-7fd1a52df60b\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") "
Jul 20 21:38:37.600543 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.600531    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8faf645f-19d0-4241-b648-7fd1a52df60b-openshift-service-ca\") pod \"8faf645f-19d0-4241-b648-7fd1a52df60b\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") "
Jul 20 21:38:37.600602 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.600591    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2gmq\" (UniqueName: \"kubernetes.io/projected/8faf645f-19d0-4241-b648-7fd1a52df60b-kube-api-access-r2gmq\") pod \"8faf645f-19d0-4241-b648-7fd1a52df60b\" (UID: \"8faf645f-19d0-4241-b648-7fd1a52df60b\") "
Jul 20 21:38:37.600808 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.600786    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8faf645f-19d0-4241-b648-7fd1a52df60b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8faf645f-19d0-4241-b648-7fd1a52df60b" (UID: "8faf645f-19d0-4241-b648-7fd1a52df60b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:38:37.602336 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.602315    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8faf645f-19d0-4241-b648-7fd1a52df60b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8faf645f-19d0-4241-b648-7fd1a52df60b" (UID: "8faf645f-19d0-4241-b648-7fd1a52df60b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:38:37.602506 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.602487    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8faf645f-19d0-4241-b648-7fd1a52df60b-kube-api-access-r2gmq" (OuterVolumeSpecName: "kube-api-access-r2gmq") pod "8faf645f-19d0-4241-b648-7fd1a52df60b" (UID: "8faf645f-19d0-4241-b648-7fd1a52df60b"). InnerVolumeSpecName "kube-api-access-r2gmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:38:37.702030 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.702007    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2gmq\" (UniqueName: \"kubernetes.io/projected/8faf645f-19d0-4241-b648-7fd1a52df60b-kube-api-access-r2gmq\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:38:37.702030 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.702029    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8faf645f-19d0-4241-b648-7fd1a52df60b-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:38:37.702179 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.702039    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8faf645f-19d0-4241-b648-7fd1a52df60b-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:38:37.910161 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.910129    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"]
Jul 20 21:38:37.916834 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:37.916806    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ff57b586-78f8cd59d8-dbrwz"]
Jul 20 21:38:38.769941 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:38.769910    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8faf645f-19d0-4241-b648-7fd1a52df60b" path="/var/lib/kubelet/pods/8faf645f-19d0-4241-b648-7fd1a52df60b/volumes"
Jul 20 21:38:41.678662 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:41.678627    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"]
Jul 20 21:38:41.681398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:41.681376    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ff57b586-2s5r2"]
Jul 20 21:38:42.769779 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:38:42.769745    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd5bd20e-d0c5-4ef4-a7bd-756822cccf54" path="/var/lib/kubelet/pods/fd5bd20e-d0c5-4ef4-a7bd-756822cccf54/volumes"
Jul 20 21:39:11.487000 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.486970    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"]
Jul 20 21:39:11.487495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.487350    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5bd20e-d0c5-4ef4-a7bd-756822cccf54" containerName="revoke-keys"
Jul 20 21:39:11.487495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.487364    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5bd20e-d0c5-4ef4-a7bd-756822cccf54" containerName="revoke-keys"
Jul 20 21:39:11.487495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.487379    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8faf645f-19d0-4241-b648-7fd1a52df60b" containerName="maas-api"
Jul 20 21:39:11.487495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.487385    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8faf645f-19d0-4241-b648-7fd1a52df60b" containerName="maas-api"
Jul 20 21:39:11.487495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.487452    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5bd20e-d0c5-4ef4-a7bd-756822cccf54" containerName="revoke-keys"
Jul 20 21:39:11.487495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.487459    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8faf645f-19d0-4241-b648-7fd1a52df60b" containerName="maas-api"
Jul 20 21:39:11.491304 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.491288    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:11.494061 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.494040    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bf0666db-serving-cert\""
Jul 20 21:39:11.504661 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.504640    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"]
Jul 20 21:39:11.571426 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.571391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bbf489d-6a8f-4f76-a342-729a89e2ce24-maas-api-tls\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:11.571581 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.571446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd568\" (UniqueName: \"kubernetes.io/projected/1bbf489d-6a8f-4f76-a342-729a89e2ce24-kube-api-access-pd568\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:11.571581 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.571516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bbf489d-6a8f-4f76-a342-729a89e2ce24-openshift-service-ca\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:11.672667 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.672632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bbf489d-6a8f-4f76-a342-729a89e2ce24-maas-api-tls\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:11.672835 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.672677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd568\" (UniqueName: \"kubernetes.io/projected/1bbf489d-6a8f-4f76-a342-729a89e2ce24-kube-api-access-pd568\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:11.672835 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.672730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bbf489d-6a8f-4f76-a342-729a89e2ce24-openshift-service-ca\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:11.672835 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:39:11.672798    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-serving-cert: secret "maas-api-e2e-mt-bf0666db-serving-cert" not found
Jul 20 21:39:11.672957 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:39:11.672901    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bbf489d-6a8f-4f76-a342-729a89e2ce24-maas-api-tls podName:1bbf489d-6a8f-4f76-a342-729a89e2ce24 nodeName:}" failed. No retries permitted until 2026-07-20 21:39:12.17287948 +0000 UTC m=+2211.925602181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1bbf489d-6a8f-4f76-a342-729a89e2ce24-maas-api-tls") pod "maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf" (UID: "1bbf489d-6a8f-4f76-a342-729a89e2ce24") : secret "maas-api-e2e-mt-bf0666db-serving-cert" not found
Jul 20 21:39:11.673372 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.673354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bbf489d-6a8f-4f76-a342-729a89e2ce24-openshift-service-ca\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:11.688604 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:11.688579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd568\" (UniqueName: \"kubernetes.io/projected/1bbf489d-6a8f-4f76-a342-729a89e2ce24-kube-api-access-pd568\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:12.177152 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:12.177120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bbf489d-6a8f-4f76-a342-729a89e2ce24-maas-api-tls\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:12.179723 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:12.179695    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bbf489d-6a8f-4f76-a342-729a89e2ce24-maas-api-tls\") pod \"maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:12.401032 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:12.400996    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:12.542130 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:12.542100    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"]
Jul 20 21:39:12.543867 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:39:12.543840    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbf489d_6a8f_4f76_a342_729a89e2ce24.slice/crio-08f2ac4747603f517802d2764936186d5f2759a2617f9e26e189f0766c46a652 WatchSource:0}: Error finding container 08f2ac4747603f517802d2764936186d5f2759a2617f9e26e189f0766c46a652: Status 404 returned error can't find the container with id 08f2ac4747603f517802d2764936186d5f2759a2617f9e26e189f0766c46a652
Jul 20 21:39:12.545615 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:12.545595    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 21:39:12.778396 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:12.778358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf" event={"ID":"1bbf489d-6a8f-4f76-a342-729a89e2ce24","Type":"ContainerStarted","Data":"08f2ac4747603f517802d2764936186d5f2759a2617f9e26e189f0766c46a652"}
Jul 20 21:39:13.785235 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:13.785202    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf" event={"ID":"1bbf489d-6a8f-4f76-a342-729a89e2ce24","Type":"ContainerStarted","Data":"622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804"}
Jul 20 21:39:13.785615 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:13.785306    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:39:13.804732 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:13.804684    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf" podStartSLOduration=2.14517764 podStartE2EDuration="2.804670761s" totalImagesPullingTime="659.493121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:39:13.802383964 +0000 UTC m=+2213.555106707" watchObservedRunningTime="2026-07-20 21:39:13.804670761 +0000 UTC m=+2213.557393483"
Jul 20 21:39:19.796504 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:39:19.796475    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:40:05.109432 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.109352    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"]
Jul 20 21:40:05.109991 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.109541    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf" podUID="1bbf489d-6a8f-4f76-a342-729a89e2ce24" containerName="maas-api" containerID="cri-o://622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804" gracePeriod=30
Jul 20 21:40:05.352724 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.352699    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:40:05.434571 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.434498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bbf489d-6a8f-4f76-a342-729a89e2ce24-openshift-service-ca\") pod \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") "
Jul 20 21:40:05.434571 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.434537    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd568\" (UniqueName: \"kubernetes.io/projected/1bbf489d-6a8f-4f76-a342-729a89e2ce24-kube-api-access-pd568\") pod \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") "
Jul 20 21:40:05.434746 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.434579    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bbf489d-6a8f-4f76-a342-729a89e2ce24-maas-api-tls\") pod \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\" (UID: \"1bbf489d-6a8f-4f76-a342-729a89e2ce24\") "
Jul 20 21:40:05.434902 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.434871    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bbf489d-6a8f-4f76-a342-729a89e2ce24-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1bbf489d-6a8f-4f76-a342-729a89e2ce24" (UID: "1bbf489d-6a8f-4f76-a342-729a89e2ce24"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:40:05.436671 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.436637    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bbf489d-6a8f-4f76-a342-729a89e2ce24-kube-api-access-pd568" (OuterVolumeSpecName: "kube-api-access-pd568") pod "1bbf489d-6a8f-4f76-a342-729a89e2ce24" (UID: "1bbf489d-6a8f-4f76-a342-729a89e2ce24"). InnerVolumeSpecName "kube-api-access-pd568". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:40:05.436753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.436685    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bbf489d-6a8f-4f76-a342-729a89e2ce24-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1bbf489d-6a8f-4f76-a342-729a89e2ce24" (UID: "1bbf489d-6a8f-4f76-a342-729a89e2ce24"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:40:05.535608 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.535575    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bbf489d-6a8f-4f76-a342-729a89e2ce24-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:40:05.535608 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.535609    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bbf489d-6a8f-4f76-a342-729a89e2ce24-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:40:05.535890 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:05.535625    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd568\" (UniqueName: \"kubernetes.io/projected/1bbf489d-6a8f-4f76-a342-729a89e2ce24-kube-api-access-pd568\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:40:06.061573 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.061540    2573 generic.go:356] "Generic (PLEG): container finished" podID="1bbf489d-6a8f-4f76-a342-729a89e2ce24" containerID="622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804" exitCode=0
Jul 20 21:40:06.061746 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.061586    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"
Jul 20 21:40:06.061746 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.061630    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf" event={"ID":"1bbf489d-6a8f-4f76-a342-729a89e2ce24","Type":"ContainerDied","Data":"622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804"}
Jul 20 21:40:06.061746 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.061682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf" event={"ID":"1bbf489d-6a8f-4f76-a342-729a89e2ce24","Type":"ContainerDied","Data":"08f2ac4747603f517802d2764936186d5f2759a2617f9e26e189f0766c46a652"}
Jul 20 21:40:06.061746 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.061703    2573 scope.go:117] "RemoveContainer" containerID="622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804"
Jul 20 21:40:06.071721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.071706    2573 scope.go:117] "RemoveContainer" containerID="622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804"
Jul 20 21:40:06.071986 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:40:06.071965    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804\": container with ID starting with 622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804 not found: ID does not exist" containerID="622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804"
Jul 20 21:40:06.072060 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.071995    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804"} err="failed to get container status \"622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804\": rpc error: code = NotFound desc = could not find container \"622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804\": container with ID starting with 622ee006adb7450a85cb4cf77a8549147d4f00cfd672ea6d09714a89dffee804 not found: ID does not exist"
Jul 20 21:40:06.084666 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.084642    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"]
Jul 20 21:40:06.086616 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.086597    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bf0666db-56df7d8d99-l85zf"]
Jul 20 21:40:06.769591 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:40:06.769557    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bbf489d-6a8f-4f76-a342-729a89e2ce24" path="/var/lib/kubelet/pods/1bbf489d-6a8f-4f76-a342-729a89e2ce24/volumes"
Jul 20 21:42:00.305083 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.305035    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"]
Jul 20 21:42:00.305668 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.305558    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bbf489d-6a8f-4f76-a342-729a89e2ce24" containerName="maas-api"
Jul 20 21:42:00.305668 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.305579    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bbf489d-6a8f-4f76-a342-729a89e2ce24" containerName="maas-api"
Jul 20 21:42:00.305791 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.305696    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bbf489d-6a8f-4f76-a342-729a89e2ce24" containerName="maas-api"
Jul 20 21:42:00.307810 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.307792    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.310524 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.310499    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-b7f42a-serving-cert\""
Jul 20 21:42:00.320407 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.320383    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"]
Jul 20 21:42:00.365301 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.365264    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.365471 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.365322    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-maas-api-tls\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.365471 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.365342    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2tfm\" (UniqueName: \"kubernetes.io/projected/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-kube-api-access-f2tfm\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.466184 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.466139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.466376 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.466200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-maas-api-tls\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.466376 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.466219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2tfm\" (UniqueName: \"kubernetes.io/projected/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-kube-api-access-f2tfm\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.466376 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:42:00.466296    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-serving-cert: secret "maas-api-e2e-inf-a-b7f42a-serving-cert" not found
Jul 20 21:42:00.466376 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:42:00.466363    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-maas-api-tls podName:8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d nodeName:}" failed. No retries permitted until 2026-07-20 21:42:00.966346922 +0000 UTC m=+2380.719069628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-maas-api-tls") pod "maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5" (UID: "8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d") : secret "maas-api-e2e-inf-a-b7f42a-serving-cert" not found
Jul 20 21:42:00.466817 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.466799    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.477272 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.477238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2tfm\" (UniqueName: \"kubernetes.io/projected/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-kube-api-access-f2tfm\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.970345 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.970310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-maas-api-tls\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:00.972761 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:00.972726    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-maas-api-tls\") pod \"maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:01.221066 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:01.220974    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:01.374752 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:01.374725    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"]
Jul 20 21:42:01.376397 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:42:01.376369    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb6ab45_9ac1_4d5b_85b0_7e45b0ec9c4d.slice/crio-eaef89fe19dc9a2ffd49e5f255ade6445bc503c388ff70f485bf10587698c2ff WatchSource:0}: Error finding container eaef89fe19dc9a2ffd49e5f255ade6445bc503c388ff70f485bf10587698c2ff: Status 404 returned error can't find the container with id eaef89fe19dc9a2ffd49e5f255ade6445bc503c388ff70f485bf10587698c2ff
Jul 20 21:42:01.676673 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:01.676632    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5" event={"ID":"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d","Type":"ContainerStarted","Data":"eaef89fe19dc9a2ffd49e5f255ade6445bc503c388ff70f485bf10587698c2ff"}
Jul 20 21:42:02.686945 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:02.686910    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5" event={"ID":"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d","Type":"ContainerStarted","Data":"664b1f39a61050d2ab7b3797747e27a604dbece5823d5f3b9d1d1d360730cb25"}
Jul 20 21:42:02.687401 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:02.687013    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:02.708116 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:02.708041    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5" podStartSLOduration=2.104170839 podStartE2EDuration="2.708019501s" totalImagesPullingTime="603.848662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:42:02.705825601 +0000 UTC m=+2382.458548326" watchObservedRunningTime="2026-07-20 21:42:02.708019501 +0000 UTC m=+2382.460742228"
Jul 20 21:42:05.499739 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.499703    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"]
Jul 20 21:42:05.503711 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.503688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.509511 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.509484    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2ad633-openshift-default-dockercfg-fss6n\""
Jul 20 21:42:05.538209 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.538176    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"]
Jul 20 21:42:05.601738 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.601701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-token\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.601738 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.601737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-envoy\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.601955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.601817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-certs\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.601955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.601882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkvj9\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-kube-api-access-mkvj9\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.601955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.601914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-podinfo\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.601955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.601934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/811c711a-fd0e-42f1-ac28-b42d7665624d-istiod-ca-cert\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.602109 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.602009    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-socket\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.602109 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.602031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-credential-socket\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.602109 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.602050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-data\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703246 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkvj9\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-kube-api-access-mkvj9\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-podinfo\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703283    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/811c711a-fd0e-42f1-ac28-b42d7665624d-istiod-ca-cert\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-socket\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703354    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-credential-socket\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-data\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703442 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-token\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703772 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-envoy\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703772 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-certs\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703882 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703756    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-credential-socket\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703882 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703807    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-socket\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703882 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703840    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-data\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.703882 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-certs\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.704118 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.703999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/811c711a-fd0e-42f1-ac28-b42d7665624d-istiod-ca-cert\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.705949 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.705924    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-envoy\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.706162 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.706139    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-podinfo\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.713672 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.713639    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-token\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.713831 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.713798    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkvj9\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-kube-api-access-mkvj9\") pod \"e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") " pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.814997 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.814909    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:05.957495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.957464    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"]
Jul 20 21:42:05.958531 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:42:05.958505    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811c711a_fd0e_42f1_ac28_b42d7665624d.slice/crio-86c55ee2629513635cee0e74752afbdc3465f9afa7a179f6ee7e36e5852acda1 WatchSource:0}: Error finding container 86c55ee2629513635cee0e74752afbdc3465f9afa7a179f6ee7e36e5852acda1: Status 404 returned error can't find the container with id 86c55ee2629513635cee0e74752afbdc3465f9afa7a179f6ee7e36e5852acda1
Jul 20 21:42:05.961267 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.961232    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:42:05.961349 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.961295    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:42:05.961349 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:05.961329    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:42:06.709572 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:06.709534    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" event={"ID":"811c711a-fd0e-42f1-ac28-b42d7665624d","Type":"ContainerStarted","Data":"438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686"}
Jul 20 21:42:06.710038 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:06.709586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" event={"ID":"811c711a-fd0e-42f1-ac28-b42d7665624d","Type":"ContainerStarted","Data":"86c55ee2629513635cee0e74752afbdc3465f9afa7a179f6ee7e36e5852acda1"}
Jul 20 21:42:06.754291 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:06.754229    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" podStartSLOduration=1.754208421 podStartE2EDuration="1.754208421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:42:06.753273887 +0000 UTC m=+2386.505996610" watchObservedRunningTime="2026-07-20 21:42:06.754208421 +0000 UTC m=+2386.506931147"
Jul 20 21:42:06.816035 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:06.816008    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:07.820458 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:07.820427    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:08.704545 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.704512    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:42:08.720706 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.720675    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:08.721967 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.721945    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:08.864364 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.864331    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"]
Jul 20 21:42:08.868125 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.868105    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:08.870975 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.870955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2ad633-serving-cert\""
Jul 20 21:42:08.890393 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.890368    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"]
Jul 20 21:42:08.930608 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.930577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7chmb\" (UniqueName: \"kubernetes.io/projected/d9078744-6518-4752-a854-8c9f2dda53e5-kube-api-access-7chmb\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:08.930753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.930629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9078744-6518-4752-a854-8c9f2dda53e5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:08.930753 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:08.930707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9078744-6518-4752-a854-8c9f2dda53e5-maas-api-tls\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:09.031557 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:09.031523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7chmb\" (UniqueName: \"kubernetes.io/projected/d9078744-6518-4752-a854-8c9f2dda53e5-kube-api-access-7chmb\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:09.031759 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:09.031586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9078744-6518-4752-a854-8c9f2dda53e5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:09.031842 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:09.031797    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9078744-6518-4752-a854-8c9f2dda53e5-maas-api-tls\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:09.031951 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:42:09.031930    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-serving-cert: secret "maas-api-e2e-inf-b-2ad633-serving-cert" not found
Jul 20 21:42:09.032016 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:42:09.032008    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9078744-6518-4752-a854-8c9f2dda53e5-maas-api-tls podName:d9078744-6518-4752-a854-8c9f2dda53e5 nodeName:}" failed. No retries permitted until 2026-07-20 21:42:09.531991342 +0000 UTC m=+2389.284714043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9078744-6518-4752-a854-8c9f2dda53e5-maas-api-tls") pod "maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz" (UID: "d9078744-6518-4752-a854-8c9f2dda53e5") : secret "maas-api-e2e-inf-b-2ad633-serving-cert" not found
Jul 20 21:42:09.032384 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:09.032365    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9078744-6518-4752-a854-8c9f2dda53e5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:09.045593 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:09.045566    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7chmb\" (UniqueName: \"kubernetes.io/projected/d9078744-6518-4752-a854-8c9f2dda53e5-kube-api-access-7chmb\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:09.537061 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:09.537023    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9078744-6518-4752-a854-8c9f2dda53e5-maas-api-tls\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:09.539459 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:09.539426    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9078744-6518-4752-a854-8c9f2dda53e5-maas-api-tls\") pod \"maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:09.778756 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:09.778721    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:09.923350 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:09.923320    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"]
Jul 20 21:42:09.925146 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:42:09.925059    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9078744_6518_4752_a854_8c9f2dda53e5.slice/crio-d0c320c29ddf3e94e57a9c69e2e5bfb64addf8bc2f60c199001d27def6491dc0 WatchSource:0}: Error finding container d0c320c29ddf3e94e57a9c69e2e5bfb64addf8bc2f60c199001d27def6491dc0: Status 404 returned error can't find the container with id d0c320c29ddf3e94e57a9c69e2e5bfb64addf8bc2f60c199001d27def6491dc0
Jul 20 21:42:10.734157 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:10.734116    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz" event={"ID":"d9078744-6518-4752-a854-8c9f2dda53e5","Type":"ContainerStarted","Data":"e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6"}
Jul 20 21:42:10.734369 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:10.734179    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz" event={"ID":"d9078744-6518-4752-a854-8c9f2dda53e5","Type":"ContainerStarted","Data":"d0c320c29ddf3e94e57a9c69e2e5bfb64addf8bc2f60c199001d27def6491dc0"}
Jul 20 21:42:10.753654 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:10.753592    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz" podStartSLOduration=2.41157353 podStartE2EDuration="2.753575349s" totalImagesPullingTime="342.001819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:42:10.751820588 +0000 UTC m=+2390.504543339" watchObservedRunningTime="2026-07-20 21:42:10.753575349 +0000 UTC m=+2390.506298072"
Jul 20 21:42:11.740146 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:11.740113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:17.753252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:17.753216    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:42:20.794970 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:20.794934    2573 generic.go:356] "Generic (PLEG): container finished" podID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerID="438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686" exitCode=0
Jul 20 21:42:20.795443 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:20.795007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" event={"ID":"811c711a-fd0e-42f1-ac28-b42d7665624d","Type":"ContainerDied","Data":"438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686"}
Jul 20 21:42:20.795443 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:20.795397    2573 scope.go:117] "RemoveContainer" containerID="438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686"
Jul 20 21:42:20.796376 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:20.796347    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:42:20.796474 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:20.796434    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:42:20.796544 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:20.796485    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:42:21.103438 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:21.103343    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:42:21.113575 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:21.113554    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:42:21.807173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:21.807111    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" event={"ID":"811c711a-fd0e-42f1-ac28-b42d7665624d","Type":"ContainerStarted","Data":"22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503"}
Jul 20 21:42:21.815135 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:21.815095    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:21.816365 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:21.816337    2573 patch_prober.go:28] interesting pod/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 20 21:42:21.816536 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:21.816399    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 20 21:42:22.815263 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:22.815226    2573 patch_prober.go:28] interesting pod/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 20 21:42:22.815652 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:22.815281    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 20 21:42:23.721356 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:23.721316    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:23.815779 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:23.815742    2573 patch_prober.go:28] interesting pod/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 20 21:42:23.816211 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:23.815805    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 20 21:42:24.815885 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:24.815847    2573 patch_prober.go:28] interesting pod/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 20 21:42:24.816317 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:24.815907    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 20 21:42:25.816217 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:25.816184    2573 patch_prober.go:28] interesting pod/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 20 21:42:25.816597 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:25.816238    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 20 21:42:26.819734 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:26.819704    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:42:26.820724 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:42:26.820706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:44:05.126905 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.126867    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"]
Jul 20 21:44:05.127823 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.127787    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5" podUID="8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d" containerName="maas-api" containerID="cri-o://664b1f39a61050d2ab7b3797747e27a604dbece5823d5f3b9d1d1d360730cb25" gracePeriod=30
Jul 20 21:44:05.367141 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.367104    2573 generic.go:356] "Generic (PLEG): container finished" podID="8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d" containerID="664b1f39a61050d2ab7b3797747e27a604dbece5823d5f3b9d1d1d360730cb25" exitCode=0
Jul 20 21:44:05.367141 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.367107    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5" event={"ID":"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d","Type":"ContainerDied","Data":"664b1f39a61050d2ab7b3797747e27a604dbece5823d5f3b9d1d1d360730cb25"}
Jul 20 21:44:05.367297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.367182    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5" event={"ID":"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d","Type":"ContainerDied","Data":"eaef89fe19dc9a2ffd49e5f255ade6445bc503c388ff70f485bf10587698c2ff"}
Jul 20 21:44:05.367297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.367206    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eaef89fe19dc9a2ffd49e5f255ade6445bc503c388ff70f485bf10587698c2ff"
Jul 20 21:44:05.375844 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.375823    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:44:05.455152 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.455049    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2tfm\" (UniqueName: \"kubernetes.io/projected/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-kube-api-access-f2tfm\") pod \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") "
Jul 20 21:44:05.455315 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.455173    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-maas-api-tls\") pod \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") "
Jul 20 21:44:05.455315 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.455196    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-openshift-service-ca\") pod \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\" (UID: \"8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d\") "
Jul 20 21:44:05.455597 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.455575    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d" (UID: "8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:44:05.457102 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.457064    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-kube-api-access-f2tfm" (OuterVolumeSpecName: "kube-api-access-f2tfm") pod "8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d" (UID: "8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d"). InnerVolumeSpecName "kube-api-access-f2tfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:44:05.457185 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.457068    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d" (UID: "8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:44:05.556344 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.556316    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:05.556344 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.556344    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:05.556533 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:05.556359    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2tfm\" (UniqueName: \"kubernetes.io/projected/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d-kube-api-access-f2tfm\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:06.372865 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:06.372835    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"
Jul 20 21:44:06.394765 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:06.394734    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"]
Jul 20 21:44:06.398918 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:06.398896    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b7f42a-8fd9b56d5-d25l5"]
Jul 20 21:44:06.770468 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:06.770437    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d" path="/var/lib/kubelet/pods/8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d/volumes"
Jul 20 21:44:27.633914 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:27.633830    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"]
Jul 20 21:44:27.634445 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:27.634030    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz" podUID="d9078744-6518-4752-a854-8c9f2dda53e5" containerName="maas-api" containerID="cri-o://e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6" gracePeriod=30
Jul 20 21:44:27.747837 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:27.747797    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz" podUID="d9078744-6518-4752-a854-8c9f2dda53e5" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.68:8443/health\": dial tcp 10.132.0.68:8443: connect: connection refused"
Jul 20 21:44:27.888031 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:27.887974    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:44:28.046540 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.046507    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9078744-6518-4752-a854-8c9f2dda53e5-maas-api-tls\") pod \"d9078744-6518-4752-a854-8c9f2dda53e5\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") "
Jul 20 21:44:28.046724 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.046572    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7chmb\" (UniqueName: \"kubernetes.io/projected/d9078744-6518-4752-a854-8c9f2dda53e5-kube-api-access-7chmb\") pod \"d9078744-6518-4752-a854-8c9f2dda53e5\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") "
Jul 20 21:44:28.046724 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.046611    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9078744-6518-4752-a854-8c9f2dda53e5-openshift-service-ca\") pod \"d9078744-6518-4752-a854-8c9f2dda53e5\" (UID: \"d9078744-6518-4752-a854-8c9f2dda53e5\") "
Jul 20 21:44:28.046992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.046967    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9078744-6518-4752-a854-8c9f2dda53e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9078744-6518-4752-a854-8c9f2dda53e5" (UID: "d9078744-6518-4752-a854-8c9f2dda53e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:44:28.048718 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.048693    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9078744-6518-4752-a854-8c9f2dda53e5-kube-api-access-7chmb" (OuterVolumeSpecName: "kube-api-access-7chmb") pod "d9078744-6518-4752-a854-8c9f2dda53e5" (UID: "d9078744-6518-4752-a854-8c9f2dda53e5"). InnerVolumeSpecName "kube-api-access-7chmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:44:28.048947 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.048931    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9078744-6518-4752-a854-8c9f2dda53e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9078744-6518-4752-a854-8c9f2dda53e5" (UID: "d9078744-6518-4752-a854-8c9f2dda53e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:44:28.147482 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.147414    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9078744-6518-4752-a854-8c9f2dda53e5-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:28.147482 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.147443    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9078744-6518-4752-a854-8c9f2dda53e5-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:28.147482 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.147454    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7chmb\" (UniqueName: \"kubernetes.io/projected/d9078744-6518-4752-a854-8c9f2dda53e5-kube-api-access-7chmb\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:28.495380 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.495351    2573 generic.go:356] "Generic (PLEG): container finished" podID="d9078744-6518-4752-a854-8c9f2dda53e5" containerID="e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6" exitCode=0
Jul 20 21:44:28.495541 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.495384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz" event={"ID":"d9078744-6518-4752-a854-8c9f2dda53e5","Type":"ContainerDied","Data":"e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6"}
Jul 20 21:44:28.495541 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.495406    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"
Jul 20 21:44:28.495541 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.495450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz" event={"ID":"d9078744-6518-4752-a854-8c9f2dda53e5","Type":"ContainerDied","Data":"d0c320c29ddf3e94e57a9c69e2e5bfb64addf8bc2f60c199001d27def6491dc0"}
Jul 20 21:44:28.495541 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.495485    2573 scope.go:117] "RemoveContainer" containerID="e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6"
Jul 20 21:44:28.506257 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.506241    2573 scope.go:117] "RemoveContainer" containerID="e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6"
Jul 20 21:44:28.506551 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:44:28.506526    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6\": container with ID starting with e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6 not found: ID does not exist" containerID="e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6"
Jul 20 21:44:28.506631 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.506562    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6"} err="failed to get container status \"e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6\": rpc error: code = NotFound desc = could not find container \"e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6\": container with ID starting with e941672a6128e106b08ca99099ee3c6399b91740ecef393f62f81935247963a6 not found: ID does not exist"
Jul 20 21:44:28.525125 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.525061    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"]
Jul 20 21:44:28.527293 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.527272    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2ad633-6df57bc5bc-kmwjz"]
Jul 20 21:44:28.530600 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:44:28.530576    2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9078744_6518_4752_a854_8c9f2dda53e5.slice/crio-d0c320c29ddf3e94e57a9c69e2e5bfb64addf8bc2f60c199001d27def6491dc0\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9078744_6518_4752_a854_8c9f2dda53e5.slice\": RecentStats: unable to find data in memory cache]"
Jul 20 21:44:28.769696 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:28.769616    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9078744-6518-4752-a854-8c9f2dda53e5" path="/var/lib/kubelet/pods/d9078744-6518-4752-a854-8c9f2dda53e5/volumes"
Jul 20 21:44:39.160998 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:39.160965    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"]
Jul 20 21:44:39.161615 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:39.161242    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy" containerID="cri-o://22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503" gracePeriod=30
Jul 20 21:44:40.176476 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.176435    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"]
Jul 20 21:44:40.177002 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.176980    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d" containerName="maas-api"
Jul 20 21:44:40.177110 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.177005    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d" containerName="maas-api"
Jul 20 21:44:40.177110 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.177037    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9078744-6518-4752-a854-8c9f2dda53e5" containerName="maas-api"
Jul 20 21:44:40.177110 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.177046    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9078744-6518-4752-a854-8c9f2dda53e5" containerName="maas-api"
Jul 20 21:44:40.177271 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.177150    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9078744-6518-4752-a854-8c9f2dda53e5" containerName="maas-api"
Jul 20 21:44:40.177271 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.177169    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb6ab45-9ac1-4d5b-85b0-7e45b0ec9c4d" containerName="maas-api"
Jul 20 21:44:40.181561 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.181539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.184337 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.184313    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d449d6-openshift-default-dockercfg-8j4w9\""
Jul 20 21:44:40.193850 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.193826    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"]
Jul 20 21:44:40.253897 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.253863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-credential-socket\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.253897 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.253899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6km7j\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-kube-api-access-6km7j\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.254126 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.253917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/640090be-1e85-4116-bfcc-8964b4ff8cfc-istiod-ca-cert\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.254126 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.253982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-envoy\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.254126 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.254037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-certs\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.254126 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.254053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-data\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.254126 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.254067    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-podinfo\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.254394 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.254215    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-socket\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.254394 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.254252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-token\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355304 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-envoy\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355503 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-certs\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355503 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-data\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355503 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355486    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-podinfo\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355687 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355561    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-socket\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355687 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-token\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355687 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355630    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-certs\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355689    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-credential-socket\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6km7j\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-kube-api-access-6km7j\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/640090be-1e85-4116-bfcc-8964b4ff8cfc-istiod-ca-cert\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.355840 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-data\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.356046 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.355978    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-socket\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.356112 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.356047    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-credential-socket\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.356426 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.356410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/640090be-1e85-4116-bfcc-8964b4ff8cfc-istiod-ca-cert\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.357739 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.357715    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-envoy\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.357928 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.357912    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-podinfo\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.364227 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.364207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-token\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.364737 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.364719    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6km7j\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-kube-api-access-6km7j\") pod \"e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") " pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.492310 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.492284    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:40.640722 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.640684    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"]
Jul 20 21:44:40.641956 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:44:40.641926    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640090be_1e85_4116_bfcc_8964b4ff8cfc.slice/crio-029027e2fe5ae12bece87c7b36d8149cf4958f5c0c0bf1220855bd34b30cc87f WatchSource:0}: Error finding container 029027e2fe5ae12bece87c7b36d8149cf4958f5c0c0bf1220855bd34b30cc87f: Status 404 returned error can't find the container with id 029027e2fe5ae12bece87c7b36d8149cf4958f5c0c0bf1220855bd34b30cc87f
Jul 20 21:44:40.644098 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.644035    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:44:40.644186 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.644125    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:44:40.644186 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:40.644156    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:44:41.570814 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:41.570776    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" event={"ID":"640090be-1e85-4116-bfcc-8964b4ff8cfc","Type":"ContainerStarted","Data":"8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210"}
Jul 20 21:44:41.571198 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:41.570835    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" event={"ID":"640090be-1e85-4116-bfcc-8964b4ff8cfc","Type":"ContainerStarted","Data":"029027e2fe5ae12bece87c7b36d8149cf4958f5c0c0bf1220855bd34b30cc87f"}
Jul 20 21:44:41.594623 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:41.594572    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" podStartSLOduration=1.5945571360000002 podStartE2EDuration="1.594557136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:44:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:44:41.592285164 +0000 UTC m=+2541.345007886" watchObservedRunningTime="2026-07-20 21:44:41.594557136 +0000 UTC m=+2541.347279860"
Jul 20 21:44:41.822495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:41.822419    2573 patch_prober.go:28] interesting pod/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 21:44:41.822495 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:41.822470    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 21:44:42.493395 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:42.493358    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:42.498394 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:42.498368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:42.576140 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:42.576108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:42.576962 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:42.576941    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:44:44.410922 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.410899    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:44:44.489314 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489284    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-podinfo\") pod \"811c711a-fd0e-42f1-ac28-b42d7665624d\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") "
Jul 20 21:44:44.489491 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489327    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkvj9\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-kube-api-access-mkvj9\") pod \"811c711a-fd0e-42f1-ac28-b42d7665624d\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") "
Jul 20 21:44:44.489491 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489354    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-credential-socket\") pod \"811c711a-fd0e-42f1-ac28-b42d7665624d\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") "
Jul 20 21:44:44.489491 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-token\") pod \"811c711a-fd0e-42f1-ac28-b42d7665624d\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") "
Jul 20 21:44:44.489491 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489451    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/811c711a-fd0e-42f1-ac28-b42d7665624d-istiod-ca-cert\") pod \"811c711a-fd0e-42f1-ac28-b42d7665624d\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") "
Jul 20 21:44:44.489721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489496    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-envoy\") pod \"811c711a-fd0e-42f1-ac28-b42d7665624d\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") "
Jul 20 21:44:44.489721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489531    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-data\") pod \"811c711a-fd0e-42f1-ac28-b42d7665624d\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") "
Jul 20 21:44:44.489721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489562    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-socket\") pod \"811c711a-fd0e-42f1-ac28-b42d7665624d\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") "
Jul 20 21:44:44.489721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489610    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-certs\") pod \"811c711a-fd0e-42f1-ac28-b42d7665624d\" (UID: \"811c711a-fd0e-42f1-ac28-b42d7665624d\") "
Jul 20 21:44:44.489721 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489669    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "811c711a-fd0e-42f1-ac28-b42d7665624d" (UID: "811c711a-fd0e-42f1-ac28-b42d7665624d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:44:44.489980 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489875    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "811c711a-fd0e-42f1-ac28-b42d7665624d" (UID: "811c711a-fd0e-42f1-ac28-b42d7665624d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:44:44.489980 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489903    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:44.489980 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489933    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/811c711a-fd0e-42f1-ac28-b42d7665624d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "811c711a-fd0e-42f1-ac28-b42d7665624d" (UID: "811c711a-fd0e-42f1-ac28-b42d7665624d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:44:44.489980 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.489954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "811c711a-fd0e-42f1-ac28-b42d7665624d" (UID: "811c711a-fd0e-42f1-ac28-b42d7665624d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:44:44.490519 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.490497    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-data" (OuterVolumeSpecName: "istio-data") pod "811c711a-fd0e-42f1-ac28-b42d7665624d" (UID: "811c711a-fd0e-42f1-ac28-b42d7665624d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:44:44.491554 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.491528    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "811c711a-fd0e-42f1-ac28-b42d7665624d" (UID: "811c711a-fd0e-42f1-ac28-b42d7665624d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 21:44:44.491734 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.491716    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-kube-api-access-mkvj9" (OuterVolumeSpecName: "kube-api-access-mkvj9") pod "811c711a-fd0e-42f1-ac28-b42d7665624d" (UID: "811c711a-fd0e-42f1-ac28-b42d7665624d"). InnerVolumeSpecName "kube-api-access-mkvj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:44:44.491960 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.491939    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "811c711a-fd0e-42f1-ac28-b42d7665624d" (UID: "811c711a-fd0e-42f1-ac28-b42d7665624d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:44:44.492010 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.491945    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-token" (OuterVolumeSpecName: "istio-token") pod "811c711a-fd0e-42f1-ac28-b42d7665624d" (UID: "811c711a-fd0e-42f1-ac28-b42d7665624d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:44:44.589550 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.589520    2573 generic.go:356] "Generic (PLEG): container finished" podID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerID="22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503" exitCode=0
Jul 20 21:44:44.589727 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.589568    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"
Jul 20 21:44:44.589727 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.589606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" event={"ID":"811c711a-fd0e-42f1-ac28-b42d7665624d","Type":"ContainerDied","Data":"22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503"}
Jul 20 21:44:44.589727 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.589671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4" event={"ID":"811c711a-fd0e-42f1-ac28-b42d7665624d","Type":"ContainerDied","Data":"86c55ee2629513635cee0e74752afbdc3465f9afa7a179f6ee7e36e5852acda1"}
Jul 20 21:44:44.589727 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.589704    2573 scope.go:117] "RemoveContainer" containerID="22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503"
Jul 20 21:44:44.590446 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.590426    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/811c711a-fd0e-42f1-ac28-b42d7665624d-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:44.590446 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.590445    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:44.590592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.590454    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:44.590592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.590464    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:44.590592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.590479    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/811c711a-fd0e-42f1-ac28-b42d7665624d-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:44.590592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.590491    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:44.590592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.590499    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkvj9\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-kube-api-access-mkvj9\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:44.590592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.590508    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/811c711a-fd0e-42f1-ac28-b42d7665624d-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:44:44.599557 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.599542    2573 scope.go:117] "RemoveContainer" containerID="438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686"
Jul 20 21:44:44.607603 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.607585    2573 scope.go:117] "RemoveContainer" containerID="22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503"
Jul 20 21:44:44.607849 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:44:44.607830    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503\": container with ID starting with 22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503 not found: ID does not exist" containerID="22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503"
Jul 20 21:44:44.607906 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.607855    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503"} err="failed to get container status \"22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503\": rpc error: code = NotFound desc = could not find container \"22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503\": container with ID starting with 22908c9adf862f6cf7692f075d8985a1cae97ab4e2bf2c8daacde3534915b503 not found: ID does not exist"
Jul 20 21:44:44.607906 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.607880    2573 scope.go:117] "RemoveContainer" containerID="438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686"
Jul 20 21:44:44.608127 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:44:44.608108    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686\": container with ID starting with 438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686 not found: ID does not exist" containerID="438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686"
Jul 20 21:44:44.608191 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.608138    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686"} err="failed to get container status \"438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686\": rpc error: code = NotFound desc = could not find container \"438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686\": container with ID starting with 438182a367b873fe0eee57a700991b71f37e168f86640395e2a1572fbb8ab686 not found: ID does not exist"
Jul 20 21:44:44.629841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.629818    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"]
Jul 20 21:44:44.643718 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.643693    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2ad633-openshift-default-85ffc89fb9-qlml4"]
Jul 20 21:44:44.769750 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:44.769680    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" path="/var/lib/kubelet/pods/811c711a-fd0e-42f1-ac28-b42d7665624d/volumes"
Jul 20 21:44:52.195097 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.195043    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"]
Jul 20 21:44:52.195572 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.195466    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy"
Jul 20 21:44:52.195572 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.195480    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy"
Jul 20 21:44:52.195572 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.195493    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy"
Jul 20 21:44:52.195572 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.195500    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy"
Jul 20 21:44:52.195572 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.195563    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy"
Jul 20 21:44:52.195572 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.195570    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="811c711a-fd0e-42f1-ac28-b42d7665624d" containerName="istio-proxy"
Jul 20 21:44:52.200106 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.200068    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.202805 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.202779    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-08ebd1-serving-cert\""
Jul 20 21:44:52.212961 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.212935    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"]
Jul 20 21:44:52.262684 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.262643    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43a12c7c-beed-437b-b123-e86eee4301a1-maas-api-tls\") pod \"maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.262684 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.262677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a12c7c-beed-437b-b123-e86eee4301a1-openshift-service-ca\") pod \"maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.262899 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.262705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bwn\" (UniqueName: \"kubernetes.io/projected/43a12c7c-beed-437b-b123-e86eee4301a1-kube-api-access-86bwn\") pod \"maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.364142 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.364104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43a12c7c-beed-437b-b123-e86eee4301a1-maas-api-tls\") pod \"maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.364309 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.364156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a12c7c-beed-437b-b123-e86eee4301a1-openshift-service-ca\") pod \"maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.364309 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.364202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bwn\" (UniqueName: \"kubernetes.io/projected/43a12c7c-beed-437b-b123-e86eee4301a1-kube-api-access-86bwn\") pod \"maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.365049 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.365018    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a12c7c-beed-437b-b123-e86eee4301a1-openshift-service-ca\") pod \"maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.366897 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.366873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43a12c7c-beed-437b-b123-e86eee4301a1-maas-api-tls\") pod \"maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.374598 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.374576    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bwn\" (UniqueName: \"kubernetes.io/projected/43a12c7c-beed-437b-b123-e86eee4301a1-kube-api-access-86bwn\") pod \"maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.513996 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.513964    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:52.703727 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.703694    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"]
Jul 20 21:44:52.705245 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:44:52.705211    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a12c7c_beed_437b_b123_e86eee4301a1.slice/crio-93af275cccf3543e52646885069171b34aeb250f3ae08c04840cb4b6825b6789 WatchSource:0}: Error finding container 93af275cccf3543e52646885069171b34aeb250f3ae08c04840cb4b6825b6789: Status 404 returned error can't find the container with id 93af275cccf3543e52646885069171b34aeb250f3ae08c04840cb4b6825b6789
Jul 20 21:44:52.706471 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:52.706453    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 21:44:53.673119 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:53.673062    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6" event={"ID":"43a12c7c-beed-437b-b123-e86eee4301a1","Type":"ContainerStarted","Data":"f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258"}
Jul 20 21:44:53.673552 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:53.673145    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6" event={"ID":"43a12c7c-beed-437b-b123-e86eee4301a1","Type":"ContainerStarted","Data":"93af275cccf3543e52646885069171b34aeb250f3ae08c04840cb4b6825b6789"}
Jul 20 21:44:53.673552 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:53.673177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:53.695511 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:53.695465    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6" podStartSLOduration=1.376619565 podStartE2EDuration="1.695449553s" totalImagesPullingTime="318.829988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:44:53.694249686 +0000 UTC m=+2553.446972419" watchObservedRunningTime="2026-07-20 21:44:53.695449553 +0000 UTC m=+2553.448172277"
Jul 20 21:44:58.617201 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:58.617165    2573 patch_prober.go:28] interesting pod/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 21:44:58.617659 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:58.617230    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 21:44:59.685190 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:59.685160    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:44:59.712124 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:59.712086    2573 generic.go:356] "Generic (PLEG): container finished" podID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerID="8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210" exitCode=0
Jul 20 21:44:59.712274 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:59.712145    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" event={"ID":"640090be-1e85-4116-bfcc-8964b4ff8cfc","Type":"ContainerDied","Data":"8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210"}
Jul 20 21:44:59.712586 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:59.712557    2573 scope.go:117] "RemoveContainer" containerID="8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210"
Jul 20 21:44:59.713704 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:59.713673    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:44:59.713802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:59.713740    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:44:59.713802 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:44:59.713773    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:45:00.719626 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:00.719592    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" event={"ID":"640090be-1e85-4116-bfcc-8964b4ff8cfc","Type":"ContainerStarted","Data":"099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8"}
Jul 20 21:45:01.493162 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:01.493125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:45:01.493357 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:01.493333    2573 patch_prober.go:28] interesting pod/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 20 21:45:01.493416 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:01.493400    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 20 21:45:02.492835 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:02.492800    2573 patch_prober.go:28] interesting pod/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 20 21:45:02.493247 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:02.492864    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 20 21:45:03.493465 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:03.493428    2573 patch_prober.go:28] interesting pod/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 20 21:45:03.493848 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:03.493486    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 20 21:45:04.501446 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:04.501413    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:45:04.501854 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:04.501698    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:45:04.502342 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:04.502327    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:45:21.028423 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:21.028393    2573 scope.go:117] "RemoveContainer" containerID="a598f890fba6c399cc97e1ca23c75390c974ccc5919df428210551db638efd92"
Jul 20 21:45:31.400506 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:31.400474    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"]
Jul 20 21:45:31.401067 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:31.400739    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy" containerID="cri-o://099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8" gracePeriod=30
Jul 20 21:45:34.503822 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:34.503778    2573 patch_prober.go:28] interesting pod/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 20 21:45:34.504214 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:34.503845    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 21:45:36.656308 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.656280    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:45:36.660159 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660136    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6km7j\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-kube-api-access-6km7j\") pod \"640090be-1e85-4116-bfcc-8964b4ff8cfc\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") "
Jul 20 21:45:36.660247 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660186    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-envoy\") pod \"640090be-1e85-4116-bfcc-8964b4ff8cfc\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") "
Jul 20 21:45:36.660247 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660220    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/640090be-1e85-4116-bfcc-8964b4ff8cfc-istiod-ca-cert\") pod \"640090be-1e85-4116-bfcc-8964b4ff8cfc\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") "
Jul 20 21:45:36.660327 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660295    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-podinfo\") pod \"640090be-1e85-4116-bfcc-8964b4ff8cfc\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") "
Jul 20 21:45:36.660375 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660334    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-data\") pod \"640090be-1e85-4116-bfcc-8964b4ff8cfc\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") "
Jul 20 21:45:36.660428 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-certs\") pod \"640090be-1e85-4116-bfcc-8964b4ff8cfc\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") "
Jul 20 21:45:36.660497 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660425    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-credential-socket\") pod \"640090be-1e85-4116-bfcc-8964b4ff8cfc\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") "
Jul 20 21:45:36.660497 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660450    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-token\") pod \"640090be-1e85-4116-bfcc-8964b4ff8cfc\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") "
Jul 20 21:45:36.660612 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660523    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-socket\") pod \"640090be-1e85-4116-bfcc-8964b4ff8cfc\" (UID: \"640090be-1e85-4116-bfcc-8964b4ff8cfc\") "
Jul 20 21:45:36.660669 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660640    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "640090be-1e85-4116-bfcc-8964b4ff8cfc" (UID: "640090be-1e85-4116-bfcc-8964b4ff8cfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:45:36.660669 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660651    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/640090be-1e85-4116-bfcc-8964b4ff8cfc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "640090be-1e85-4116-bfcc-8964b4ff8cfc" (UID: "640090be-1e85-4116-bfcc-8964b4ff8cfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:45:36.660799 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660771    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "640090be-1e85-4116-bfcc-8964b4ff8cfc" (UID: "640090be-1e85-4116-bfcc-8964b4ff8cfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:45:36.660921 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660898    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/640090be-1e85-4116-bfcc-8964b4ff8cfc-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:36.661035 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660924    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:36.661035 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660928    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "640090be-1e85-4116-bfcc-8964b4ff8cfc" (UID: "640090be-1e85-4116-bfcc-8964b4ff8cfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:45:36.661035 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.660939    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:36.661448 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.661421    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-data" (OuterVolumeSpecName: "istio-data") pod "640090be-1e85-4116-bfcc-8964b4ff8cfc" (UID: "640090be-1e85-4116-bfcc-8964b4ff8cfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:45:36.662455 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.662433    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-kube-api-access-6km7j" (OuterVolumeSpecName: "kube-api-access-6km7j") pod "640090be-1e85-4116-bfcc-8964b4ff8cfc" (UID: "640090be-1e85-4116-bfcc-8964b4ff8cfc"). InnerVolumeSpecName "kube-api-access-6km7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:45:36.662548 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.662491    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "640090be-1e85-4116-bfcc-8964b4ff8cfc" (UID: "640090be-1e85-4116-bfcc-8964b4ff8cfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 21:45:36.662876 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.662859    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "640090be-1e85-4116-bfcc-8964b4ff8cfc" (UID: "640090be-1e85-4116-bfcc-8964b4ff8cfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:45:36.662926 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.662885    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-token" (OuterVolumeSpecName: "istio-token") pod "640090be-1e85-4116-bfcc-8964b4ff8cfc" (UID: "640090be-1e85-4116-bfcc-8964b4ff8cfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:45:36.761357 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.761325    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:36.761357 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.761351    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6km7j\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-kube-api-access-6km7j\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:36.761357 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.761363    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:36.761625 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.761371    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:36.761625 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.761379    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:36.761625 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.761387    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/640090be-1e85-4116-bfcc-8964b4ff8cfc-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:36.918626 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.918544    2573 generic.go:356] "Generic (PLEG): container finished" podID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerID="099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8" exitCode=0
Jul 20 21:45:36.918626 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.918588    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"
Jul 20 21:45:36.918626 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.918609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" event={"ID":"640090be-1e85-4116-bfcc-8964b4ff8cfc","Type":"ContainerDied","Data":"099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8"}
Jul 20 21:45:36.918850 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.918651    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7" event={"ID":"640090be-1e85-4116-bfcc-8964b4ff8cfc","Type":"ContainerDied","Data":"029027e2fe5ae12bece87c7b36d8149cf4958f5c0c0bf1220855bd34b30cc87f"}
Jul 20 21:45:36.918850 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.918674    2573 scope.go:117] "RemoveContainer" containerID="099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8"
Jul 20 21:45:36.929662 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.929647    2573 scope.go:117] "RemoveContainer" containerID="8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210"
Jul 20 21:45:36.941290 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.941269    2573 scope.go:117] "RemoveContainer" containerID="099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8"
Jul 20 21:45:36.941600 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:45:36.941576    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8\": container with ID starting with 099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8 not found: ID does not exist" containerID="099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8"
Jul 20 21:45:36.941709 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.941607    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8"} err="failed to get container status \"099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8\": rpc error: code = NotFound desc = could not find container \"099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8\": container with ID starting with 099ed28988a61bc04247e90bf83cb3db28e2543241a349b9edead5a4db9b6ca8 not found: ID does not exist"
Jul 20 21:45:36.941709 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.941624    2573 scope.go:117] "RemoveContainer" containerID="8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210"
Jul 20 21:45:36.941892 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:45:36.941872    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210\": container with ID starting with 8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210 not found: ID does not exist" containerID="8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210"
Jul 20 21:45:36.941963 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.941897    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210"} err="failed to get container status \"8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210\": rpc error: code = NotFound desc = could not find container \"8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210\": container with ID starting with 8ed8d93e1a65603fe9592e07e90c01324c48a2921832e44c4e65dc0c4a355210 not found: ID does not exist"
Jul 20 21:45:36.942516 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.942500    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"]
Jul 20 21:45:36.944494 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:36.944474    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d449d6-openshift-default-577c9f789c-mksv7"]
Jul 20 21:45:38.769761 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:38.769730    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" path="/var/lib/kubelet/pods/640090be-1e85-4116-bfcc-8964b4ff8cfc/volumes"
Jul 20 21:45:47.304039 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.303960    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"]
Jul 20 21:45:47.304474 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.304226    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6" podUID="43a12c7c-beed-437b-b123-e86eee4301a1" containerName="maas-api" containerID="cri-o://f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258" gracePeriod=30
Jul 20 21:45:47.551344 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.551320    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:45:47.654458 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.654388    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a12c7c-beed-437b-b123-e86eee4301a1-openshift-service-ca\") pod \"43a12c7c-beed-437b-b123-e86eee4301a1\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") "
Jul 20 21:45:47.654458 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.654442    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86bwn\" (UniqueName: \"kubernetes.io/projected/43a12c7c-beed-437b-b123-e86eee4301a1-kube-api-access-86bwn\") pod \"43a12c7c-beed-437b-b123-e86eee4301a1\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") "
Jul 20 21:45:47.654660 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.654462    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43a12c7c-beed-437b-b123-e86eee4301a1-maas-api-tls\") pod \"43a12c7c-beed-437b-b123-e86eee4301a1\" (UID: \"43a12c7c-beed-437b-b123-e86eee4301a1\") "
Jul 20 21:45:47.654770 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.654743    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43a12c7c-beed-437b-b123-e86eee4301a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "43a12c7c-beed-437b-b123-e86eee4301a1" (UID: "43a12c7c-beed-437b-b123-e86eee4301a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:45:47.656482 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.656456    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43a12c7c-beed-437b-b123-e86eee4301a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "43a12c7c-beed-437b-b123-e86eee4301a1" (UID: "43a12c7c-beed-437b-b123-e86eee4301a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 21:45:47.656596 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.656562    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a12c7c-beed-437b-b123-e86eee4301a1-kube-api-access-86bwn" (OuterVolumeSpecName: "kube-api-access-86bwn") pod "43a12c7c-beed-437b-b123-e86eee4301a1" (UID: "43a12c7c-beed-437b-b123-e86eee4301a1"). InnerVolumeSpecName "kube-api-access-86bwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:45:47.755621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.755590    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86bwn\" (UniqueName: \"kubernetes.io/projected/43a12c7c-beed-437b-b123-e86eee4301a1-kube-api-access-86bwn\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:47.755621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.755617    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43a12c7c-beed-437b-b123-e86eee4301a1-maas-api-tls\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:47.755621 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.755627    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a12c7c-beed-437b-b123-e86eee4301a1-openshift-service-ca\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:45:47.984095 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.984047    2573 generic.go:356] "Generic (PLEG): container finished" podID="43a12c7c-beed-437b-b123-e86eee4301a1" containerID="f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258" exitCode=0
Jul 20 21:45:47.984252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.984105    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"
Jul 20 21:45:47.984252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.984132    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6" event={"ID":"43a12c7c-beed-437b-b123-e86eee4301a1","Type":"ContainerDied","Data":"f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258"}
Jul 20 21:45:47.984252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.984194    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6" event={"ID":"43a12c7c-beed-437b-b123-e86eee4301a1","Type":"ContainerDied","Data":"93af275cccf3543e52646885069171b34aeb250f3ae08c04840cb4b6825b6789"}
Jul 20 21:45:47.984252 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.984223    2573 scope.go:117] "RemoveContainer" containerID="f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258"
Jul 20 21:45:47.993652 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.993635    2573 scope.go:117] "RemoveContainer" containerID="f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258"
Jul 20 21:45:47.993899 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:45:47.993879    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258\": container with ID starting with f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258 not found: ID does not exist" containerID="f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258"
Jul 20 21:45:47.993985 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:47.993915    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258"} err="failed to get container status \"f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258\": rpc error: code = NotFound desc = could not find container \"f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258\": container with ID starting with f24c2e922aacb68e3c71acbe2c30d828d55ef9791710cc6bdc046a5a09989258 not found: ID does not exist"
Jul 20 21:45:48.006617 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:48.006595    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"]
Jul 20 21:45:48.010205 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:48.010185    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-08ebd1-75686f5747-qdcq6"]
Jul 20 21:45:48.770700 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:48.770655    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43a12c7c-beed-437b-b123-e86eee4301a1" path="/var/lib/kubelet/pods/43a12c7c-beed-437b-b123-e86eee4301a1/volumes"
Jul 20 21:45:59.559402 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.559368    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"]
Jul 20 21:45:59.559898 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.559881    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy"
Jul 20 21:45:59.559949 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.559901    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy"
Jul 20 21:45:59.559949 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.559916    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy"
Jul 20 21:45:59.559949 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.559925    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy"
Jul 20 21:45:59.560042 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.559953    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a12c7c-beed-437b-b123-e86eee4301a1" containerName="maas-api"
Jul 20 21:45:59.560042 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.559962    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a12c7c-beed-437b-b123-e86eee4301a1" containerName="maas-api"
Jul 20 21:45:59.560127 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.560050    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a12c7c-beed-437b-b123-e86eee4301a1" containerName="maas-api"
Jul 20 21:45:59.560127 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.560061    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy"
Jul 20 21:45:59.563224 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.563204    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.566054 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.566029    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-196c99-openshift-default-dockercfg-fl92j\""
Jul 20 21:45:59.576277 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.576255    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"]
Jul 20 21:45:59.653405 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.653379    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-token\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.653549 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.653415    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-podinfo\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.653549 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.653485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-data\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.653549 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.653532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-certs\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.653549 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.653547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istiod-ca-cert\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.653717 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.653567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmt4n\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-kube-api-access-bmt4n\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.653717 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.653596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-socket\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.653717 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.653621    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-credential-socket\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.653717 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.653694    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-envoy\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.754584 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.754553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-envoy\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.754728 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.754590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-token\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.754728 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.754611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-podinfo\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.754728 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.754640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-data\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.754728 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.754671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-certs\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.754728 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.754688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istiod-ca-cert\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.754728 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.754707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt4n\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-kube-api-access-bmt4n\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.755023 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.754734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-socket\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.755023 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.754757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-credential-socket\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.755173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.755065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-certs\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.755173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.755131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-socket\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.755282 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.755173    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-credential-socket\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.755282 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.755260    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-data\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.755464 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.755441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istiod-ca-cert\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.756814 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.756795    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-envoy\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.757293 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.757274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-podinfo\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.770142 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.770123    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-token\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.775796 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.775772    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmt4n\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-kube-api-access-bmt4n\") pod \"e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") " pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:45:59.872859 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:45:59.872777    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:00.013695 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:00.013669    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"]
Jul 20 21:46:00.015622 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:46:00.015595    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd54e16f_e2f0_4b02_8a1f_b5559eca81b2.slice/crio-189f71f6d58b180fdc2f5143a7e568301a09e6602e1c2f1af234c930b0078fbb WatchSource:0}: Error finding container 189f71f6d58b180fdc2f5143a7e568301a09e6602e1c2f1af234c930b0078fbb: Status 404 returned error can't find the container with id 189f71f6d58b180fdc2f5143a7e568301a09e6602e1c2f1af234c930b0078fbb
Jul 20 21:46:00.017713 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:00.017680    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:00.017799 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:00.017746    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:00.017799 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:00.017776    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:00.048537 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:00.048507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" event={"ID":"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2","Type":"ContainerStarted","Data":"189f71f6d58b180fdc2f5143a7e568301a09e6602e1c2f1af234c930b0078fbb"}
Jul 20 21:46:01.057791 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:01.057753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" event={"ID":"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2","Type":"ContainerStarted","Data":"76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5"}
Jul 20 21:46:01.081504 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:01.081458    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" podStartSLOduration=2.081444111 podStartE2EDuration="2.081444111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:46:01.079362492 +0000 UTC m=+2620.832085215" watchObservedRunningTime="2026-07-20 21:46:01.081444111 +0000 UTC m=+2620.834166907"
Jul 20 21:46:01.873820 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:01.873791    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:01.878653 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:01.878630    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:02.064918 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:02.064890    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:02.065806 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:02.065789    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:08.491534 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.491496    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"]
Jul 20 21:46:08.492026 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.491911    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="640090be-1e85-4116-bfcc-8964b4ff8cfc" containerName="istio-proxy"
Jul 20 21:46:08.495166 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.495143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.497888 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.497870    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-046c73-openshift-default-dockercfg-fvjg2\""
Jul 20 21:46:08.508994 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.508967    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"]
Jul 20 21:46:08.632567 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.632517    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-istio-token\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.632762 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.632579    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-credential-socket\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.632762 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.632601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4523813a-f245-4cce-a162-7fd00edd06ee-istiod-ca-cert\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.632762 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.632641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-socket\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.632925 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.632762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-envoy\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.632925 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.632786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-data\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.632925 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.632802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4523813a-f245-4cce-a162-7fd00edd06ee-istio-podinfo\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.632925 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.632846    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-certs\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.632925 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.632863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmwhz\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-kube-api-access-zmwhz\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.733983 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.733947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-certs\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.734342 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.734317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmwhz\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-kube-api-access-zmwhz\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.734473 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.734443    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-certs\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.734945 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.734492    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-istio-token\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.735144 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.735126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-credential-socket\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.735592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.735573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4523813a-f245-4cce-a162-7fd00edd06ee-istiod-ca-cert\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.735783 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.735766    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-socket\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.736327 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.736306    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-envoy\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.736900 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.736879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-data\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.737040 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.737025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4523813a-f245-4cce-a162-7fd00edd06ee-istio-podinfo\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.737222 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.735517    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-credential-socket\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.737463 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.736198    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-socket\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.737572 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.737255    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-data\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.737688 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.736312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4523813a-f245-4cce-a162-7fd00edd06ee-istiod-ca-cert\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.742131 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.738912    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-envoy\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.742589 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.742544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4523813a-f245-4cce-a162-7fd00edd06ee-istio-podinfo\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.747093 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.746931    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmwhz\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-kube-api-access-zmwhz\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.747738 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.747711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-istio-token\") pod \"e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") " pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:08.805968 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:08.805931    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:09.004394 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:09.004369    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"]
Jul 20 21:46:09.005836 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:46:09.005810    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4523813a_f245_4cce_a162_7fd00edd06ee.slice/crio-d36eaa22dfb1e35c3fe622f37b8d3caba5c57153f09590be1beaa25abc43e56e WatchSource:0}: Error finding container d36eaa22dfb1e35c3fe622f37b8d3caba5c57153f09590be1beaa25abc43e56e: Status 404 returned error can't find the container with id d36eaa22dfb1e35c3fe622f37b8d3caba5c57153f09590be1beaa25abc43e56e
Jul 20 21:46:09.008127 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:09.008041    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:09.008210 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:09.008153    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:09.008210 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:09.008197    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:09.104348 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:09.104316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" event={"ID":"4523813a-f245-4cce-a162-7fd00edd06ee","Type":"ContainerStarted","Data":"2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d"}
Jul 20 21:46:09.104489 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:09.104379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" event={"ID":"4523813a-f245-4cce-a162-7fd00edd06ee","Type":"ContainerStarted","Data":"d36eaa22dfb1e35c3fe622f37b8d3caba5c57153f09590be1beaa25abc43e56e"}
Jul 20 21:46:09.136146 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:09.135636    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" podStartSLOduration=1.135610469 podStartE2EDuration="1.135610469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:46:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:46:09.133336584 +0000 UTC m=+2628.886059307" watchObservedRunningTime="2026-07-20 21:46:09.135610469 +0000 UTC m=+2628.888333193"
Jul 20 21:46:09.806979 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:09.806944    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:10.811552 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:10.811522    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:11.115596 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:11.115519    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:11.116424 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:11.116405    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:16.148503 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:16.148468    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerID="76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5" exitCode=0
Jul 20 21:46:16.149169 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:16.149142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" event={"ID":"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2","Type":"ContainerDied","Data":"76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5"}
Jul 20 21:46:16.149763 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:16.149744    2573 scope.go:117] "RemoveContainer" containerID="76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5"
Jul 20 21:46:16.152284 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:16.152242    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:16.152394 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:16.152335    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:16.152459 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:16.152389    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:17.065115 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:17.065055    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:17.160258 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:17.160220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" event={"ID":"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2","Type":"ContainerStarted","Data":"52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66"}
Jul 20 21:46:17.873630 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:17.873313    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:17.874850 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:17.874820    2573 patch_prober.go:28] interesting pod/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 20 21:46:17.875126 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:17.875100    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 20 21:46:18.877173 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:18.877130    2573 patch_prober.go:28] interesting pod/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 20 21:46:18.877662 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:18.877197    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 20 21:46:19.873975 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:19.873938    2573 patch_prober.go:28] interesting pod/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 20 21:46:19.874160 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:19.874000    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 20 21:46:20.873492 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:20.873447    2573 patch_prober.go:28] interesting pod/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 20 21:46:20.873900 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:20.873517    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 20 21:46:21.876807 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:21.876779    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:21.877288 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:21.877032    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:21.877778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:21.877757    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:46:23.201628 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:23.201592    2573 generic.go:356] "Generic (PLEG): container finished" podID="4523813a-f245-4cce-a162-7fd00edd06ee" containerID="2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d" exitCode=0
Jul 20 21:46:23.202064 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:23.201662    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" event={"ID":"4523813a-f245-4cce-a162-7fd00edd06ee","Type":"ContainerDied","Data":"2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d"}
Jul 20 21:46:23.202203 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:23.202186    2573 scope.go:117] "RemoveContainer" containerID="2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d"
Jul 20 21:46:23.203144 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:23.203114    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:23.203215 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:23.203196    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:23.203262 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:23.203246    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 21:46:24.209067 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:24.209029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" event={"ID":"4523813a-f245-4cce-a162-7fd00edd06ee","Type":"ContainerStarted","Data":"7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e"}
Jul 20 21:46:24.806323 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:24.806289    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:24.807409 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:24.807384    2573 patch_prober.go:28] interesting pod/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 20 21:46:24.807532 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:24.807431    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 20 21:46:25.807057 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:25.807023    2573 patch_prober.go:28] interesting pod/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 20 21:46:25.807452 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:25.807103    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 20 21:46:26.115568 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:26.115481    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:26.807026 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:26.806993    2573 patch_prober.go:28] interesting pod/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 20 21:46:26.807216 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:26.807044    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 20 21:46:27.807059 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:27.807021    2573 patch_prober.go:28] interesting pod/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 20 21:46:27.807269 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:27.807106    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 20 21:46:28.810607 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:28.810577    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:46:28.811623 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:46:28.811604    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:47:21.139715 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:47:21.139491    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:47:21.152099 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:47:21.152059    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:48:21.084916 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:48:21.084883    2573 scope.go:117] "RemoveContainer" containerID="664b1f39a61050d2ab7b3797747e27a604dbece5823d5f3b9d1d1d360730cb25"
Jul 20 21:52:21.173717 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:21.173682    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:52:21.187153 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:21.187131    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt8xd_7ebfe27c-db36-403d-855a-e757efa8d930/ovn-acl-logging/0.log"
Jul 20 21:52:24.709146 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:24.709112    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"]
Jul 20 21:52:24.709629 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:24.709340    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy" containerID="cri-o://52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66" gracePeriod=30
Jul 20 21:52:29.969095 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:29.969053    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:52:30.108370 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108332    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmt4n\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-kube-api-access-bmt4n\") pod \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") "
Jul 20 21:52:30.108569 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108392    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-certs\") pod \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") "
Jul 20 21:52:30.108569 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108412    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-socket\") pod \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") "
Jul 20 21:52:30.108569 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108434    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-podinfo\") pod \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") "
Jul 20 21:52:30.108569 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108484    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-credential-socket\") pod \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") "
Jul 20 21:52:30.108569 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108524    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-envoy\") pod \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") "
Jul 20 21:52:30.108569 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108563    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istiod-ca-cert\") pod \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") "
Jul 20 21:52:30.108894 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108624    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-data\") pod \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") "
Jul 20 21:52:30.108894 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108655    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-token\") pod \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\" (UID: \"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2\") "
Jul 20 21:52:30.108894 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108731    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" (UID: "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:30.108894 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108747    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" (UID: "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:30.108894 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.108846    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" (UID: "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:30.109180 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.109068    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:30.109180 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.109121    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:30.109180 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.109135    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:30.109342 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.109256    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" (UID: "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:52:30.109992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.109955    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" (UID: "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:30.110808 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.110781    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-kube-api-access-bmt4n" (OuterVolumeSpecName: "kube-api-access-bmt4n") pod "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" (UID: "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2"). InnerVolumeSpecName "kube-api-access-bmt4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:52:30.110906 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.110889    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" (UID: "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 21:52:30.111110 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.111037    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" (UID: "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:52:30.112286 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.112262    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" (UID: "cd54e16f-e2f0-4b02-8a1f-b5559eca81b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:30.209502 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.209475    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:30.209502 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.209498    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:30.209502 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.209508    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:30.209686 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.209516    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:30.209686 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.209523    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:30.209686 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.209535    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmt4n\" (UniqueName: \"kubernetes.io/projected/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2-kube-api-access-bmt4n\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:30.229169 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.229140    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerID="52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66" exitCode=0
Jul 20 21:52:30.229298 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.229186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" event={"ID":"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2","Type":"ContainerDied","Data":"52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66"}
Jul 20 21:52:30.229298 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.229193    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"
Jul 20 21:52:30.229298 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.229254    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm" event={"ID":"cd54e16f-e2f0-4b02-8a1f-b5559eca81b2","Type":"ContainerDied","Data":"189f71f6d58b180fdc2f5143a7e568301a09e6602e1c2f1af234c930b0078fbb"}
Jul 20 21:52:30.229298 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.229279    2573 scope.go:117] "RemoveContainer" containerID="52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66"
Jul 20 21:52:30.238829 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.238813    2573 scope.go:117] "RemoveContainer" containerID="76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5"
Jul 20 21:52:30.247144 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.247130    2573 scope.go:117] "RemoveContainer" containerID="52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66"
Jul 20 21:52:30.247360 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:52:30.247344    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66\": container with ID starting with 52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66 not found: ID does not exist" containerID="52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66"
Jul 20 21:52:30.247413 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.247366    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66"} err="failed to get container status \"52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66\": rpc error: code = NotFound desc = could not find container \"52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66\": container with ID starting with 52e6369a62341ba20a5d9fa74f2e46c9c5aaf9e3bfd1c09c0383c2492fd24b66 not found: ID does not exist"
Jul 20 21:52:30.247413 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.247382    2573 scope.go:117] "RemoveContainer" containerID="76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5"
Jul 20 21:52:30.247576 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:52:30.247561    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5\": container with ID starting with 76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5 not found: ID does not exist" containerID="76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5"
Jul 20 21:52:30.247613 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.247579    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5"} err="failed to get container status \"76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5\": rpc error: code = NotFound desc = could not find container \"76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5\": container with ID starting with 76e28fc0c65e227ecb93f69ed2286044e747a05d3ea25639b3a062923fbd7db5 not found: ID does not exist"
Jul 20 21:52:30.252918 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.252898    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"]
Jul 20 21:52:30.261764 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.261742    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-196c99-openshift-default-f654b57c5-fpnmm"]
Jul 20 21:52:30.770288 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:30.770255    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" path="/var/lib/kubelet/pods/cd54e16f-e2f0-4b02-8a1f-b5559eca81b2/volumes"
Jul 20 21:52:47.048240 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:47.048201    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"]
Jul 20 21:52:47.048740 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:47.048440    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy" containerID="cri-o://7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e" gracePeriod=30
Jul 20 21:52:47.772132 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:47.772065    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84dfd759db-6mzdk_1457c9a2-933f-4542-8f1a-b37cb83c6b04/authorino/0.log"
Jul 20 21:52:52.305536 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.305505    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:52:52.347867 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.347788    2573 generic.go:356] "Generic (PLEG): container finished" podID="4523813a-f245-4cce-a162-7fd00edd06ee" containerID="7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e" exitCode=0
Jul 20 21:52:52.347867 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.347830    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"
Jul 20 21:52:52.348022 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.347873    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" event={"ID":"4523813a-f245-4cce-a162-7fd00edd06ee","Type":"ContainerDied","Data":"7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e"}
Jul 20 21:52:52.348022 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.347925    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp" event={"ID":"4523813a-f245-4cce-a162-7fd00edd06ee","Type":"ContainerDied","Data":"d36eaa22dfb1e35c3fe622f37b8d3caba5c57153f09590be1beaa25abc43e56e"}
Jul 20 21:52:52.348022 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.347947    2573 scope.go:117] "RemoveContainer" containerID="7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e"
Jul 20 21:52:52.357243 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.357226    2573 scope.go:117] "RemoveContainer" containerID="2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d"
Jul 20 21:52:52.364960 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.364937    2573 scope.go:117] "RemoveContainer" containerID="7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e"
Jul 20 21:52:52.365253 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:52:52.365232    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e\": container with ID starting with 7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e not found: ID does not exist" containerID="7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e"
Jul 20 21:52:52.365351 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.365259    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e"} err="failed to get container status \"7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e\": rpc error: code = NotFound desc = could not find container \"7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e\": container with ID starting with 7b7a8780bc1af6dbd0cbadfe87cb9e7a268b17c3705a6a7d4efda39a4a46c54e not found: ID does not exist"
Jul 20 21:52:52.365351 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.365278    2573 scope.go:117] "RemoveContainer" containerID="2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d"
Jul 20 21:52:52.365539 ip-10-0-136-242 kubenswrapper[2573]: E0720 21:52:52.365522    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d\": container with ID starting with 2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d not found: ID does not exist" containerID="2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d"
Jul 20 21:52:52.365582 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.365545    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d"} err="failed to get container status \"2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d\": rpc error: code = NotFound desc = could not find container \"2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d\": container with ID starting with 2589b2532e9cf4c151ec36aa1667868fe9fd9b3e61caa9479ee43667f8c8354d not found: ID does not exist"
Jul 20 21:52:52.369841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.369823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4523813a-f245-4cce-a162-7fd00edd06ee-istiod-ca-cert\") pod \"4523813a-f245-4cce-a162-7fd00edd06ee\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") "
Jul 20 21:52:52.369955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.369858    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmwhz\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-kube-api-access-zmwhz\") pod \"4523813a-f245-4cce-a162-7fd00edd06ee\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") "
Jul 20 21:52:52.369955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.369885    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-istio-token\") pod \"4523813a-f245-4cce-a162-7fd00edd06ee\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") "
Jul 20 21:52:52.369955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.369909    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-certs\") pod \"4523813a-f245-4cce-a162-7fd00edd06ee\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") "
Jul 20 21:52:52.369955 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.369949    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-envoy\") pod \"4523813a-f245-4cce-a162-7fd00edd06ee\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") "
Jul 20 21:52:52.370187 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.369982    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-credential-socket\") pod \"4523813a-f245-4cce-a162-7fd00edd06ee\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") "
Jul 20 21:52:52.370187 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.370020    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-socket\") pod \"4523813a-f245-4cce-a162-7fd00edd06ee\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") "
Jul 20 21:52:52.370187 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.370046    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-data\") pod \"4523813a-f245-4cce-a162-7fd00edd06ee\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") "
Jul 20 21:52:52.370187 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.370092    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4523813a-f245-4cce-a162-7fd00edd06ee-istio-podinfo\") pod \"4523813a-f245-4cce-a162-7fd00edd06ee\" (UID: \"4523813a-f245-4cce-a162-7fd00edd06ee\") "
Jul 20 21:52:52.370402 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.370301    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4523813a-f245-4cce-a162-7fd00edd06ee" (UID: "4523813a-f245-4cce-a162-7fd00edd06ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:52.370402 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.370328    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4523813a-f245-4cce-a162-7fd00edd06ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4523813a-f245-4cce-a162-7fd00edd06ee" (UID: "4523813a-f245-4cce-a162-7fd00edd06ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 21:52:52.370507 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.370433    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4523813a-f245-4cce-a162-7fd00edd06ee" (UID: "4523813a-f245-4cce-a162-7fd00edd06ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:52.370507 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.370448    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4523813a-f245-4cce-a162-7fd00edd06ee-istiod-ca-cert\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:52.370507 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.370465    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-certs\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:52.370681 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.370644    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4523813a-f245-4cce-a162-7fd00edd06ee" (UID: "4523813a-f245-4cce-a162-7fd00edd06ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:52.371147 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.371122    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "4523813a-f245-4cce-a162-7fd00edd06ee" (UID: "4523813a-f245-4cce-a162-7fd00edd06ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:52.372306 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.372288    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4523813a-f245-4cce-a162-7fd00edd06ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4523813a-f245-4cce-a162-7fd00edd06ee" (UID: "4523813a-f245-4cce-a162-7fd00edd06ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 21:52:52.372501 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.372482    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-kube-api-access-zmwhz" (OuterVolumeSpecName: "kube-api-access-zmwhz") pod "4523813a-f245-4cce-a162-7fd00edd06ee" (UID: "4523813a-f245-4cce-a162-7fd00edd06ee"). InnerVolumeSpecName "kube-api-access-zmwhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:52:52.372582 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.372500    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4523813a-f245-4cce-a162-7fd00edd06ee" (UID: "4523813a-f245-4cce-a162-7fd00edd06ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 21:52:52.372622 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.372578    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "4523813a-f245-4cce-a162-7fd00edd06ee" (UID: "4523813a-f245-4cce-a162-7fd00edd06ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 21:52:52.471312 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.471289    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-data\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:52.471312 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.471309    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4523813a-f245-4cce-a162-7fd00edd06ee-istio-podinfo\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:52.471505 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.471319    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmwhz\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-kube-api-access-zmwhz\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:52.471505 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.471328    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4523813a-f245-4cce-a162-7fd00edd06ee-istio-token\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:52.471505 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.471336    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-istio-envoy\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:52.471505 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.471344    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-credential-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:52.471505 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.471352    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4523813a-f245-4cce-a162-7fd00edd06ee-workload-socket\") on node \"ip-10-0-136-242.ec2.internal\" DevicePath \"\""
Jul 20 21:52:52.671227 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.671198    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"]
Jul 20 21:52:52.675445 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.675413    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-046c73-openshift-default-757949fdf9-p7mdp"]
Jul 20 21:52:52.769875 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:52.769845    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" path="/var/lib/kubelet/pods/4523813a-f245-4cce-a162-7fd00edd06ee/volumes"
Jul 20 21:52:53.235712 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:53.235684    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vk2k8_34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae/manager/0.log"
Jul 20 21:52:53.353172 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:53.353145    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jchd8_de27a5fc-d80a-46f1-830f-da9f5911bae7/manager/0.log"
Jul 20 21:52:53.470287 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:53.470263    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84bff768b5-4j2h9_ba26e5be-734e-4bbf-9f54-be22ec3b73e7/manager/0.log"
Jul 20 21:52:53.583441 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:53.583375    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-brdw7_eae21af0-a80b-4050-a083-e6ed13e82135/server/0.log"
Jul 20 21:52:53.697297 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:53.697268    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9qjrf_fcf7b721-1a6e-4a67-b888-22adc66b24cb/manager/0.log"
Jul 20 21:52:54.078649 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:54.078621    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66b5c4b596-kjgmf_2b867932-1539-4a17-bc94-4e82cbd91967/copy-manifests/0.log"
Jul 20 21:52:54.100333 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:54.100307    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66b5c4b596-kjgmf_2b867932-1539-4a17-bc94-4e82cbd91967/manager/0.log"
Jul 20 21:52:54.462510 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:54.462438    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-664b6b5859-4rzwn_44a1d39b-4e7d-4061-9fbd-c1414475373f/maas-api/0.log"
Jul 20 21:52:54.805255 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:54.805228    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dp672_73dca0ed-dced-4a5c-a82e-065461d58508/postgres/0.log"
Jul 20 21:52:55.611293 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.611269    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd_531926dd-bb37-4d0c-9724-f72d41c69a4d/util/0.log"
Jul 20 21:52:55.618627 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.618604    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd_531926dd-bb37-4d0c-9724-f72d41c69a4d/pull/0.log"
Jul 20 21:52:55.625542 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.625518    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd_531926dd-bb37-4d0c-9724-f72d41c69a4d/extract/0.log"
Jul 20 21:52:55.741696 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.741668    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv_93690712-178f-45b2-8bbe-109fd1d83400/util/0.log"
Jul 20 21:52:55.749640 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.749613    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv_93690712-178f-45b2-8bbe-109fd1d83400/pull/0.log"
Jul 20 21:52:55.756622 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.756587    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv_93690712-178f-45b2-8bbe-109fd1d83400/extract/0.log"
Jul 20 21:52:55.874648 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.874583    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw_c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df/util/0.log"
Jul 20 21:52:55.881113 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.881093    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw_c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df/pull/0.log"
Jul 20 21:52:55.887613 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.887599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw_c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df/extract/0.log"
Jul 20 21:52:55.996518 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:55.996502    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285_09405bd6-8305-4b21-b8c8-09702bb62603/util/0.log"
Jul 20 21:52:56.003159 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:56.003140    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285_09405bd6-8305-4b21-b8c8-09702bb62603/pull/0.log"
Jul 20 21:52:56.009311 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:56.009297    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285_09405bd6-8305-4b21-b8c8-09702bb62603/extract/0.log"
Jul 20 21:52:56.121616 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:56.121594    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84dfd759db-6mzdk_1457c9a2-933f-4542-8f1a-b37cb83c6b04/authorino/0.log"
Jul 20 21:52:56.236352 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:56.236329    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gkwv9_bc79abc1-f3d1-40da-82bd-af3b676631ad/manager/0.log"
Jul 20 21:52:56.355304 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:56.355280    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-97nt5_5721aa10-e7e4-4ffd-9af3-c72932089714/manager/0.log"
Jul 20 21:52:56.462400 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:56.462372    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xvhqw_775299f0-3154-4d27-a2b5-7887516b7406/kuadrant-console-plugin/0.log"
Jul 20 21:52:56.591702 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:56.591633    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qjlnq_b762ff94-d294-42da-9658-d10bf9a8c3df/registry-server/0.log"
Jul 20 21:52:56.709852 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:56.709824    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tpbtd_16ed3a11-a469-42da-808e-951c563e63bd/manager/0.log"
Jul 20 21:52:57.559890 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:57.559863    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfcf6b877-65xpm_c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab/kube-auth-proxy/0.log"
Jul 20 21:52:57.822999 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:57.822921    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qcshl_160bec94-7fb5-4d02-a1b5-deeffc2c9109/istio-proxy/1.log"
Jul 20 21:52:58.108747 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:58.108676    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dp276_90fe6e8f-3769-43ca-8f56-370cb996b0ae/payload-processing/0.log"
Jul 20 21:52:58.607643 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:58.607614    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xjhsk_b821fc70-079b-4843-9fe1-facb8113a313/main/0.log"
Jul 20 21:52:58.834366 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:52:58.834335    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-hdn7h_b66be4ed-f156-4b23-9be0-25f7a3cfc595/main/0.log"
Jul 20 21:53:04.343454 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343420    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cffm9/must-gather-wg2rp"]
Jul 20 21:53:04.343824 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343756    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy"
Jul 20 21:53:04.343824 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343767    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy"
Jul 20 21:53:04.343824 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343774    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy"
Jul 20 21:53:04.343824 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343779    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy"
Jul 20 21:53:04.343824 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343786    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy"
Jul 20 21:53:04.343824 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343791    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy"
Jul 20 21:53:04.343824 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343804    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy"
Jul 20 21:53:04.343824 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343810    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy"
Jul 20 21:53:04.344102 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343873    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy"
Jul 20 21:53:04.344102 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343880    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd54e16f-e2f0-4b02-8a1f-b5559eca81b2" containerName="istio-proxy"
Jul 20 21:53:04.344102 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343888    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy"
Jul 20 21:53:04.344102 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.343895    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4523813a-f245-4cce-a162-7fd00edd06ee" containerName="istio-proxy"
Jul 20 21:53:04.347019 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.347000    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cffm9/must-gather-wg2rp"
Jul 20 21:53:04.349712 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.349686    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cffm9\"/\"openshift-service-ca.crt\""
Jul 20 21:53:04.349826 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.349717    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cffm9\"/\"kube-root-ca.crt\""
Jul 20 21:53:04.349879 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.349835    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cffm9\"/\"default-dockercfg-tbtzm\""
Jul 20 21:53:04.357536 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.357514    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cffm9/must-gather-wg2rp"]
Jul 20 21:53:04.464360 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.464332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8vg\" (UniqueName: \"kubernetes.io/projected/8d4c2822-2303-4762-9844-4f011986afe9-kube-api-access-rl8vg\") pod \"must-gather-wg2rp\" (UID: \"8d4c2822-2303-4762-9844-4f011986afe9\") " pod="openshift-must-gather-cffm9/must-gather-wg2rp"
Jul 20 21:53:04.464500 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.464408    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8d4c2822-2303-4762-9844-4f011986afe9-must-gather-output\") pod \"must-gather-wg2rp\" (UID: \"8d4c2822-2303-4762-9844-4f011986afe9\") " pod="openshift-must-gather-cffm9/must-gather-wg2rp"
Jul 20 21:53:04.565242 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.565202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8d4c2822-2303-4762-9844-4f011986afe9-must-gather-output\") pod \"must-gather-wg2rp\" (UID: \"8d4c2822-2303-4762-9844-4f011986afe9\") " pod="openshift-must-gather-cffm9/must-gather-wg2rp"
Jul 20 21:53:04.565398 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.565260    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8vg\" (UniqueName: \"kubernetes.io/projected/8d4c2822-2303-4762-9844-4f011986afe9-kube-api-access-rl8vg\") pod \"must-gather-wg2rp\" (UID: \"8d4c2822-2303-4762-9844-4f011986afe9\") " pod="openshift-must-gather-cffm9/must-gather-wg2rp"
Jul 20 21:53:04.565586 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.565567    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8d4c2822-2303-4762-9844-4f011986afe9-must-gather-output\") pod \"must-gather-wg2rp\" (UID: \"8d4c2822-2303-4762-9844-4f011986afe9\") " pod="openshift-must-gather-cffm9/must-gather-wg2rp"
Jul 20 21:53:04.574164 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.574139    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8vg\" (UniqueName: \"kubernetes.io/projected/8d4c2822-2303-4762-9844-4f011986afe9-kube-api-access-rl8vg\") pod \"must-gather-wg2rp\" (UID: \"8d4c2822-2303-4762-9844-4f011986afe9\") " pod="openshift-must-gather-cffm9/must-gather-wg2rp"
Jul 20 21:53:04.656412 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.656356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cffm9/must-gather-wg2rp"
Jul 20 21:53:04.798031 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.798009    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cffm9/must-gather-wg2rp"]
Jul 20 21:53:04.800164 ip-10-0-136-242 kubenswrapper[2573]: W0720 21:53:04.800135    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d4c2822_2303_4762_9844_4f011986afe9.slice/crio-5359592faaffdddeb2a22b1cdec11189c22832bfce99527f21b6e13963e3ba65 WatchSource:0}: Error finding container 5359592faaffdddeb2a22b1cdec11189c22832bfce99527f21b6e13963e3ba65: Status 404 returned error can't find the container with id 5359592faaffdddeb2a22b1cdec11189c22832bfce99527f21b6e13963e3ba65
Jul 20 21:53:04.801683 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:04.801667    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 21:53:05.412617 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:05.412583    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cffm9/must-gather-wg2rp" event={"ID":"8d4c2822-2303-4762-9844-4f011986afe9","Type":"ContainerStarted","Data":"5359592faaffdddeb2a22b1cdec11189c22832bfce99527f21b6e13963e3ba65"}
Jul 20 21:53:06.422762 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:06.422729    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cffm9/must-gather-wg2rp" event={"ID":"8d4c2822-2303-4762-9844-4f011986afe9","Type":"ContainerStarted","Data":"0cd865ac2e83199c8314cfb77c2c002da4bab625dfebe7f2379055bc6bebd817"}
Jul 20 21:53:06.423220 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:06.422774    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cffm9/must-gather-wg2rp" event={"ID":"8d4c2822-2303-4762-9844-4f011986afe9","Type":"ContainerStarted","Data":"15cf1d8ff46e8febd6879d83698bd8af17c4a70501261ec74b7d28b3a49d52be"}
Jul 20 21:53:06.446009 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:06.445959    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cffm9/must-gather-wg2rp" podStartSLOduration=1.557121899 podStartE2EDuration="2.445944062s" totalImagesPullingTime="888.822163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 21:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:53:06.445269189 +0000 UTC m=+3046.197991912" watchObservedRunningTime="2026-07-20 21:53:06.445944062 +0000 UTC m=+3046.198666791"
Jul 20 21:53:07.457873 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:07.457842    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7s52p_ccbdeae7-d204-44c7-bd07-bf3c91742105/global-pull-secret-syncer/0.log"
Jul 20 21:53:07.642828 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:07.642797    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fs9kl_335d465f-e796-4de5-a149-0a728bab41a6/konnectivity-agent/0.log"
Jul 20 21:53:07.696234 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:07.696207    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-242.ec2.internal_2ecdc9466b19439a9a3bd8f65ab19d6a/haproxy/0.log"
Jul 20 21:53:11.675669 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.675603    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd_531926dd-bb37-4d0c-9724-f72d41c69a4d/extract/0.log"
Jul 20 21:53:11.700277 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.700255    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd_531926dd-bb37-4d0c-9724-f72d41c69a4d/util/0.log"
Jul 20 21:53:11.726993 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.726960    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xh9jd_531926dd-bb37-4d0c-9724-f72d41c69a4d/pull/0.log"
Jul 20 21:53:11.759686 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.759659    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv_93690712-178f-45b2-8bbe-109fd1d83400/extract/0.log"
Jul 20 21:53:11.789841 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.789806    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv_93690712-178f-45b2-8bbe-109fd1d83400/util/0.log"
Jul 20 21:53:11.817291 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.817185    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkvzv_93690712-178f-45b2-8bbe-109fd1d83400/pull/0.log"
Jul 20 21:53:11.871266 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.871241    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw_c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df/extract/0.log"
Jul 20 21:53:11.896771 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.896744    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw_c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df/util/0.log"
Jul 20 21:53:11.921758 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.921733    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qpsw_c19a7fc0-c7ab-4e93-8fe9-72cdeb4169df/pull/0.log"
Jul 20 21:53:11.955934 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.955856    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285_09405bd6-8305-4b21-b8c8-09702bb62603/extract/0.log"
Jul 20 21:53:11.978907 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:11.978884    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285_09405bd6-8305-4b21-b8c8-09702bb62603/util/0.log"
Jul 20 21:53:12.012002 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:12.011954    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r2285_09405bd6-8305-4b21-b8c8-09702bb62603/pull/0.log"
Jul 20 21:53:12.580848 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:12.580814    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84dfd759db-6mzdk_1457c9a2-933f-4542-8f1a-b37cb83c6b04/authorino/0.log"
Jul 20 21:53:12.616853 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:12.616794    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gkwv9_bc79abc1-f3d1-40da-82bd-af3b676631ad/manager/0.log"
Jul 20 21:53:12.667231 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:12.667202    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-97nt5_5721aa10-e7e4-4ffd-9af3-c72932089714/manager/0.log"
Jul 20 21:53:12.711121 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:12.710238    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xvhqw_775299f0-3154-4d27-a2b5-7887516b7406/kuadrant-console-plugin/0.log"
Jul 20 21:53:12.769107 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:12.766010    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qjlnq_b762ff94-d294-42da-9658-d10bf9a8c3df/registry-server/0.log"
Jul 20 21:53:13.008461 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:13.008415    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tpbtd_16ed3a11-a469-42da-808e-951c563e63bd/manager/0.log"
Jul 20 21:53:15.454224 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:15.454195    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2t8c_74e94684-ef93-4db2-8f8e-e097b4528f95/node-exporter/0.log"
Jul 20 21:53:15.502641 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:15.502610    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2t8c_74e94684-ef93-4db2-8f8e-e097b4528f95/kube-rbac-proxy/0.log"
Jul 20 21:53:15.535248 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:15.535218    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2t8c_74e94684-ef93-4db2-8f8e-e097b4528f95/init-textfile/0.log"
Jul 20 21:53:17.030808 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.030767    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"]
Jul 20 21:53:17.035806 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.035774    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.049539 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.049506    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"]
Jul 20 21:53:17.094880 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.094842    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-proc\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.095051 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.094901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-sys\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.095051 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.094927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-podres\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.095051 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.094973    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-lib-modules\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.095176 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.095066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67zlr\" (UniqueName: \"kubernetes.io/projected/d4c37626-c8e6-44b9-a888-e3818ead0ccc-kube-api-access-67zlr\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.196579 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.196537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67zlr\" (UniqueName: \"kubernetes.io/projected/d4c37626-c8e6-44b9-a888-e3818ead0ccc-kube-api-access-67zlr\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.196778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.196617    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-proc\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.196778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.196656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-sys\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.196778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.196684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-podres\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.196778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.196729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-lib-modules\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.197008 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.196891    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-lib-modules\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.197304 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.197279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-proc\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.197385 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.197345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-sys\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.197460 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.197440    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4c37626-c8e6-44b9-a888-e3818ead0ccc-podres\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.206592 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.206559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67zlr\" (UniqueName: \"kubernetes.io/projected/d4c37626-c8e6-44b9-a888-e3818ead0ccc-kube-api-access-67zlr\") pod \"perf-node-gather-daemonset-tv8jm\" (UID: \"d4c37626-c8e6-44b9-a888-e3818ead0ccc\") " pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.349355 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.349274    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:17.545633 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.545591    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"]
Jul 20 21:53:17.632441 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:17.632401    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-t54vz_ff466237-8d4e-451b-9f64-1a2f09aace58/networking-console-plugin/0.log"
Jul 20 21:53:18.520157 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:18.520065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm" event={"ID":"d4c37626-c8e6-44b9-a888-e3818ead0ccc","Type":"ContainerStarted","Data":"8b8f9543919f219f06ee5fc0b190c72798291530c89fb59510dd63f359dbc881"}
Jul 20 21:53:18.520547 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:18.520227    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm" event={"ID":"d4c37626-c8e6-44b9-a888-e3818ead0ccc","Type":"ContainerStarted","Data":"86e58d1fc6f041eaae89b5d9bf8c6aa574c2397f3b8c98accd4af2a2bb89fa65"}
Jul 20 21:53:18.520547 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:18.520498    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:18.539754 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:18.539685    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm" podStartSLOduration=1.5396659019999999 podStartE2EDuration="1.539665902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 21:53:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 21:53:18.537546229 +0000 UTC m=+3058.290268954" watchObservedRunningTime="2026-07-20 21:53:18.539665902 +0000 UTC m=+3058.292388624"
Jul 20 21:53:20.239097 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:20.239050    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6xncf_40069710-60c1-42f1-8792-ee9befb5c154/dns/0.log"
Jul 20 21:53:20.265119 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:20.265093    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6xncf_40069710-60c1-42f1-8792-ee9befb5c154/kube-rbac-proxy/0.log"
Jul 20 21:53:20.425247 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:20.425218    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zw96k_73354489-004c-4429-9ba9-2cadd2eec8ff/dns-node-resolver/0.log"
Jul 20 21:53:21.008976 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:21.008933    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-frz2v_e9ec5099-bccf-40fd-bc3e-d4c386061cff/node-ca/0.log"
Jul 20 21:53:22.176600 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:22.176570    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfcf6b877-65xpm_c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab/kube-auth-proxy/0.log"
Jul 20 21:53:22.245667 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:22.245639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qcshl_160bec94-7fb5-4d02-a1b5-deeffc2c9109/istio-proxy/0.log"
Jul 20 21:53:22.279329 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:22.279293    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qcshl_160bec94-7fb5-4d02-a1b5-deeffc2c9109/istio-proxy/1.log"
Jul 20 21:53:22.351513 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:22.351482    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dp276_90fe6e8f-3769-43ca-8f56-370cb996b0ae/payload-processing/0.log"
Jul 20 21:53:23.139639 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:23.139605    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b9gt6_99d3963f-e3cf-4654-980c-f7b71972a1a9/serve-healthcheck-canary/0.log"
Jul 20 21:53:23.722445 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:23.722419    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbrsj_8a12aebb-d0ed-40a5-a53d-8c47693bb423/kube-rbac-proxy/0.log"
Jul 20 21:53:23.744309 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:23.744282    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbrsj_8a12aebb-d0ed-40a5-a53d-8c47693bb423/exporter/0.log"
Jul 20 21:53:23.768125 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:23.768101    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbrsj_8a12aebb-d0ed-40a5-a53d-8c47693bb423/extractor/0.log"
Jul 20 21:53:24.542887 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:24.542856    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cffm9/perf-node-gather-daemonset-tv8jm"
Jul 20 21:53:26.243392 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:26.243363    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vk2k8_34bbd3d9-eb63-4d5f-a9fd-e8d4665029ae/manager/0.log"
Jul 20 21:53:26.531937 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:26.531859    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jchd8_de27a5fc-d80a-46f1-830f-da9f5911bae7/manager/0.log"
Jul 20 21:53:26.686107 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:26.686055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84bff768b5-4j2h9_ba26e5be-734e-4bbf-9f54-be22ec3b73e7/manager/0.log"
Jul 20 21:53:26.706992 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:26.706938    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-brdw7_eae21af0-a80b-4050-a083-e6ed13e82135/server/0.log"
Jul 20 21:53:26.801778 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:26.801697    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9qjrf_fcf7b721-1a6e-4a67-b888-22adc66b24cb/manager/0.log"
Jul 20 21:53:27.007334 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:27.007301    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66b5c4b596-kjgmf_2b867932-1539-4a17-bc94-4e82cbd91967/manager/0.log"
Jul 20 21:53:27.026990 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:27.026959    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66b5c4b596-kjgmf_2b867932-1539-4a17-bc94-4e82cbd91967/copy-manifests/0.log"
Jul 20 21:53:27.466090 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:27.466009    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfcf6b877-65xpm_c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab/kube-auth-proxy/0.log"
Jul 20 21:53:27.499548 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:27.499509    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qcshl_160bec94-7fb5-4d02-a1b5-deeffc2c9109/istio-proxy/0.log"
Jul 20 21:53:27.533148 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:27.533120    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qcshl_160bec94-7fb5-4d02-a1b5-deeffc2c9109/istio-proxy/1.log"
Jul 20 21:53:27.585584 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:27.585559    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dp276_90fe6e8f-3769-43ca-8f56-370cb996b0ae/payload-processing/0.log"
Jul 20 21:53:28.286350 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:28.286316    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-h9slw_9eeb7d5f-f73b-4c0a-96fd-0da02b6a0b69/openshift-lws-operator/0.log"
Jul 20 21:53:28.923954 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:28.923923    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfcf6b877-65xpm_c4c102a2-b7b4-4bc3-bd5d-ec93f49cfeab/kube-auth-proxy/0.log"
Jul 20 21:53:28.955730 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:28.955702    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qcshl_160bec94-7fb5-4d02-a1b5-deeffc2c9109/istio-proxy/0.log"
Jul 20 21:53:28.986733 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:28.986710    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qcshl_160bec94-7fb5-4d02-a1b5-deeffc2c9109/istio-proxy/1.log"
Jul 20 21:53:29.039908 ip-10-0-136-242 kubenswrapper[2573]: I0720 21:53:29.039859    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dp276_90fe6e8f-3769-43ca-8f56-370cb996b0ae/payload-processing/0.log"