Jul 15 23:45:17.398761 ip-10-0-140-110 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 23:45:17.398772 ip-10-0-140-110 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 23:45:17.398778 ip-10-0-140-110 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 23:45:17.399071 ip-10-0-140-110 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 23:45:27.644249 ip-10-0-140-110 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 23:45:27.644265 ip-10-0-140-110 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0e58bf5dc3d64df7972cb8d56581affc --
Jul 15 23:47:19.640901 ip-10-0-140-110 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 23:47:19.939972 ip-10-0-140-110 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 23:47:19.939972 ip-10-0-140-110 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 23:47:19.939972 ip-10-0-140-110 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 23:47:19.939972 ip-10-0-140-110 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 23:47:19.939972 ip-10-0-140-110 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 23:47:19.941329 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.941219    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 23:47:19.944472 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944457    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:47:19.944472 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944472    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944475    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944479    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944481    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944484    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944487    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944489    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944492    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944495    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944498    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944500    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944503    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944505    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944508    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944511    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944513    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944516    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944520    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944527    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:47:19.944532 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944530    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944533    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944536    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944539    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944542    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944545    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944548    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944550    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944553    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944556    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944558    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944562    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944564    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944567    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944569    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944572    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944574    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944577    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944580    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944582    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:47:19.945017 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944585    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944587    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944590    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944592    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944594    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944608    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944611    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944614    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944616    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944619    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944621    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944624    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944626    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944629    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944633    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944636    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944640    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944646    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944649    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:47:19.945486 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944652    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944655    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944658    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944661    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944663    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944666    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944668    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944671    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944674    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944676    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944679    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944681    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944684    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944687    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944689    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944692    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944695    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944697    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944700    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944702    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:47:19.945988 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944705    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944707    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944710    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944713    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944716    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944718    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944721    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944723    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944726    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944729    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944731    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944734    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944736    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944739    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944741    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944744    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944746    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944749    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944751    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:47:19.946458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.944754    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945432    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945438    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945440    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945443    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945446    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945449    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945452    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945455    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945458    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945460    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945463    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945465    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945469    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945472    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945475    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945478    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945480    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945483    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945486    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:47:19.946961 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945488    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945491    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945494    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945497    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945500    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945502    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945505    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945508    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945510    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945513    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945515    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945518    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945521    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945525    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945529    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945532    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945535    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945537    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945540    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:47:19.947458 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945543    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945545    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945548    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945550    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945553    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945556    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945559    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945562    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945564    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945567    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945571    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945575    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945578    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945580    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945583    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945586    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945588    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945591    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945593    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945596    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:47:19.948081 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945613    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945616    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945618    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945623    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945627    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945630    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945633    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945636    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945638    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945641    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945643    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945646    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945649    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945652    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945654    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945657    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945659    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945662    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945664    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945667    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:47:19.948569 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945670    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945673    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945675    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945678    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945680    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945683    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945685    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945688    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945690    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945693    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945695    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945697    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945700    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945702    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945705    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945707    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945710    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945712    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945715    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945717    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:47:19.949073 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.945720    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946062    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946066    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946069    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946072    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946076    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946079    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946082    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946084    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946087    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946090    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946092    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946095    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946098    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946100    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946103    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946106    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946109    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946111    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946114    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:47:19.949556 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946117    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946119    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946122    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946125    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946127    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946130    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946132    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946135    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946137    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946140    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946142    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946145    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946148    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946150    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946152    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946155    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946157    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946160    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946163    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946165    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:47:19.950049 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946168    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946174    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946177    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946182    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946185    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946188    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946191    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946194    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946197    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946199    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946202    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946204    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946206    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946210    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946214    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946217    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946220    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946223    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946225    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:47:19.950522 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946228    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946230    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946234    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946237    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946240    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946243    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946245    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946248    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946250    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946252    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946255    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946257    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946260    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946263    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946267    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946270    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946273    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946275    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946278    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:47:19.950995 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946280    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946282    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946286    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946288    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946291    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946293    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946296    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946298    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946300    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946303    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946306    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946308    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946311    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946313    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946316    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946318    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946320    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946323    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946325    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946328    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:47:19.951461 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946330    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.946333    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946399    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946409    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946414    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946418    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946423    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946428    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946432    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946436    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946440    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946443    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946446    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946449    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946452    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946455    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946458    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946461    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946464    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946467    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946477    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946480    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946483    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946486    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 23:47:19.951960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946490    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946497    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946500    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946503    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946506    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946509    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946516    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946519    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946522    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946525    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946529    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946532    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946534    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946537    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946540    2576 flags.go:64] FLAG: --enable-server="true"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946545    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946549    2576 flags.go:64] FLAG: --event-burst="100"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946552    2576 flags.go:64] FLAG: --event-qps="50"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946555    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946558    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946561    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946564    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946568    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946570    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946573    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 15 23:47:19.952584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946576    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946579    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946582    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946585    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946588    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946590    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946593    2576 flags.go:64] FLAG: --feature-gates=""
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946610    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946614    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946617    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946620    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946623    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946626    2576 flags.go:64] FLAG: --help="false"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946629    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-110.ec2.internal"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946632    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946635    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946637    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946640    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946644    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946646    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946649    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946652    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946657    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 23:47:19.953238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946661    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946664    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946667    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946670    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946673    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946676    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946679    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946681    2576 flags.go:64] FLAG: --lock-file=""
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946684    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946687    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946690    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946695    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946698    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946701    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946704    2576 flags.go:64] FLAG: --logging-format="text"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946707    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946710    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946713    2576 flags.go:64] FLAG: --manifest-url=""
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946716    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946720    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946723    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946728    2576 flags.go:64] FLAG: --max-pods="110"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946731    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946734    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946736    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 23:47:19.953844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946739    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946742    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946745    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946748    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946754    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946757    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946763    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946766    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946770    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946775    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946778    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946822    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946827    2576 flags.go:64] FLAG: --port="10250"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946831    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946834    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c84f843504cb8ab"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946837    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946840    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946843    2576 flags.go:64] FLAG: --register-node="true"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946846    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946850    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946852    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946855    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946858    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946864    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946867    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 23:47:19.954436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946870    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946873    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946876    2576 flags.go:64] FLAG: --runonce="false"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946879    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946882    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946885    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946888    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946890    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946893    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946896    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946899    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946902    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946904    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946909    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946913    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946916    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946920    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946922    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946928    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946930    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946933    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946937    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946940    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946942    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946945    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 23:47:19.955052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946948    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946951    2576 flags.go:64] FLAG: --v="2"
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946954    2576 flags.go:64] FLAG: --version="false"
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946958    2576 flags.go:64] FLAG: --vmodule=""
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946961    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.946965    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947073    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947077    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947080    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947083    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947086    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947089    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947092    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947095    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947097    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947100    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947103    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947106    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947108    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947111    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947115    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:47:19.955683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947119    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947121    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947124    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947128    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947139    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947142    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947144    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947147    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947149    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947151    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947154    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947158    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947161    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947164    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947167    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947169    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947172    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947175    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947177    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:47:19.956177 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947180    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947183    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947185    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947188    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947190    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947193    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947195    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947198    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947200    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947203    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947206    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947208    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947212    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947215    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947217    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947220    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947222    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947226    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947228    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947231    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:47:19.956691 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947233    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947236    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947238    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947241    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947245    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947248    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947250    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947253    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947255    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947258    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947260    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947263    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947266    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947268    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947271    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947273    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947275    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947278    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947280    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947283    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:47:19.957206 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947285    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947288    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947290    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947293    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947296    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947299    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947303    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947306    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947309    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947312    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947315    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947318    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947320    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947323    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947326    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947328    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947331    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947333    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947335    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947338    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:47:19.957741 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947340    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947342    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947345    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947347    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.947350    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.947817    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.954667    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.954687    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.955303    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.955310    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955380    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955385    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955388    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955391    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955394    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:47:19.958230 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955397    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955400    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955402    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955404    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955407    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955410    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955414    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955423    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955427    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955429    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955432    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955434    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955437    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955445    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955448    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955450    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955453    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955456    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955458    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955461    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:47:19.958643 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955463    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955466    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955468    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955471    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955474    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955477    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955480    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955484    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955487    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955490    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955493    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955496    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955499    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955502    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955505    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955508    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955510    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955513    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955515    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955517    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:47:19.959125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955526    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955528    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955531    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955533    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955536    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955538    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955541    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955544    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955546    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955549    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955551    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955553    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955556    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955558    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955561    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955564    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955567    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955569    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955572    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:47:19.959757 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955575    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955577    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955579    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955582    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955585    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955587    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955589    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955592    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955594    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955611    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955616    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955620    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955622    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955626    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955636    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955639    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955642    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955644    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955646    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955649    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:47:19.960269 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955651    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955654    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955656    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955659    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955661    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955664    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955666    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955669    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955672    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955675    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955677    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955680    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955682    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955685    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:47:19.960825 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955688    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.955693    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955842    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955847    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955850    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955853    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955855    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955858    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955860    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955864    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955868    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955870    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955873    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955882    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:47:19.961171 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955885    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955888    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955890    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955893    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955896    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955899    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955902    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955904    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955907    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955910    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955912    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955915    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955918    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955921    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955924    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955926    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955929    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955931    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955934    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955937    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955939    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:47:19.961733 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955942    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955944    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955946    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955949    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955951    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955954    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955956    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955958    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955961    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955963    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955966    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955973    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955976    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955978    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955981    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955983    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955985    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955988    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955990    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955993    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:47:19.962302 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955996    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.955998    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956001    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956003    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956006    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956008    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956011    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956014    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956016    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956019    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956023    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956026    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956029    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956031    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956034    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956037    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956040    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956042    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956045    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:47:19.962883 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956047    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956049    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956052    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956054    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956057    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956064    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956067    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956070    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956072    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956075    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956078    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956080    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956083    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956086    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956088    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956091    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956093    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956096    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956098    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956100    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:47:19.963635 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956103    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956105    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956108    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956112    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956114    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956117    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:19.956119    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.956124    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.956227    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.958230    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.959269    2576 server.go:1019] "Starting client certificate rotation"
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.959392    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.959436    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 23:47:19.964286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.961332    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 23:47:19.966089 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.966070    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 23:47:19.973911 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.973892    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 15 23:47:19.975915 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.975901    2576 log.go:25] "Validated CRI v1 image API"
Jul 15 23:47:19.978833 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.978818    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 23:47:19.980925 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.980904    2576 fs.go:135] Filesystem UUIDs: map[6e69311b-46c9-4a8c-bae6-6f489d482038:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7b5ae274-5491-4579-bbea-8beca6fa9b6c:/dev/nvme0n1p4]
Jul 15 23:47:19.980983 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.980924    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 23:47:19.985669 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.985554    2576 manager.go:216] Machine: {Timestamp:2026-07-15 23:47:19.98449065 +0000 UTC m=+0.251088255 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092250 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25d54db6514cdfd2987699a75e6b08 SystemUUID:ec25d54d-b651-4cdf-d298-7699a75e6b08 BootID:0e58bf5d-c3d6-4df7-972c-b8d56581affc Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ac:b9:42:34:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ac:b9:42:34:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:5e:85:52:2d:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 23:47:19.985669 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.985663    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 23:47:19.985809 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.985738    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 23:47:19.987999 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.987971    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 23:47:19.988125 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.988108    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 23:47:19.988179 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.987999    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 23:47:19.988672 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.988661    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 23:47:19.988721 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.988680    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 23:47:19.988721 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.988691    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 23:47:19.988721 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.988712    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 23:47:19.989944 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.989931    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 23:47:19.993581 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.993567    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 23:47:19.993726 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.993715    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 23:47:19.993793 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.993752    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 23:47:19.993793 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.993766    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 23:47:19.993793 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.993786    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 23:47:19.993906 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.993799    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 15 23:47:19.993906 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.993812    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 23:47:19.994227 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.994213    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 23:47:19.994345 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.994237    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 23:47:19.995992 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.995977    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 23:47:19.997670 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.997656    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 23:47:19.997741 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.997692    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 23:47:19.997887 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.997875    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 23:47:19.997945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.997893    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 23:47:19.997945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.997901    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 23:47:19.997945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.997908    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 23:47:19.997945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.997917    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 23:47:19.997945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.997922    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 23:47:19.998233 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.998223    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 23:47:19.998233 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.998233    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 23:47:19.998292 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.998240    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 23:47:19.998292 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.998245    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 23:47:19.998292 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.998261    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 23:47:19.998292 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.998269    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 23:47:19.998840 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.998830    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 23:47:19.998840 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:19.998840    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 23:47:20.003545 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.003531    2576 server.go:1268] "Started kubelet"
Jul 15 23:47:20.004189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.003852    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 23:47:20.004189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.003885    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 23:47:20.004189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.003910    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 23:47:20.004189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.003966    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 23:47:20.004393 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.004267    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 23:47:20.004393 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.004265    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 23:47:20.004495 ip-10-0-140-110 systemd[1]: Started Kubernetes Kubelet.
Jul 15 23:47:20.005751 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.005735    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 23:47:20.007701 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.007675    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 23:47:20.007905 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.007889    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 23:47:20.008930 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.008243    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-110.ec2.internal.18c29b603b22da25  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-110.ec2.internal,UID:ip-10-0-140-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-110.ec2.internal,},FirstTimestamp:2026-07-15 23:47:20.003443237 +0000 UTC m=+0.270040846,LastTimestamp:2026-07-15 23:47:20.003443237 +0000 UTC m=+0.270040846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-110.ec2.internal,}"
Jul 15 23:47:20.009390 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.009375    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvjkf"
Jul 15 23:47:20.011799 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.011786    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 23:47:20.011870 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.011802    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 23:47:20.011870 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.011855    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.012277 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012261    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 23:47:20.012373 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012293    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 23:47:20.012516 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012500    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 23:47:20.012638 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012622    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 23:47:20.012638 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012634    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 23:47:20.012784 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012651    2576 factory.go:55] Registering systemd factory
Jul 15 23:47:20.012784 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012665    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 15 23:47:20.012943 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012930    2576 factory.go:153] Registering CRI-O factory
Jul 15 23:47:20.012943 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012944    2576 factory.go:223] Registration of the crio container factory successfully
Jul 15 23:47:20.013064 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.012988    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 23:47:20.013064 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.013006    2576 factory.go:103] Registering Raw factory
Jul 15 23:47:20.013064 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.013016    2576 manager.go:1196] Started watching for new ooms in manager
Jul 15 23:47:20.013414 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.013404    2576 manager.go:349] Starting recovery of all containers
Jul 15 23:47:20.014834 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.014810    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvjkf"
Jul 15 23:47:20.017805 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.017778    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 23:47:20.017888 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.017848    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 23:47:20.023237 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.023216    2576 manager.go:354] Recovery completed
Jul 15 23:47:20.030170 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.030155    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:47:20.031999 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.031912    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:47:20.031999 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.031946    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:47:20.031999 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.031963    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:47:20.032546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.032530    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 23:47:20.032546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.032546    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 23:47:20.032690 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.032548    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:47:20.032690 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.032596    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 23:47:20.033282 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.033262    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:47:20.033345 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.033302    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:47:20.033345 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.033318    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:47:20.034820 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.034806    2576 policy_none.go:49] "None policy: Start"
Jul 15 23:47:20.034888 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.034825    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 23:47:20.034888 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.034840    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 23:47:20.037017 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.037004    2576 policy_none.go:47] "Start"
Jul 15 23:47:20.078342 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.078228    2576 manager.go:337] "Starting Device Plugin manager"
Jul 15 23:47:20.078436 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.078360    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 23:47:20.078436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.078374    2576 server.go:87] "Starting device plugin registration server"
Jul 15 23:47:20.078635 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.078604    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 23:47:20.078635 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.078618    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 23:47:20.078747 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.078733    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 23:47:20.078931 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.078864    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 23:47:20.078931 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.078882    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 23:47:20.079304 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.079283    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 23:47:20.079447 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.079348    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.178746 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.178717    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:47:20.181214 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.179247    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 23:47:20.181214 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.179738    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:47:20.181214 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.179764    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:47:20.181214 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.179775    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:47:20.181214 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.179806    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.181214 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.180586    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 23:47:20.181214 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.180623    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 23:47:20.181214 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.180646    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 23:47:20.181214 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.180701    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 23:47:20.182813 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.182791    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:47:20.188115 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.188095    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.188217 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.188119    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-110.ec2.internal\": node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.219962 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.219893    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.281089 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.281039    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal"]
Jul 15 23:47:20.281282 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.281141    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:47:20.285162 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.285144    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:47:20.285250 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.285176    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:47:20.285250 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.285186    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:47:20.287768 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.287752    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:47:20.287901 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.287885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.287953 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.287919    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:47:20.288508 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.288492    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:47:20.288562 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.288521    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:47:20.288562 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.288533    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:47:20.289073 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.289057    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:47:20.289156 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.289083    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:47:20.289156 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.289098    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:47:20.291566 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.291548    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.291637 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.291602    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:47:20.292403 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.292386    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:47:20.292495 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.292410    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:47:20.292495 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.292421    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:47:20.314286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.314260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d4532858afc2d1bac9188abd35243f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal\" (UID: \"4d4532858afc2d1bac9188abd35243f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.314395 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.314287    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4532858afc2d1bac9188abd35243f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal\" (UID: \"4d4532858afc2d1bac9188abd35243f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.314395 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.314308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d83b6c4466b41c709fe7423fe0495f53-config\") pod \"kube-apiserver-proxy-ip-10-0-140-110.ec2.internal\" (UID: \"d83b6c4466b41c709fe7423fe0495f53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.314508 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.314449    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-110.ec2.internal\" not found" node="ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.319273 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.319256    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-110.ec2.internal\" not found" node="ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.320269 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.320253    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.414945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.414909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d4532858afc2d1bac9188abd35243f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal\" (UID: \"4d4532858afc2d1bac9188abd35243f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.414945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.414945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4532858afc2d1bac9188abd35243f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal\" (UID: \"4d4532858afc2d1bac9188abd35243f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.415145 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.414963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d83b6c4466b41c709fe7423fe0495f53-config\") pod \"kube-apiserver-proxy-ip-10-0-140-110.ec2.internal\" (UID: \"d83b6c4466b41c709fe7423fe0495f53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.415145 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.415032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d83b6c4466b41c709fe7423fe0495f53-config\") pod \"kube-apiserver-proxy-ip-10-0-140-110.ec2.internal\" (UID: \"d83b6c4466b41c709fe7423fe0495f53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.415145 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.415040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4532858afc2d1bac9188abd35243f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal\" (UID: \"4d4532858afc2d1bac9188abd35243f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.415145 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.415032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d4532858afc2d1bac9188abd35243f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal\" (UID: \"4d4532858afc2d1bac9188abd35243f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.420385 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.420362    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.520645 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.520568    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.619369 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.619334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.621691 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.621653    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.621691 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.621679    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:20.722401 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.722370    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.823200 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.823124    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.924307 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:20.924280    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:20.960813 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.960780    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 23:47:20.961290 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:20.960940    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 23:47:21.012912 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.012881    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:47:21.017849 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.017832    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:47:21.018751 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.018728    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 23:42:20 +0000 UTC" deadline="2028-03-31 10:06:05.079839206 +0000 UTC"
Jul 15 23:47:21.018801 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.018751    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14986h18m44.061090492s"
Jul 15 23:47:21.024740 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:21.024724    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:21.124995 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:21.124902    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:21.225985 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:21.225953    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:21.326952 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:21.326919    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:21.359020 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:21.358986    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83b6c4466b41c709fe7423fe0495f53.slice/crio-4ac09fcd5d4d3be67e52a892b5502684fb1a8cdf4233cd4f65810debad9b6d3f WatchSource:0}: Error finding container 4ac09fcd5d4d3be67e52a892b5502684fb1a8cdf4233cd4f65810debad9b6d3f: Status 404 returned error can't find the container with id 4ac09fcd5d4d3be67e52a892b5502684fb1a8cdf4233cd4f65810debad9b6d3f
Jul 15 23:47:21.368347 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.368328    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:47:21.375285 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:21.375226    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4532858afc2d1bac9188abd35243f5.slice/crio-f0e2b027193f239773a929869a8dc82a7bf33ea1cc3cc84c7b4d2f4bd43d3575 WatchSource:0}: Error finding container f0e2b027193f239773a929869a8dc82a7bf33ea1cc3cc84c7b4d2f4bd43d3575: Status 404 returned error can't find the container with id f0e2b027193f239773a929869a8dc82a7bf33ea1cc3cc84c7b4d2f4bd43d3575
Jul 15 23:47:21.427681 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:21.427655    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-110.ec2.internal\" not found"
Jul 15 23:47:21.464369 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.464347    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:47:21.512502 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.512459    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:21.525428 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.525394    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 23:47:21.526256 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.526242    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal"
Jul 15 23:47:21.534779 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.534760    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 23:47:21.957851 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.957822    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:47:21.996271 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:21.996248    2576 apiserver.go:52] "Watching apiserver"
Jul 15 23:47:22.003368 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.003343    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 23:47:22.003783 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.003760    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf","openshift-cluster-node-tuning-operator/tuned-dpj29","openshift-dns/node-resolver-sp624","openshift-image-registry/node-ca-sq2n2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal","kube-system/global-pull-secret-syncer-r8zt8","kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal","openshift-multus/multus-additional-cni-plugins-gszhl","openshift-multus/multus-clbsd","openshift-multus/network-metrics-daemon-894z9","openshift-network-diagnostics/network-check-target-lf66r","openshift-network-operator/iptables-alerter-f5hzb","openshift-ovn-kubernetes/ovnkube-node-5ztgd","kube-system/konnectivity-agent-vgndt"]
Jul 15 23:47:22.006702 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.006684    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.008850 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.008829    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 23:47:22.008990 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.008950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.009128 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.009102    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 23:47:22.009128 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.009127    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 23:47:22.009315 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.009111    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-csp52\""
Jul 15 23:47:22.009315 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.009112    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 23:47:22.010757 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.010740    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:47:22.011266 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.011242    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2gsdh\""
Jul 15 23:47:22.011266 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.011261    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 23:47:22.011417 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.011388    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 23:47:22.011467 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.011437    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:22.011539 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.011515    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:22.012798 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.012781    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 23:47:22.014216 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.014196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.016278 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.016211    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 23:47:22.016278 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.016214    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 23:47:22.016278 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.016277    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8q5mw\""
Jul 15 23:47:22.016531 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.016215    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 23:47:22.016781 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.016760    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.016872 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.016830    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:22.019987 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.019966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.021289 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.021269    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 23:47:22.021986 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.021887    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 23:47:22.021986 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.021932    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 23:47:22.022155 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.021886    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4q4rg\""
Jul 15 23:47:22.022298 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.022281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.024134 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.024115    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ln2q5\""
Jul 15 23:47:22.024307 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.024288    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 23:47:22.024436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.024413    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 23:47:22.025258 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.025228    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.027065 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.027037    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 23:47:22.027274 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.027152    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 23:47:22.028545 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.028189    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x4p8z\""
Jul 15 23:47:22.028545 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.028433    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 23:47:22.029107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.028560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-os-release\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.029107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.028582    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:22.029107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.028596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-run-netns\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.029107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.028629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-multus-conf-dir\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.029107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.028660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/904092ee-d93d-42c9-b158-817e418994f5-multus-daemon-config\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.029107 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.028699    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:22.029107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.028711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc01cea1-c0ef-492e-9dbc-2a1e27a31d35-host-slash\") pod \"iptables-alerter-f5hzb\" (UID: \"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35\") " pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.029107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.028743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-var-lib-cni-multus\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-hostroot\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-etc-kubernetes\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77zv9\" (UniqueName: \"kubernetes.io/projected/cc01cea1-c0ef-492e-9dbc-2a1e27a31d35-kube-api-access-77zv9\") pod \"iptables-alerter-f5hzb\" (UID: \"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35\") " pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rdjw\" (UniqueName: \"kubernetes.io/projected/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-kube-api-access-2rdjw\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/897f585f-c3d5-4d52-ab8f-1dd1b900f750-host\") pod \"node-ca-sq2n2\" (UID: \"897f585f-c3d5-4d52-ab8f-1dd1b900f750\") " pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-multus-socket-dir-parent\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-run-k8s-cni-cncf-io\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-var-lib-kubelet\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/897f585f-c3d5-4d52-ab8f-1dd1b900f750-serviceca\") pod \"node-ca-sq2n2\" (UID: \"897f585f-c3d5-4d52-ab8f-1dd1b900f750\") " pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v62j\" (UniqueName: \"kubernetes.io/projected/897f585f-c3d5-4d52-ab8f-1dd1b900f750-kube-api-access-5v62j\") pod \"node-ca-sq2n2\" (UID: \"897f585f-c3d5-4d52-ab8f-1dd1b900f750\") " pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-system-cni-dir\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-cnibin\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029867    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/904092ee-d93d-42c9-b158-817e418994f5-cni-binary-copy\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-var-lib-cni-bin\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-run-multus-certs\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.030223 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.029977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnvsr\" (UniqueName: \"kubernetes.io/projected/904092ee-d93d-42c9-b158-817e418994f5-kube-api-access-fnvsr\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.031035 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.030038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc01cea1-c0ef-492e-9dbc-2a1e27a31d35-iptables-alerter-script\") pod \"iptables-alerter-f5hzb\" (UID: \"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35\") " pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.031035 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.030082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-multus-cni-dir\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.031713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.031647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.033834 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.033797    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-862th\""
Jul 15 23:47:22.034046 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.034026    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:47:22.034273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.034253    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 23:47:22.036888 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.036182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.038410 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.038091    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 23:47:22.038410 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.038182    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 23:47:22.038578 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.038563    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 23:47:22.038672 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.038641    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rnhhl\""
Jul 15 23:47:22.038982 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.038962    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 23:47:22.039070 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.038979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:22.039713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.039535    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 23:47:22.039713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.039595    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 23:47:22.041490 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.041455    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 23:47:22.041592 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.041550    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 23:47:22.041592 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.041574    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9h5mn\""
Jul 15 23:47:22.065179 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.065144    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nz77q"
Jul 15 23:47:22.072066 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.072047    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nz77q"
Jul 15 23:47:22.114336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.114265    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-var-lib-kubelet\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-system-cni-dir\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131081    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65747fd6-6d9e-446e-b541-c163a45b1414-hosts-file\") pod \"node-resolver-sp624\" (UID: \"65747fd6-6d9e-446e-b541-c163a45b1414\") " pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-log-socket\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131166    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-var-lib-kubelet\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-etc-selinux\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.131273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-cnibin\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvsr\" (UniqueName: \"kubernetes.io/projected/904092ee-d93d-42c9-b158-817e418994f5-kube-api-access-fnvsr\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc01cea1-c0ef-492e-9dbc-2a1e27a31d35-iptables-alerter-script\") pod \"iptables-alerter-f5hzb\" (UID: \"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35\") " pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7k7t\" (UniqueName: \"kubernetes.io/projected/65747fd6-6d9e-446e-b541-c163a45b1414-kube-api-access-r7k7t\") pod \"node-resolver-sp624\" (UID: \"65747fd6-6d9e-446e-b541-c163a45b1414\") " pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-systemd\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/932f4d99-07e9-49da-8b05-8a4605cfcc3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-run-systemd\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-var-lib-cni-multus\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-hostroot\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rdjw\" (UniqueName: \"kubernetes.io/projected/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-kube-api-access-2rdjw\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/932f4d99-07e9-49da-8b05-8a4605cfcc3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-socket-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-kubernetes\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27e33601-f83b-41e7-a5da-adba4ff5326f-agent-certs\") pod \"konnectivity-agent-vgndt\" (UID: \"27e33601-f83b-41e7-a5da-adba4ff5326f\") " pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:22.131885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131870    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-multus-socket-dir-parent\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-run-k8s-cni-cncf-io\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-cni-bin\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-cni-netd\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.131991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-kubelet-config\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-var-lib-cni-bin\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-run-openvswitch\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-run-ovn\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-node-log\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e67d1976-528e-4da7-a090-1adf0805ca78-env-overrides\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-sysctl-d\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-multus-conf-dir\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwjxb\" (UniqueName: \"kubernetes.io/projected/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-kube-api-access-zwjxb\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-modprobe-d\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-lib-modules\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-tuned\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxwjj\" (UniqueName: \"kubernetes.io/projected/8ed0a5a5-bf29-454a-b141-ed896176f3e3-kube-api-access-lxwjj\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.132713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77zv9\" (UniqueName: \"kubernetes.io/projected/cc01cea1-c0ef-492e-9dbc-2a1e27a31d35-kube-api-access-77zv9\") pod \"iptables-alerter-f5hzb\" (UID: \"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35\") " pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7nk2\" (UniqueName: \"kubernetes.io/projected/e67d1976-528e-4da7-a090-1adf0805ca78-kube-api-access-w7nk2\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-sys\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/897f585f-c3d5-4d52-ab8f-1dd1b900f750-serviceca\") pod \"node-ca-sq2n2\" (UID: \"897f585f-c3d5-4d52-ab8f-1dd1b900f750\") " pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v62j\" (UniqueName: \"kubernetes.io/projected/897f585f-c3d5-4d52-ab8f-1dd1b900f750-kube-api-access-5v62j\") pod \"node-ca-sq2n2\" (UID: \"897f585f-c3d5-4d52-ab8f-1dd1b900f750\") " pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-dbus\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-device-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27e33601-f83b-41e7-a5da-adba4ff5326f-konnectivity-ca\") pod \"konnectivity-agent-vgndt\" (UID: \"27e33601-f83b-41e7-a5da-adba4ff5326f\") " pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-run-ovn-kubernetes\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e67d1976-528e-4da7-a090-1adf0805ca78-ovnkube-config\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/904092ee-d93d-42c9-b158-817e418994f5-cni-binary-copy\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65747fd6-6d9e-446e-b541-c163a45b1414-tmp-dir\") pod \"node-resolver-sp624\" (UID: \"65747fd6-6d9e-446e-b541-c163a45b1414\") " pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-registration-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-etc-kubernetes\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/897f585f-c3d5-4d52-ab8f-1dd1b900f750-host\") pod \"node-ca-sq2n2\" (UID: \"897f585f-c3d5-4d52-ab8f-1dd1b900f750\") " pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-run-netns\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.133642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.132979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-var-lib-openvswitch\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-sys-fs\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-run\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-host\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ed0a5a5-bf29-454a-b141-ed896176f3e3-tmp\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/932f4d99-07e9-49da-8b05-8a4605cfcc3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-systemd-units\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-slash\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e67d1976-528e-4da7-a090-1adf0805ca78-ovn-node-metrics-cert\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-sysctl-conf\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-system-cni-dir\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-run-multus-certs\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133730    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-system-cni-dir\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-kubelet\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-etc-openvswitch\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e67d1976-528e-4da7-a090-1adf0805ca78-ovnkube-script-lib\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.136591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-sysconfig\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133902    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-multus-cni-dir\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.133969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-os-release\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-run-netns\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/904092ee-d93d-42c9-b158-817e418994f5-multus-daemon-config\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc01cea1-c0ef-492e-9dbc-2a1e27a31d35-host-slash\") pod \"iptables-alerter-f5hzb\" (UID: \"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35\") " pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-cnibin\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/897f585f-c3d5-4d52-ab8f-1dd1b900f750-host\") pod \"node-ca-sq2n2\" (UID: \"897f585f-c3d5-4d52-ab8f-1dd1b900f750\") " pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm8pj\" (UniqueName: \"kubernetes.io/projected/932f4d99-07e9-49da-8b05-8a4605cfcc3e-kube-api-access-tm8pj\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-var-lib-kubelet\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-os-release\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.134391    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-run-multus-certs\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.134492    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs podName:205b6fb8-3a06-4ccb-9b02-b60b25ae90d7 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:22.634470519 +0000 UTC m=+2.901068119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs") pod "network-metrics-daemon-894z9" (UID: "205b6fb8-3a06-4ccb-9b02-b60b25ae90d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/897f585f-c3d5-4d52-ab8f-1dd1b900f750-serviceca\") pod \"node-ca-sq2n2\" (UID: \"897f585f-c3d5-4d52-ab8f-1dd1b900f750\") " pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134720    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-cnibin\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.134977    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-var-lib-cni-multus\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.137455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-hostroot\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc01cea1-c0ef-492e-9dbc-2a1e27a31d35-iptables-alerter-script\") pod \"iptables-alerter-f5hzb\" (UID: \"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35\") " pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135208    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-etc-kubernetes\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc01cea1-c0ef-492e-9dbc-2a1e27a31d35-host-slash\") pod \"iptables-alerter-f5hzb\" (UID: \"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35\") " pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-run-k8s-cni-cncf-io\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-multus-conf-dir\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135455    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/904092ee-d93d-42c9-b158-817e418994f5-cni-binary-copy\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135508    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-var-lib-cni-bin\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-multus-socket-dir-parent\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-os-release\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.135582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-host-run-netns\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.137387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/904092ee-d93d-42c9-b158-817e418994f5-multus-cni-dir\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.138361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.137446    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/904092ee-d93d-42c9-b158-817e418994f5-multus-daemon-config\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.144074 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.144050    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 23:47:22.149267 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.149221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77zv9\" (UniqueName: \"kubernetes.io/projected/cc01cea1-c0ef-492e-9dbc-2a1e27a31d35-kube-api-access-77zv9\") pod \"iptables-alerter-f5hzb\" (UID: \"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35\") " pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.149267 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.149244    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rdjw\" (UniqueName: \"kubernetes.io/projected/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-kube-api-access-2rdjw\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:22.149580 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.149545    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v62j\" (UniqueName: \"kubernetes.io/projected/897f585f-c3d5-4d52-ab8f-1dd1b900f750-kube-api-access-5v62j\") pod \"node-ca-sq2n2\" (UID: \"897f585f-c3d5-4d52-ab8f-1dd1b900f750\") " pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.150707 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.150636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnvsr\" (UniqueName: \"kubernetes.io/projected/904092ee-d93d-42c9-b158-817e418994f5-kube-api-access-fnvsr\") pod \"multus-clbsd\" (UID: \"904092ee-d93d-42c9-b158-817e418994f5\") " pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.190748 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.190614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal" event={"ID":"4d4532858afc2d1bac9188abd35243f5","Type":"ContainerStarted","Data":"f0e2b027193f239773a929869a8dc82a7bf33ea1cc3cc84c7b4d2f4bd43d3575"}
Jul 15 23:47:22.192706 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.192411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal" event={"ID":"d83b6c4466b41c709fe7423fe0495f53","Type":"ContainerStarted","Data":"4ac09fcd5d4d3be67e52a892b5502684fb1a8cdf4233cd4f65810debad9b6d3f"}
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235259    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-run-openvswitch\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-run-ovn\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-node-log\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e67d1976-528e-4da7-a090-1adf0805ca78-env-overrides\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-sysctl-d\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwjxb\" (UniqueName: \"kubernetes.io/projected/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-kube-api-access-zwjxb\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-modprobe-d\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-lib-modules\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-tuned\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxwjj\" (UniqueName: \"kubernetes.io/projected/8ed0a5a5-bf29-454a-b141-ed896176f3e3-kube-api-access-lxwjj\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7nk2\" (UniqueName: \"kubernetes.io/projected/e67d1976-528e-4da7-a090-1adf0805ca78-kube-api-access-w7nk2\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-sys\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-dbus\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-device-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27e33601-f83b-41e7-a5da-adba4ff5326f-konnectivity-ca\") pod \"konnectivity-agent-vgndt\" (UID: \"27e33601-f83b-41e7-a5da-adba4ff5326f\") " pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:22.236796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-run-ovn-kubernetes\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e67d1976-528e-4da7-a090-1adf0805ca78-ovnkube-config\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65747fd6-6d9e-446e-b541-c163a45b1414-tmp-dir\") pod \"node-resolver-sp624\" (UID: \"65747fd6-6d9e-446e-b541-c163a45b1414\") " pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-registration-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-run-netns\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-var-lib-openvswitch\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-sys-fs\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-run\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-host\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ed0a5a5-bf29-454a-b141-ed896176f3e3-tmp\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/932f4d99-07e9-49da-8b05-8a4605cfcc3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.235978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-systemd-units\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-slash\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e67d1976-528e-4da7-a090-1adf0805ca78-ovn-node-metrics-cert\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-sysctl-conf\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-kubelet\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-etc-openvswitch\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.237715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e67d1976-528e-4da7-a090-1adf0805ca78-ovnkube-script-lib\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-sysconfig\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-cnibin\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8pj\" (UniqueName: \"kubernetes.io/projected/932f4d99-07e9-49da-8b05-8a4605cfcc3e-kube-api-access-tm8pj\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-var-lib-kubelet\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-os-release\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-system-cni-dir\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65747fd6-6d9e-446e-b541-c163a45b1414-hosts-file\") pod \"node-resolver-sp624\" (UID: \"65747fd6-6d9e-446e-b541-c163a45b1414\") " pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-log-socket\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-etc-selinux\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7k7t\" (UniqueName: \"kubernetes.io/projected/65747fd6-6d9e-446e-b541-c163a45b1414-kube-api-access-r7k7t\") pod \"node-resolver-sp624\" (UID: \"65747fd6-6d9e-446e-b541-c163a45b1414\") " pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-systemd\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/932f4d99-07e9-49da-8b05-8a4605cfcc3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:22.238640 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-run-systemd\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/932f4d99-07e9-49da-8b05-8a4605cfcc3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-socket-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-kubernetes\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27e33601-f83b-41e7-a5da-adba4ff5326f-agent-certs\") pod \"konnectivity-agent-vgndt\" (UID: \"27e33601-f83b-41e7-a5da-adba4ff5326f\") " pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-cni-bin\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-cni-netd\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-kubelet-config\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.236947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-run-openvswitch\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237003    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-run-ovn\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-node-log\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237037    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-kubelet-config\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237358    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65747fd6-6d9e-446e-b541-c163a45b1414-tmp-dir\") pod \"node-resolver-sp624\" (UID: \"65747fd6-6d9e-446e-b541-c163a45b1414\") " pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-sysctl-d\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e67d1976-528e-4da7-a090-1adf0805ca78-env-overrides\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237602    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-registration-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237670    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-var-lib-openvswitch\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.239605 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237732    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-run-netns\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-lib-modules\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-sys-fs\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-run\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237848    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-modprobe-d\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237890    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-host\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-dbus\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-device-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.238222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-run-ovn-kubernetes\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.238469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27e33601-f83b-41e7-a5da-adba4ff5326f-konnectivity-ca\") pod \"konnectivity-agent-vgndt\" (UID: \"27e33601-f83b-41e7-a5da-adba4ff5326f\") " pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.238473    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.238551    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret podName:65f72dc6-a50b-4bd4-a8e7-58d1fc98badb nodeName:}" failed. No retries permitted until 2026-07-15 23:47:22.738528586 +0000 UTC m=+3.005126193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret") pod "global-pull-secret-syncer-r8zt8" (UID: "65f72dc6-a50b-4bd4-a8e7-58d1fc98badb") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.238548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65747fd6-6d9e-446e-b541-c163a45b1414-hosts-file\") pod \"node-resolver-sp624\" (UID: \"65747fd6-6d9e-446e-b541-c163a45b1414\") " pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.238784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-kubernetes\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.238849    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-run-systemd\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.238884    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-log-socket\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.238948    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.240666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239045    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-etc-selinux\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239094    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/932f4d99-07e9-49da-8b05-8a4605cfcc3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239204    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-systemd-units\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239254    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-slash\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239335    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-systemd\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/932f4d99-07e9-49da-8b05-8a4605cfcc3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239508    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-socket-dir\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-cnibin\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-sysctl-conf\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239770    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-kubelet\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-etc-openvswitch\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.239846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/932f4d99-07e9-49da-8b05-8a4605cfcc3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.240016    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-os-release\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.240266    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-var-lib-kubelet\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.240321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-cni-bin\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.240356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e67d1976-528e-4da7-a090-1adf0805ca78-ovnkube-script-lib\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.241734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.240434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-sysconfig\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.242658 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.240757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e67d1976-528e-4da7-a090-1adf0805ca78-host-cni-netd\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.242658 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.237692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ed0a5a5-bf29-454a-b141-ed896176f3e3-sys\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.242658 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.240823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-system-cni-dir\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.242658 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.240966    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/932f4d99-07e9-49da-8b05-8a4605cfcc3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.243123 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.243068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27e33601-f83b-41e7-a5da-adba4ff5326f-agent-certs\") pod \"konnectivity-agent-vgndt\" (UID: \"27e33601-f83b-41e7-a5da-adba4ff5326f\") " pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:22.243217 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.243124    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e67d1976-528e-4da7-a090-1adf0805ca78-ovnkube-config\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.243553 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.243514    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ed0a5a5-bf29-454a-b141-ed896176f3e3-etc-tuned\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.243657 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.243633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e67d1976-528e-4da7-a090-1adf0805ca78-ovn-node-metrics-cert\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.245367 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.245325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ed0a5a5-bf29-454a-b141-ed896176f3e3-tmp\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.247903 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.247402    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwjxb\" (UniqueName: \"kubernetes.io/projected/3c63b8f0-23ae-4441-b10e-3e98ecc7f511-kube-api-access-zwjxb\") pod \"aws-ebs-csi-driver-node-hh4jf\" (UID: \"3c63b8f0-23ae-4441-b10e-3e98ecc7f511\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.248411 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.248076    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:47:22.248411 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.248102    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:47:22.248411 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.248129    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8wb6t for pod openshift-network-diagnostics/network-check-target-lf66r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:22.248411 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.248205    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t podName:33c9778b-ca33-4993-99e1-81abfa9a8568 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:22.748189273 +0000 UTC m=+3.014786883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8wb6t" (UniqueName: "kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t") pod "network-check-target-lf66r" (UID: "33c9778b-ca33-4993-99e1-81abfa9a8568") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:22.251717 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.251658    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxwjj\" (UniqueName: \"kubernetes.io/projected/8ed0a5a5-bf29-454a-b141-ed896176f3e3-kube-api-access-lxwjj\") pod \"tuned-dpj29\" (UID: \"8ed0a5a5-bf29-454a-b141-ed896176f3e3\") " pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.252365 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.252316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7nk2\" (UniqueName: \"kubernetes.io/projected/e67d1976-528e-4da7-a090-1adf0805ca78-kube-api-access-w7nk2\") pod \"ovnkube-node-5ztgd\" (UID: \"e67d1976-528e-4da7-a090-1adf0805ca78\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.252919 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.252878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7k7t\" (UniqueName: \"kubernetes.io/projected/65747fd6-6d9e-446e-b541-c163a45b1414-kube-api-access-r7k7t\") pod \"node-resolver-sp624\" (UID: \"65747fd6-6d9e-446e-b541-c163a45b1414\") " pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.254991 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.254907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8pj\" (UniqueName: \"kubernetes.io/projected/932f4d99-07e9-49da-8b05-8a4605cfcc3e-kube-api-access-tm8pj\") pod \"multus-additional-cni-plugins-gszhl\" (UID: \"932f4d99-07e9-49da-8b05-8a4605cfcc3e\") " pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.318185 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.318083    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-clbsd"
Jul 15 23:47:22.327396 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.327366    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f5hzb"
Jul 15 23:47:22.331484 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:22.331414    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904092ee_d93d_42c9_b158_817e418994f5.slice/crio-bdfb4cb04f9954daef85a7ba29149481a254dd447f7ffdd8d4ee4873f7a18b7f WatchSource:0}: Error finding container bdfb4cb04f9954daef85a7ba29149481a254dd447f7ffdd8d4ee4873f7a18b7f: Status 404 returned error can't find the container with id bdfb4cb04f9954daef85a7ba29149481a254dd447f7ffdd8d4ee4873f7a18b7f
Jul 15 23:47:22.343072 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.343052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sq2n2"
Jul 15 23:47:22.352007 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.351847    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gszhl"
Jul 15 23:47:22.360859 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.360711    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sp624"
Jul 15 23:47:22.367125 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:22.367069    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932f4d99_07e9_49da_8b05_8a4605cfcc3e.slice/crio-c3da44bca8ffb0a0b6c73ad28764b30fb3810a56eebddeb61bb2d3dd95f91224 WatchSource:0}: Error finding container c3da44bca8ffb0a0b6c73ad28764b30fb3810a56eebddeb61bb2d3dd95f91224: Status 404 returned error can't find the container with id c3da44bca8ffb0a0b6c73ad28764b30fb3810a56eebddeb61bb2d3dd95f91224
Jul 15 23:47:22.369929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.369764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf"
Jul 15 23:47:22.377420 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:22.377296    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65747fd6_6d9e_446e_b541_c163a45b1414.slice/crio-4bbabdda36b8cd0e8cec41297fcca98930774980c7965042725ad48f2c0fdf82 WatchSource:0}: Error finding container 4bbabdda36b8cd0e8cec41297fcca98930774980c7965042725ad48f2c0fdf82: Status 404 returned error can't find the container with id 4bbabdda36b8cd0e8cec41297fcca98930774980c7965042725ad48f2c0fdf82
Jul 15 23:47:22.380316 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.380146    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpj29"
Jul 15 23:47:22.385352 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:22.385325    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c63b8f0_23ae_4441_b10e_3e98ecc7f511.slice/crio-61918e5d28d0dd83d6bd1f15abb99c811a4b1001c195a870e5492e31574ada78 WatchSource:0}: Error finding container 61918e5d28d0dd83d6bd1f15abb99c811a4b1001c195a870e5492e31574ada78: Status 404 returned error can't find the container with id 61918e5d28d0dd83d6bd1f15abb99c811a4b1001c195a870e5492e31574ada78
Jul 15 23:47:22.388604 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.388521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:22.394364 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.394337    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:22.395214 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:22.395178    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed0a5a5_bf29_454a_b141_ed896176f3e3.slice/crio-062ce050afcb30e046b5215d3191f0bca9eeac4f9f05edc4ed69e636cc4bb9fc WatchSource:0}: Error finding container 062ce050afcb30e046b5215d3191f0bca9eeac4f9f05edc4ed69e636cc4bb9fc: Status 404 returned error can't find the container with id 062ce050afcb30e046b5215d3191f0bca9eeac4f9f05edc4ed69e636cc4bb9fc
Jul 15 23:47:22.401501 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:22.401442    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67d1976_528e_4da7_a090_1adf0805ca78.slice/crio-52bd388803d23f413657a4ed7721f1749f3c5ca6237b33df021c3ace88da6834 WatchSource:0}: Error finding container 52bd388803d23f413657a4ed7721f1749f3c5ca6237b33df021c3ace88da6834: Status 404 returned error can't find the container with id 52bd388803d23f413657a4ed7721f1749f3c5ca6237b33df021c3ace88da6834
Jul 15 23:47:22.408367 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:47:22.408336    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e33601_f83b_41e7_a5da_adba4ff5326f.slice/crio-1e868603c0e795656456effab0e154ad0bb34e91e817fca7c3b378b3632321b4 WatchSource:0}: Error finding container 1e868603c0e795656456effab0e154ad0bb34e91e817fca7c3b378b3632321b4: Status 404 returned error can't find the container with id 1e868603c0e795656456effab0e154ad0bb34e91e817fca7c3b378b3632321b4
Jul 15 23:47:22.640757 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.640673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:22.640924 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.640899    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:22.640999 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.640991    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs podName:205b6fb8-3a06-4ccb-9b02-b60b25ae90d7 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:23.640963731 +0000 UTC m=+3.907561330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs") pod "network-metrics-daemon-894z9" (UID: "205b6fb8-3a06-4ccb-9b02-b60b25ae90d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:22.741852 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.741819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:22.742028 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.741998    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:22.742099 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.742085    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret podName:65f72dc6-a50b-4bd4-a8e7-58d1fc98badb nodeName:}" failed. No retries permitted until 2026-07-15 23:47:23.742061905 +0000 UTC m=+4.008659500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret") pod "global-pull-secret-syncer-r8zt8" (UID: "65f72dc6-a50b-4bd4-a8e7-58d1fc98badb") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:22.842953 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:22.842917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:22.843131 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.843061    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:47:22.843131 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.843084    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:47:22.843131 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.843095    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8wb6t for pod openshift-network-diagnostics/network-check-target-lf66r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:22.843252 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:22.843155    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t podName:33c9778b-ca33-4993-99e1-81abfa9a8568 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:23.843136689 +0000 UTC m=+4.109734282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wb6t" (UniqueName: "kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t") pod "network-check-target-lf66r" (UID: "33c9778b-ca33-4993-99e1-81abfa9a8568") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:23.075858 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.075707    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 23:42:22 +0000 UTC" deadline="2028-03-20 11:21:24.835310459 +0000 UTC"
Jul 15 23:47:23.075858 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.075747    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14723h34m1.759568756s"
Jul 15 23:47:23.202694 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.202562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gszhl" event={"ID":"932f4d99-07e9-49da-8b05-8a4605cfcc3e","Type":"ContainerStarted","Data":"c3da44bca8ffb0a0b6c73ad28764b30fb3810a56eebddeb61bb2d3dd95f91224"}
Jul 15 23:47:23.214113 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.213992    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-clbsd" event={"ID":"904092ee-d93d-42c9-b158-817e418994f5","Type":"ContainerStarted","Data":"bdfb4cb04f9954daef85a7ba29149481a254dd447f7ffdd8d4ee4873f7a18b7f"}
Jul 15 23:47:23.225506 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.225466    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vgndt" event={"ID":"27e33601-f83b-41e7-a5da-adba4ff5326f","Type":"ContainerStarted","Data":"1e868603c0e795656456effab0e154ad0bb34e91e817fca7c3b378b3632321b4"}
Jul 15 23:47:23.235907 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.235876    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpj29" event={"ID":"8ed0a5a5-bf29-454a-b141-ed896176f3e3","Type":"ContainerStarted","Data":"062ce050afcb30e046b5215d3191f0bca9eeac4f9f05edc4ed69e636cc4bb9fc"}
Jul 15 23:47:23.244238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.244204    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sp624" event={"ID":"65747fd6-6d9e-446e-b541-c163a45b1414","Type":"ContainerStarted","Data":"4bbabdda36b8cd0e8cec41297fcca98930774980c7965042725ad48f2c0fdf82"}
Jul 15 23:47:23.255195 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.255161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sq2n2" event={"ID":"897f585f-c3d5-4d52-ab8f-1dd1b900f750","Type":"ContainerStarted","Data":"ebd66245b361077c757651cfb2a692cf90941c25c1461129043f4263704adb74"}
Jul 15 23:47:23.257710 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.257682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f5hzb" event={"ID":"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35","Type":"ContainerStarted","Data":"fa23da73cd74778234761beb6da492b12cb62b81ffaf730e4bc98b5c242fbba0"}
Jul 15 23:47:23.264193 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.264003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerStarted","Data":"52bd388803d23f413657a4ed7721f1749f3c5ca6237b33df021c3ace88da6834"}
Jul 15 23:47:23.274349 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.274263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf" event={"ID":"3c63b8f0-23ae-4441-b10e-3e98ecc7f511","Type":"ContainerStarted","Data":"61918e5d28d0dd83d6bd1f15abb99c811a4b1001c195a870e5492e31574ada78"}
Jul 15 23:47:23.650933 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.650225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:23.650933 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:23.650443    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:23.650933 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:23.650512    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs podName:205b6fb8-3a06-4ccb-9b02-b60b25ae90d7 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.650491552 +0000 UTC m=+5.917089149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs") pod "network-metrics-daemon-894z9" (UID: "205b6fb8-3a06-4ccb-9b02-b60b25ae90d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:23.751745 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.751698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:23.751997 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:23.751943    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:23.752074 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:23.752055    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret podName:65f72dc6-a50b-4bd4-a8e7-58d1fc98badb nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.752034939 +0000 UTC m=+6.018632537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret") pod "global-pull-secret-syncer-r8zt8" (UID: "65f72dc6-a50b-4bd4-a8e7-58d1fc98badb") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:23.852237 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:23.852198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:23.852440 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:23.852415    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:47:23.852523 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:23.852451    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:47:23.852523 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:23.852466    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8wb6t for pod openshift-network-diagnostics/network-check-target-lf66r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:23.852662 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:23.852530    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t podName:33c9778b-ca33-4993-99e1-81abfa9a8568 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:25.852510736 +0000 UTC m=+6.119108333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wb6t" (UniqueName: "kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t") pod "network-check-target-lf66r" (UID: "33c9778b-ca33-4993-99e1-81abfa9a8568") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:24.076010 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:24.075920    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 23:42:22 +0000 UTC" deadline="2028-03-30 22:55:22.981383884 +0000 UTC"
Jul 15 23:47:24.076010 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:24.075987    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14975h7m58.905400667s"
Jul 15 23:47:24.187451 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:24.186543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:24.187451 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:24.186676    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:24.187451 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:24.187116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:24.187451 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:24.187230    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:24.187451 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:24.187305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:24.187451 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:24.187389    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:25.668349 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:25.668277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:25.668875 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:25.668461    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:25.668875 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:25.668528    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs podName:205b6fb8-3a06-4ccb-9b02-b60b25ae90d7 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:29.668508276 +0000 UTC m=+9.935105872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs") pod "network-metrics-daemon-894z9" (UID: "205b6fb8-3a06-4ccb-9b02-b60b25ae90d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:25.768791 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:25.768742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:25.769032 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:25.768985    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:25.769105 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:25.769090    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret podName:65f72dc6-a50b-4bd4-a8e7-58d1fc98badb nodeName:}" failed. No retries permitted until 2026-07-15 23:47:29.769069393 +0000 UTC m=+10.035666991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret") pod "global-pull-secret-syncer-r8zt8" (UID: "65f72dc6-a50b-4bd4-a8e7-58d1fc98badb") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:25.870044 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:25.869986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:25.870488 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:25.870235    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:47:25.870488 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:25.870261    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:47:25.870488 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:25.870277    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8wb6t for pod openshift-network-diagnostics/network-check-target-lf66r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:25.870488 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:25.870341    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t podName:33c9778b-ca33-4993-99e1-81abfa9a8568 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:29.870321344 +0000 UTC m=+10.136918946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wb6t" (UniqueName: "kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t") pod "network-check-target-lf66r" (UID: "33c9778b-ca33-4993-99e1-81abfa9a8568") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:26.186577 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:26.186044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:26.186577 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:26.186181    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:26.186577 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:26.186170    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:26.186577 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:26.186293    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:26.186577 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:26.186380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:26.186577 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:26.186454    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:28.180928 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:28.180894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:28.181511 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:28.180893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:28.181511 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:28.181296    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:28.181511 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:28.181040    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:28.186739 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:28.182003    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:28.186739 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:28.182909    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:29.702409 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:29.702373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:29.702990 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:29.702545    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:29.702990 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:29.702617    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs podName:205b6fb8-3a06-4ccb-9b02-b60b25ae90d7 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:37.70259697 +0000 UTC m=+17.969194565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs") pod "network-metrics-daemon-894z9" (UID: "205b6fb8-3a06-4ccb-9b02-b60b25ae90d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:29.803696 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:29.803571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:29.803932 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:29.803719    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:29.803932 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:29.803801    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret podName:65f72dc6-a50b-4bd4-a8e7-58d1fc98badb nodeName:}" failed. No retries permitted until 2026-07-15 23:47:37.803779485 +0000 UTC m=+18.070377082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret") pod "global-pull-secret-syncer-r8zt8" (UID: "65f72dc6-a50b-4bd4-a8e7-58d1fc98badb") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:29.904400 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:29.904335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:29.904576 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:29.904522    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:47:29.904576 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:29.904550    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:47:29.904576 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:29.904566    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8wb6t for pod openshift-network-diagnostics/network-check-target-lf66r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:29.904774 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:29.904671    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t podName:33c9778b-ca33-4993-99e1-81abfa9a8568 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:37.90461141 +0000 UTC m=+18.171209005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wb6t" (UniqueName: "kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t") pod "network-check-target-lf66r" (UID: "33c9778b-ca33-4993-99e1-81abfa9a8568") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:30.184895 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:30.184764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:30.184895 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:30.184794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:30.184895 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:30.184764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:30.185141 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:30.184881    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:30.185141 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:30.185001    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:30.185141 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:30.185084    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:32.181555 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:32.181072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:32.181555 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:32.181072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:32.181555 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:32.181227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:32.181555 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:32.181224    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:32.181555 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:32.181319    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:32.181555 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:32.181409    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:34.181304 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:34.181272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:34.181304 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:34.181286    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:34.181784 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:34.181272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:34.181784 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:34.181395    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:34.181784 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:34.181448    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:34.181784 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:34.181505    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:36.184618 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:36.184394    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:36.185083 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:36.184427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:36.185083 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:36.184714    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:36.185083 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:36.184429    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:36.185083 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:36.184806    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:36.185083 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:36.184874    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:37.762898 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:37.762861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:37.763340 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:37.763019    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:37.763340 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:37.763084    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs podName:205b6fb8-3a06-4ccb-9b02-b60b25ae90d7 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:53.763068358 +0000 UTC m=+34.029665950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs") pod "network-metrics-daemon-894z9" (UID: "205b6fb8-3a06-4ccb-9b02-b60b25ae90d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:37.863495 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:37.863465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:37.863642 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:37.863577    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:37.863642 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:37.863641    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret podName:65f72dc6-a50b-4bd4-a8e7-58d1fc98badb nodeName:}" failed. No retries permitted until 2026-07-15 23:47:53.863627253 +0000 UTC m=+34.130224845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret") pod "global-pull-secret-syncer-r8zt8" (UID: "65f72dc6-a50b-4bd4-a8e7-58d1fc98badb") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:37.964673 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:37.964645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:37.964845 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:37.964827    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:47:37.964897 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:37.964849    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:47:37.964897 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:37.964859    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8wb6t for pod openshift-network-diagnostics/network-check-target-lf66r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:37.964981 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:37.964911    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t podName:33c9778b-ca33-4993-99e1-81abfa9a8568 nodeName:}" failed. No retries permitted until 2026-07-15 23:47:53.964894185 +0000 UTC m=+34.231491796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wb6t" (UniqueName: "kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t") pod "network-check-target-lf66r" (UID: "33c9778b-ca33-4993-99e1-81abfa9a8568") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:38.183913 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:38.183800    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:38.184050 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:38.183910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:38.184050 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:38.183920    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:38.184050 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:38.183925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:38.184050 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:38.184035    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:38.184202 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:38.184113    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:40.184266 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:40.184240    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:40.184266 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:40.184250    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:40.184266 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:40.184241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:40.184751 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:40.184338    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:40.184751 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:40.184443    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:40.184751 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:40.184506    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:42.184396 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:42.184368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:42.184763 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:42.184464    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:42.184763 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:42.184480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:42.184763 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:42.184475    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:42.184763 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:42.184553    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:42.184763 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:42.184629    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:43.333044 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.332672    2576 generic.go:356] "Generic (PLEG): container finished" podID="4d4532858afc2d1bac9188abd35243f5" containerID="16e9e34139205b1e2c5b7ae2afa108a4dcf0cc4480891ec35e8c0eb02ee147f5" exitCode=0
Jul 15 23:47:43.333913 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.332798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal" event={"ID":"4d4532858afc2d1bac9188abd35243f5","Type":"ContainerDied","Data":"16e9e34139205b1e2c5b7ae2afa108a4dcf0cc4480891ec35e8c0eb02ee147f5"}
Jul 15 23:47:43.335353 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.335308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal" event={"ID":"d83b6c4466b41c709fe7423fe0495f53","Type":"ContainerStarted","Data":"fc49c81c7aeb535dc72e66e1379162427b2fac144e9e43afbcc89044dff593cc"}
Jul 15 23:47:43.338653 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.338631    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 15 23:47:43.339049 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.339025    2576 generic.go:356] "Generic (PLEG): container finished" podID="e67d1976-528e-4da7-a090-1adf0805ca78" containerID="fed6cd21811899fb3e57c226f1391a55afe8feaa3e389191a72bde5b66f8b650" exitCode=1
Jul 15 23:47:43.339122 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.339105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerStarted","Data":"6c0804b8ab777c8320402fbe78c1d9c8d68454db177ef2d01dc4d7a14d644362"}
Jul 15 23:47:43.339190 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.339172    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerStarted","Data":"28715b81da4672e8c00f17ef8a7e7e0b89d1d0f6b5af3666fb284f72291ddbbd"}
Jul 15 23:47:43.339308 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.339222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerStarted","Data":"9f06ca1120e9340d0cfd3dec3c4b7923acd4c46f832bd45f090345293c23d4d7"}
Jul 15 23:47:43.339308 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.339269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerStarted","Data":"fa2546cda453da536bcececf7c04074216c81941991212e907ccab13b57e3305"}
Jul 15 23:47:43.339446 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.339314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerDied","Data":"fed6cd21811899fb3e57c226f1391a55afe8feaa3e389191a72bde5b66f8b650"}
Jul 15 23:47:43.339446 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.339364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerStarted","Data":"8cd6d907ecfd59c0be6dd89c97eb61f5fdb195fd70a254edd08051d21e558ed3"}
Jul 15 23:47:43.340649 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.340623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf" event={"ID":"3c63b8f0-23ae-4441-b10e-3e98ecc7f511","Type":"ContainerStarted","Data":"763cd6583b74f63aad4e874729c8ebca133a868e81d54c801bd976c4df238085"}
Jul 15 23:47:43.342311 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.342287    2576 generic.go:356] "Generic (PLEG): container finished" podID="932f4d99-07e9-49da-8b05-8a4605cfcc3e" containerID="f658104a5d54dcd6364308b1fe5c6acf7ef6f6c79f9ff0a1c4d513b66d37bfb8" exitCode=0
Jul 15 23:47:43.342406 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.342367    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gszhl" event={"ID":"932f4d99-07e9-49da-8b05-8a4605cfcc3e","Type":"ContainerDied","Data":"f658104a5d54dcd6364308b1fe5c6acf7ef6f6c79f9ff0a1c4d513b66d37bfb8"}
Jul 15 23:47:43.343991 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.343970    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-clbsd" event={"ID":"904092ee-d93d-42c9-b158-817e418994f5","Type":"ContainerStarted","Data":"b272bf040f3c941ac4e577b8c7d8aa562261eafb447b4d60d09ed6723c40c8f9"}
Jul 15 23:47:43.345515 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.345496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vgndt" event={"ID":"27e33601-f83b-41e7-a5da-adba4ff5326f","Type":"ContainerStarted","Data":"32ebeccde851f39c8dc7028ba6712969873f580c41f7f77c2dfca7739f3660b7"}
Jul 15 23:47:43.347289 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.347267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpj29" event={"ID":"8ed0a5a5-bf29-454a-b141-ed896176f3e3","Type":"ContainerStarted","Data":"efc392b82a1dab186afc0196222d471eb43224e590911f6b30c8812a26a9991e"}
Jul 15 23:47:43.348851 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.348822    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sp624" event={"ID":"65747fd6-6d9e-446e-b541-c163a45b1414","Type":"ContainerStarted","Data":"bfc6f6fa3944907569a7872c5c3a8fd7f82d37bd46a40aa9e81f6275d76ae6f8"}
Jul 15 23:47:43.350403 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.350383    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sq2n2" event={"ID":"897f585f-c3d5-4d52-ab8f-1dd1b900f750","Type":"ContainerStarted","Data":"4148cbb92e18832ad921ad68ef5af6c615b938aedf10d7b361c670c4129fb09d"}
Jul 15 23:47:43.377695 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.377646    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-110.ec2.internal" podStartSLOduration=21.377628857 podStartE2EDuration="21.377628857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:43.377062629 +0000 UTC m=+23.643660243" watchObservedRunningTime="2026-07-15 23:47:43.377628857 +0000 UTC m=+23.644226474"
Jul 15 23:47:43.409831 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.409794    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sp624" podStartSLOduration=10.63342915 podStartE2EDuration="22.409782373s" totalImagesPullingTime="11.776353223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:43.409561458 +0000 UTC m=+23.676159072" watchObservedRunningTime="2026-07-15 23:47:43.409782373 +0000 UTC m=+23.676379986"
Jul 15 23:47:43.409917 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.409854    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sq2n2" podStartSLOduration=2.421769926 podStartE2EDuration="22.409850921s" totalImagesPullingTime="19.988080995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:43.390632934 +0000 UTC m=+23.657230547" watchObservedRunningTime="2026-07-15 23:47:43.409850921 +0000 UTC m=+23.676448534"
Jul 15 23:47:43.427316 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.427271    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dpj29" podStartSLOduration=2.457366045 podStartE2EDuration="22.427254195s" totalImagesPullingTime="19.96988815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:43.426681437 +0000 UTC m=+23.693279050" watchObservedRunningTime="2026-07-15 23:47:43.427254195 +0000 UTC m=+23.693851810"
Jul 15 23:47:43.444769 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.444718    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vgndt" podStartSLOduration=10.697141242 podStartE2EDuration="22.444699295s" totalImagesPullingTime="11.747558053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:43.443948653 +0000 UTC m=+23.710546280" watchObservedRunningTime="2026-07-15 23:47:43.444699295 +0000 UTC m=+23.711296913"
Jul 15 23:47:43.459406 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.459363    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-clbsd" podStartSLOduration=3.409782991 podStartE2EDuration="23.459351512s" totalImagesPullingTime="20.049568521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:43.459148812 +0000 UTC m=+23.725746427" watchObservedRunningTime="2026-07-15 23:47:43.459351512 +0000 UTC m=+23.725949127"
Jul 15 23:47:43.642133 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.642066    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:43.642684 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:43.642669    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:44.067764 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.067742    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 23:47:44.092925 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.092806    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T23:47:44.06775771Z","UUID":"f9a889f6-7a60-4299-93ac-c7800c451368","Handler":null,"Name":"","Endpoint":""}
Jul 15 23:47:44.095632 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.095613    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 23:47:44.095740 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.095642    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 23:47:44.184667 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.184564    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:44.184667 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.184580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:44.184667 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.184569    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:44.184953 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:44.184697    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:44.184953 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:44.184834    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:44.184953 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:44.184925    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:44.354254 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.354216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f5hzb" event={"ID":"cc01cea1-c0ef-492e-9dbc-2a1e27a31d35","Type":"ContainerStarted","Data":"bbc0cc201c38ae26d2b61da1a9c23655526367eafff0cb48e96caa1834324765"}
Jul 15 23:47:44.356291 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.356264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal" event={"ID":"4d4532858afc2d1bac9188abd35243f5","Type":"ContainerStarted","Data":"4afcb7de565dcf03a35ad05189a68438b0208f847426ba64d92e2df852016a9f"}
Jul 15 23:47:44.358534 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.358511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf" event={"ID":"3c63b8f0-23ae-4441-b10e-3e98ecc7f511","Type":"ContainerStarted","Data":"06b0b4914c490908b07a1249505142f4b3989b1dc8ce0d1ddadcfd6f1fcd4ac9"}
Jul 15 23:47:44.359009 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.358861    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:44.359545 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.359524    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vgndt"
Jul 15 23:47:44.368595 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.368550    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f5hzb" podStartSLOduration=4.342647443 podStartE2EDuration="24.368533543s" totalImagesPullingTime="20.0258861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:44.368310513 +0000 UTC m=+24.634908127" watchObservedRunningTime="2026-07-15 23:47:44.368533543 +0000 UTC m=+24.635131159"
Jul 15 23:47:44.398644 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:44.398570    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-110.ec2.internal" podStartSLOduration=22.398556024 podStartE2EDuration="22.398556024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:44.397973115 +0000 UTC m=+24.664570733" watchObservedRunningTime="2026-07-15 23:47:44.398556024 +0000 UTC m=+24.665153638"
Jul 15 23:47:46.181774 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:46.181745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:46.182271 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:46.181756    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:46.182271 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:46.181863    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:46.182271 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:46.181985    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:46.182271 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:46.181993    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:46.182271 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:46.182095    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:46.366142 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:46.366117    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 15 23:47:46.366583 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:46.366557    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerStarted","Data":"c30ea1064e438f30fdb52f789dfd82d97090408f7936fdedbfaa1311afbea528"}
Jul 15 23:47:46.368703 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:46.368666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf" event={"ID":"3c63b8f0-23ae-4441-b10e-3e98ecc7f511","Type":"ContainerStarted","Data":"95da64fd0e0b24092b9f6604063952ad939eaba07ecd3885ef73778bc034b62d"}
Jul 15 23:47:46.385483 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:46.385442    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hh4jf" podStartSLOduration=3.018203994 podStartE2EDuration="25.385428721s" totalImagesPullingTime="22.367224727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:46.384990134 +0000 UTC m=+26.651587754" watchObservedRunningTime="2026-07-15 23:47:46.385428721 +0000 UTC m=+26.652026334"
Jul 15 23:47:48.184836 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.184465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:48.185472 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.184509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:48.185472 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:48.184882    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:48.185472 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.184511    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:48.185472 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:48.184923    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:48.185472 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:48.185003    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:48.376802 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.376775    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 15 23:47:48.377178 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.377155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerStarted","Data":"d80ae24e491d4c958ad9ade096b13405d9ba4879badc8e079047380a54e0270e"}
Jul 15 23:47:48.377470 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.377451    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:48.377571 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.377512    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:48.377643 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.377588    2576 scope.go:117] "RemoveContainer" containerID="fed6cd21811899fb3e57c226f1391a55afe8feaa3e389191a72bde5b66f8b650"
Jul 15 23:47:48.382329 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.382298    2576 generic.go:356] "Generic (PLEG): container finished" podID="932f4d99-07e9-49da-8b05-8a4605cfcc3e" containerID="6ee6c44f1defaad462c66ffa008d691855b4dcb84097ea2492cb0d20a85e5296" exitCode=0
Jul 15 23:47:48.382403 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.382351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gszhl" event={"ID":"932f4d99-07e9-49da-8b05-8a4605cfcc3e","Type":"ContainerDied","Data":"6ee6c44f1defaad462c66ffa008d691855b4dcb84097ea2492cb0d20a85e5296"}
Jul 15 23:47:48.394716 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:48.394697    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:49.387750 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:49.387729    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 15 23:47:49.388096 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:49.388075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" event={"ID":"e67d1976-528e-4da7-a090-1adf0805ca78","Type":"ContainerStarted","Data":"79191f219414d9cbf8af7e8cbff9b313bcdcd77881e432eaf2e13d5fccf65a62"}
Jul 15 23:47:49.388294 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:49.388277    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:49.405070 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:49.405044    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:47:49.419918 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:49.419883    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd" podStartSLOduration=8.308977868 podStartE2EDuration="28.419866765s" totalImagesPullingTime="20.110888897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:49.419205969 +0000 UTC m=+29.685803583" watchObservedRunningTime="2026-07-15 23:47:49.419866765 +0000 UTC m=+29.686464379"
Jul 15 23:47:50.184562 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:50.184527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:50.184744 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:50.184649    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:50.184744 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:50.184648    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:50.184744 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:50.184698    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:50.184929 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:50.184799    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:50.184929 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:50.184883    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:50.392511 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:50.392472    2576 generic.go:356] "Generic (PLEG): container finished" podID="932f4d99-07e9-49da-8b05-8a4605cfcc3e" containerID="c9518e4859c844a79a5a63601495add1bb90e2a1cd2b2e94df32cccf98227371" exitCode=0
Jul 15 23:47:50.392901 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:50.392562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gszhl" event={"ID":"932f4d99-07e9-49da-8b05-8a4605cfcc3e","Type":"ContainerDied","Data":"c9518e4859c844a79a5a63601495add1bb90e2a1cd2b2e94df32cccf98227371"}
Jul 15 23:47:52.181171 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:52.181137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:52.181723 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:52.181143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:52.181723 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:52.181267    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:52.181723 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:52.181143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:52.181723 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:52.181300    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:52.181723 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:52.181378    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:52.399863 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:52.399828    2576 generic.go:356] "Generic (PLEG): container finished" podID="932f4d99-07e9-49da-8b05-8a4605cfcc3e" containerID="aadc50138e1b694d30f87454bdfaee22284020e5927c3dbb8584a3d6c0874547" exitCode=0
Jul 15 23:47:52.399863 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:52.399867    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gszhl" event={"ID":"932f4d99-07e9-49da-8b05-8a4605cfcc3e","Type":"ContainerDied","Data":"aadc50138e1b694d30f87454bdfaee22284020e5927c3dbb8584a3d6c0874547"}
Jul 15 23:47:53.779892 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:53.779856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:53.780301 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:53.780027    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:53.780301 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:53.780129    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs podName:205b6fb8-3a06-4ccb-9b02-b60b25ae90d7 nodeName:}" failed. No retries permitted until 2026-07-15 23:48:25.78008328 +0000 UTC m=+66.046680877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs") pod "network-metrics-daemon-894z9" (UID: "205b6fb8-3a06-4ccb-9b02-b60b25ae90d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:47:53.880279 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:53.880215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:53.880530 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:53.880349    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:53.880530 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:53.880420    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret podName:65f72dc6-a50b-4bd4-a8e7-58d1fc98badb nodeName:}" failed. No retries permitted until 2026-07-15 23:48:25.880399294 +0000 UTC m=+66.146996891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret") pod "global-pull-secret-syncer-r8zt8" (UID: "65f72dc6-a50b-4bd4-a8e7-58d1fc98badb") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:47:53.980703 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:53.980664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:53.980881 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:53.980859    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:47:53.980929 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:53.980888    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:47:53.980929 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:53.980903    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8wb6t for pod openshift-network-diagnostics/network-check-target-lf66r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:53.981046 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:53.980963    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t podName:33c9778b-ca33-4993-99e1-81abfa9a8568 nodeName:}" failed. No retries permitted until 2026-07-15 23:48:25.980946754 +0000 UTC m=+66.247544345 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wb6t" (UniqueName: "kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t") pod "network-check-target-lf66r" (UID: "33c9778b-ca33-4993-99e1-81abfa9a8568") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:47:54.181328 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:54.181239    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:54.181328 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:54.181270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:54.181526 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:54.181239    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:54.181526 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:54.181365    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:54.181526 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:54.181455    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:54.181667 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:54.181529    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:56.181859 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:56.181817    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:56.182312 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:56.181827    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:56.182312 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:56.181921    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:56.182312 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:56.182021    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:56.182312 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:56.182053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:56.182312 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:56.182105    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:56.412611 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:56.412569    2576 generic.go:356] "Generic (PLEG): container finished" podID="932f4d99-07e9-49da-8b05-8a4605cfcc3e" containerID="a015a24a245e501ff5d3a713b240bc433aef18ce412ff9c455c02e451f9ba65c" exitCode=0
Jul 15 23:47:56.412753 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:56.412635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gszhl" event={"ID":"932f4d99-07e9-49da-8b05-8a4605cfcc3e","Type":"ContainerDied","Data":"a015a24a245e501ff5d3a713b240bc433aef18ce412ff9c455c02e451f9ba65c"}
Jul 15 23:47:57.418256 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:57.418223    2576 generic.go:356] "Generic (PLEG): container finished" podID="932f4d99-07e9-49da-8b05-8a4605cfcc3e" containerID="afc663deb32cf4a76f5af16ecd201bc0d618eec64414d2d53e3025bb914e0f4a" exitCode=0
Jul 15 23:47:57.418651 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:57.418305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gszhl" event={"ID":"932f4d99-07e9-49da-8b05-8a4605cfcc3e","Type":"ContainerDied","Data":"afc663deb32cf4a76f5af16ecd201bc0d618eec64414d2d53e3025bb914e0f4a"}
Jul 15 23:47:57.768617 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:57.768313    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r8zt8"]
Jul 15 23:47:57.768754 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:57.768662    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:57.768798 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:57.768775    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:47:57.771834 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:57.771806    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lf66r"]
Jul 15 23:47:57.771958 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:57.771899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:57.772462 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:57.772007    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:57.772705 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:57.772685    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-894z9"]
Jul 15 23:47:57.772789 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:57.772777    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:57.772904 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:57.772875    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:58.423732 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:58.423700    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gszhl" event={"ID":"932f4d99-07e9-49da-8b05-8a4605cfcc3e","Type":"ContainerStarted","Data":"f96ce2efe0e4809e1a8f6d86ef8cc4e1b1fd4d4bbddbe373cdb5d2e24cab4b15"}
Jul 15 23:47:58.444667 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:58.444626    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gszhl" podStartSLOduration=7.329425092 podStartE2EDuration="37.444593936s" totalImagesPullingTime="30.115168844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:47:58.444524996 +0000 UTC m=+38.711122609" watchObservedRunningTime="2026-07-15 23:47:58.444593936 +0000 UTC m=+38.711191548"
Jul 15 23:47:59.180822 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:59.180794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:47:59.180990 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:59.180851    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:47:59.180990 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:47:59.180937    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:47:59.180990 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:59.180950    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:47:59.181143 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:59.181030    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:47:59.181143 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:47:59.181075    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:48:01.181646 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:01.181592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:48:01.182254 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:01.181653    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:48:01.182254 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:01.181619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:48:01.182254 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:48:01.181739    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lf66r" podUID="33c9778b-ca33-4993-99e1-81abfa9a8568"
Jul 15 23:48:01.182254 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:48:01.181803    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8zt8" podUID="65f72dc6-a50b-4bd4-a8e7-58d1fc98badb"
Jul 15 23:48:01.182254 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:48:01.181866    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-894z9" podUID="205b6fb8-3a06-4ccb-9b02-b60b25ae90d7"
Jul 15 23:48:02.108773 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.108744    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-110.ec2.internal" event="NodeReady"
Jul 15 23:48:02.108907 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.108860    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 23:48:02.137863 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.137829    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86db6bdb55-flpz9"]
Jul 15 23:48:02.175291 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.175225    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pwgfb"]
Jul 15 23:48:02.175425 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.175342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.177404 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.177378    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 23:48:02.177560 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.177424    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 23:48:02.177709 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.177652    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cf9dq\""
Jul 15 23:48:02.177837 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.177822    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 23:48:02.182052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.182032    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 23:48:02.190377 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.190338    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gq2lm"]
Jul 15 23:48:02.190463 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.190427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.192670 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.192651    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 23:48:02.192775 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.192675    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 23:48:02.192775 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.192714    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 23:48:02.192775 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.192772    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 23:48:02.192914 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.192848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q4vkt\""
Jul 15 23:48:02.208463 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.208443    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86db6bdb55-flpz9"]
Jul 15 23:48:02.208612 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.208585    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gq2lm"
Jul 15 23:48:02.213436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.213360    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 23:48:02.213436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.213412    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jq9d4\""
Jul 15 23:48:02.213436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.213421    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 23:48:02.213677 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.213414    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 23:48:02.216236 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.216217    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pwgfb"]
Jul 15 23:48:02.216339 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.216259    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gq2lm"]
Jul 15 23:48:02.253189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.253157    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z8gwr"]
Jul 15 23:48:02.276070 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.276041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z8gwr"]
Jul 15 23:48:02.276196 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.276153    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.278274 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.278252    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 23:48:02.278387 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.278274    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72cf6\""
Jul 15 23:48:02.278387 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.278294    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 23:48:02.344341 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grnlp\" (UniqueName: \"kubernetes.io/projected/90bf70d5-2d3e-4b42-8fd0-d55d7db967e8-kube-api-access-grnlp\") pod \"ingress-canary-gq2lm\" (UID: \"90bf70d5-2d3e-4b42-8fd0-d55d7db967e8\") " pod="openshift-ingress-canary/ingress-canary-gq2lm"
Jul 15 23:48:02.344507 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91477475-8000-491f-806a-47df0f8e56b0-data-volume\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.344507 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4514d8bb-98a6-45e6-af27-193be26b0dbe-ca-trust-extracted\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.344507 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91477475-8000-491f-806a-47df0f8e56b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.344507 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91477475-8000-491f-806a-47df0f8e56b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.344660 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qwlq\" (UniqueName: \"kubernetes.io/projected/4514d8bb-98a6-45e6-af27-193be26b0dbe-kube-api-access-5qwlq\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.344660 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4514d8bb-98a6-45e6-af27-193be26b0dbe-bound-sa-token\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.344660 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91477475-8000-491f-806a-47df0f8e56b0-crio-socket\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.344753 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90bf70d5-2d3e-4b42-8fd0-d55d7db967e8-cert\") pod \"ingress-canary-gq2lm\" (UID: \"90bf70d5-2d3e-4b42-8fd0-d55d7db967e8\") " pod="openshift-ingress-canary/ingress-canary-gq2lm"
Jul 15 23:48:02.344753 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4514d8bb-98a6-45e6-af27-193be26b0dbe-registry-certificates\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.344753 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4514d8bb-98a6-45e6-af27-193be26b0dbe-trusted-ca\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.344753 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4514d8bb-98a6-45e6-af27-193be26b0dbe-image-registry-private-configuration\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.344867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4514d8bb-98a6-45e6-af27-193be26b0dbe-registry-tls\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.344867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4514d8bb-98a6-45e6-af27-193be26b0dbe-installation-pull-secrets\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.344867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.344810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfd57\" (UniqueName: \"kubernetes.io/projected/91477475-8000-491f-806a-47df0f8e56b0-kube-api-access-xfd57\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.445276 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4514d8bb-98a6-45e6-af27-193be26b0dbe-bound-sa-token\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.445276 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91477475-8000-491f-806a-47df0f8e56b0-crio-socket\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.445276 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d69480-9524-4755-b990-2126aa5d8f2f-tmp-dir\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.445276 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfz26\" (UniqueName: \"kubernetes.io/projected/c1d69480-9524-4755-b990-2126aa5d8f2f-kube-api-access-lfz26\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.445546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90bf70d5-2d3e-4b42-8fd0-d55d7db967e8-cert\") pod \"ingress-canary-gq2lm\" (UID: \"90bf70d5-2d3e-4b42-8fd0-d55d7db967e8\") " pod="openshift-ingress-canary/ingress-canary-gq2lm"
Jul 15 23:48:02.445546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4514d8bb-98a6-45e6-af27-193be26b0dbe-registry-certificates\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.445546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4514d8bb-98a6-45e6-af27-193be26b0dbe-trusted-ca\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.445546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4514d8bb-98a6-45e6-af27-193be26b0dbe-image-registry-private-configuration\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.445546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4514d8bb-98a6-45e6-af27-193be26b0dbe-registry-tls\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.445546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91477475-8000-491f-806a-47df0f8e56b0-crio-socket\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.445854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4514d8bb-98a6-45e6-af27-193be26b0dbe-installation-pull-secrets\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.445854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfd57\" (UniqueName: \"kubernetes.io/projected/91477475-8000-491f-806a-47df0f8e56b0-kube-api-access-xfd57\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.445854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1d69480-9524-4755-b990-2126aa5d8f2f-config-volume\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.445854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grnlp\" (UniqueName: \"kubernetes.io/projected/90bf70d5-2d3e-4b42-8fd0-d55d7db967e8-kube-api-access-grnlp\") pod \"ingress-canary-gq2lm\" (UID: \"90bf70d5-2d3e-4b42-8fd0-d55d7db967e8\") " pod="openshift-ingress-canary/ingress-canary-gq2lm"
Jul 15 23:48:02.445854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91477475-8000-491f-806a-47df0f8e56b0-data-volume\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.445854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4514d8bb-98a6-45e6-af27-193be26b0dbe-ca-trust-extracted\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.445854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91477475-8000-491f-806a-47df0f8e56b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.445854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91477475-8000-491f-806a-47df0f8e56b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.445854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1d69480-9524-4755-b990-2126aa5d8f2f-metrics-tls\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.446260 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.445893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qwlq\" (UniqueName: \"kubernetes.io/projected/4514d8bb-98a6-45e6-af27-193be26b0dbe-kube-api-access-5qwlq\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.446379 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.446354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4514d8bb-98a6-45e6-af27-193be26b0dbe-registry-certificates\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.446463 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.446444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91477475-8000-491f-806a-47df0f8e56b0-data-volume\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.446512 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.446487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4514d8bb-98a6-45e6-af27-193be26b0dbe-ca-trust-extracted\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.446628 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.446585    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4514d8bb-98a6-45e6-af27-193be26b0dbe-trusted-ca\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.446852 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.446744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91477475-8000-491f-806a-47df0f8e56b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.449753 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.449733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4514d8bb-98a6-45e6-af27-193be26b0dbe-installation-pull-secrets\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.449854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.449762    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4514d8bb-98a6-45e6-af27-193be26b0dbe-registry-tls\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.449899 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.449848    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4514d8bb-98a6-45e6-af27-193be26b0dbe-image-registry-private-configuration\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.449899 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.449862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91477475-8000-491f-806a-47df0f8e56b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.449899 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.449892    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90bf70d5-2d3e-4b42-8fd0-d55d7db967e8-cert\") pod \"ingress-canary-gq2lm\" (UID: \"90bf70d5-2d3e-4b42-8fd0-d55d7db967e8\") " pod="openshift-ingress-canary/ingress-canary-gq2lm"
Jul 15 23:48:02.452643 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.452625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4514d8bb-98a6-45e6-af27-193be26b0dbe-bound-sa-token\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.453165 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.453135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grnlp\" (UniqueName: \"kubernetes.io/projected/90bf70d5-2d3e-4b42-8fd0-d55d7db967e8-kube-api-access-grnlp\") pod \"ingress-canary-gq2lm\" (UID: \"90bf70d5-2d3e-4b42-8fd0-d55d7db967e8\") " pod="openshift-ingress-canary/ingress-canary-gq2lm"
Jul 15 23:48:02.453517 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.453503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qwlq\" (UniqueName: \"kubernetes.io/projected/4514d8bb-98a6-45e6-af27-193be26b0dbe-kube-api-access-5qwlq\") pod \"image-registry-86db6bdb55-flpz9\" (UID: \"4514d8bb-98a6-45e6-af27-193be26b0dbe\") " pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.454002 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.453987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfd57\" (UniqueName: \"kubernetes.io/projected/91477475-8000-491f-806a-47df0f8e56b0-kube-api-access-xfd57\") pod \"insights-runtime-extractor-pwgfb\" (UID: \"91477475-8000-491f-806a-47df0f8e56b0\") " pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.486150 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.486117    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:02.498682 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.498657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pwgfb"
Jul 15 23:48:02.521232 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.521208    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gq2lm"
Jul 15 23:48:02.546811 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.546526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1d69480-9524-4755-b990-2126aa5d8f2f-config-volume\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.546944 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.546869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1d69480-9524-4755-b990-2126aa5d8f2f-metrics-tls\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.546944 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.546936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d69480-9524-4755-b990-2126aa5d8f2f-tmp-dir\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.547077 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.546961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfz26\" (UniqueName: \"kubernetes.io/projected/c1d69480-9524-4755-b990-2126aa5d8f2f-kube-api-access-lfz26\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.547232 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.547205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1d69480-9524-4755-b990-2126aa5d8f2f-config-volume\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.547305 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.547280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d69480-9524-4755-b990-2126aa5d8f2f-tmp-dir\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.550049 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.550028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1d69480-9524-4755-b990-2126aa5d8f2f-metrics-tls\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.553885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.553856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfz26\" (UniqueName: \"kubernetes.io/projected/c1d69480-9524-4755-b990-2126aa5d8f2f-kube-api-access-lfz26\") pod \"dns-default-z8gwr\" (UID: \"c1d69480-9524-4755-b990-2126aa5d8f2f\") " pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.584758 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.584728    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:02.734149 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.734062    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gq2lm"]
Jul 15 23:48:02.737098 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.736947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86db6bdb55-flpz9"]
Jul 15 23:48:02.739919 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:02.739883    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90bf70d5_2d3e_4b42_8fd0_d55d7db967e8.slice/crio-b0e61b2f8bf31563404b916e38d0870f86cc8e2d09f9946b18719ac34517d2fb WatchSource:0}: Error finding container b0e61b2f8bf31563404b916e38d0870f86cc8e2d09f9946b18719ac34517d2fb: Status 404 returned error can't find the container with id b0e61b2f8bf31563404b916e38d0870f86cc8e2d09f9946b18719ac34517d2fb
Jul 15 23:48:02.741185 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:02.741159    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4514d8bb_98a6_45e6_af27_193be26b0dbe.slice/crio-bc9b4497740ebea73ba45bdbc1ed98b0fee60c5f2a3b9cba90116910700f17bb WatchSource:0}: Error finding container bc9b4497740ebea73ba45bdbc1ed98b0fee60c5f2a3b9cba90116910700f17bb: Status 404 returned error can't find the container with id bc9b4497740ebea73ba45bdbc1ed98b0fee60c5f2a3b9cba90116910700f17bb
Jul 15 23:48:02.745929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.745907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pwgfb"]
Jul 15 23:48:02.748736 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:02.748716    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91477475_8000_491f_806a_47df0f8e56b0.slice/crio-494c6e964f3ff16a15f9136e2772b88f4fa2adb2085ecc728dff531d5bfcd665 WatchSource:0}: Error finding container 494c6e964f3ff16a15f9136e2772b88f4fa2adb2085ecc728dff531d5bfcd665: Status 404 returned error can't find the container with id 494c6e964f3ff16a15f9136e2772b88f4fa2adb2085ecc728dff531d5bfcd665
Jul 15 23:48:02.791170 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:02.791148    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z8gwr"]
Jul 15 23:48:02.800769 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:02.800730    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d69480_9524_4755_b990_2126aa5d8f2f.slice/crio-b8dd532dd067e58a88588cab2dfd59ecbb9b65988d3948c6ea194bbf0b0ed3c9 WatchSource:0}: Error finding container b8dd532dd067e58a88588cab2dfd59ecbb9b65988d3948c6ea194bbf0b0ed3c9: Status 404 returned error can't find the container with id b8dd532dd067e58a88588cab2dfd59ecbb9b65988d3948c6ea194bbf0b0ed3c9
Jul 15 23:48:03.180886 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.180853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:48:03.181082 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.180958    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:48:03.181082 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.180995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:48:03.183258 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.183236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwsxh\""
Jul 15 23:48:03.183827 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.183806    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 23:48:03.183945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.183877    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 23:48:03.183945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.183886    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 23:48:03.193995 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.193872    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2fgm\""
Jul 15 23:48:03.193995 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.193877    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 23:48:03.438895 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.438801    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86db6bdb55-flpz9" event={"ID":"4514d8bb-98a6-45e6-af27-193be26b0dbe","Type":"ContainerStarted","Data":"3f4bb6db8cae23ea0c0a0f75c6d74bb4cb234c0fab8841ce1d4ca17af639bea0"}
Jul 15 23:48:03.438895 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.438866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86db6bdb55-flpz9" event={"ID":"4514d8bb-98a6-45e6-af27-193be26b0dbe","Type":"ContainerStarted","Data":"bc9b4497740ebea73ba45bdbc1ed98b0fee60c5f2a3b9cba90116910700f17bb"}
Jul 15 23:48:03.439095 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.439043    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:03.441589 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.441534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gq2lm" event={"ID":"90bf70d5-2d3e-4b42-8fd0-d55d7db967e8","Type":"ContainerStarted","Data":"b0e61b2f8bf31563404b916e38d0870f86cc8e2d09f9946b18719ac34517d2fb"}
Jul 15 23:48:03.444470 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.444445    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwgfb" event={"ID":"91477475-8000-491f-806a-47df0f8e56b0","Type":"ContainerStarted","Data":"494c6e964f3ff16a15f9136e2772b88f4fa2adb2085ecc728dff531d5bfcd665"}
Jul 15 23:48:03.447079 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.447041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z8gwr" event={"ID":"c1d69480-9524-4755-b990-2126aa5d8f2f","Type":"ContainerStarted","Data":"b8dd532dd067e58a88588cab2dfd59ecbb9b65988d3948c6ea194bbf0b0ed3c9"}
Jul 15 23:48:03.458005 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:03.457020    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86db6bdb55-flpz9" podStartSLOduration=7.456993917 podStartE2EDuration="7.456993917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:03.456106285 +0000 UTC m=+43.722703901" watchObservedRunningTime="2026-07-15 23:48:03.456993917 +0000 UTC m=+43.723591532"
Jul 15 23:48:10.466107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:10.465889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwgfb" event={"ID":"91477475-8000-491f-806a-47df0f8e56b0","Type":"ContainerStarted","Data":"2651c6579561c6c71dafd4e7bf610c8ce38565eedc669a79ea7306a295e59264"}
Jul 15 23:48:10.467671 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:10.467639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z8gwr" event={"ID":"c1d69480-9524-4755-b990-2126aa5d8f2f","Type":"ContainerStarted","Data":"7ed44f3c8936e2a8501b7a3683c25fe3b739ee087214eaabc58efde0e1294dda"}
Jul 15 23:48:10.467808 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:10.467696    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z8gwr" event={"ID":"c1d69480-9524-4755-b990-2126aa5d8f2f","Type":"ContainerStarted","Data":"0b2892f4b60ee6bdf6baeae84825f041f5e184cd177b847b5ad56985db280772"}
Jul 15 23:48:10.467808 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:10.467737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:10.468973 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:10.468952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gq2lm" event={"ID":"90bf70d5-2d3e-4b42-8fd0-d55d7db967e8","Type":"ContainerStarted","Data":"fdc88d1061679e4f95b6c5a527ba7f70fc36ac864fa83d2568cff2a733b00ef3"}
Jul 15 23:48:10.484444 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:10.484397    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z8gwr" podStartSLOduration=1.264969124 podStartE2EDuration="8.484384286s" totalImagesPullingTime="7.219415162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:10.483463765 +0000 UTC m=+50.750061376" watchObservedRunningTime="2026-07-15 23:48:10.484384286 +0000 UTC m=+50.750981900"
Jul 15 23:48:10.499485 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:10.499442    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gq2lm" podStartSLOduration=1.219780236 podStartE2EDuration="8.499430088s" totalImagesPullingTime="7.279649852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:10.498364979 +0000 UTC m=+50.764962585" watchObservedRunningTime="2026-07-15 23:48:10.499430088 +0000 UTC m=+50.766027680"
Jul 15 23:48:12.601932 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:12.601723    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"]
Jul 15 23:48:12.737789 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:12.737747    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"]
Jul 15 23:48:12.737979 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:12.737789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"
Jul 15 23:48:12.740060 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:12.740037    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 23:48:12.740190 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:12.740140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kzzhd\""
Jul 15 23:48:12.820811 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:12.820781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9c1a651f-75e4-4997-8b65-d147e5f7ff05-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hqf4p\" (UID: \"9c1a651f-75e4-4997-8b65-d147e5f7ff05\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"
Jul 15 23:48:12.921721 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:12.921685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9c1a651f-75e4-4997-8b65-d147e5f7ff05-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hqf4p\" (UID: \"9c1a651f-75e4-4997-8b65-d147e5f7ff05\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"
Jul 15 23:48:12.926761 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:12.926727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9c1a651f-75e4-4997-8b65-d147e5f7ff05-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hqf4p\" (UID: \"9c1a651f-75e4-4997-8b65-d147e5f7ff05\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"
Jul 15 23:48:13.048503 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:13.048465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"
Jul 15 23:48:14.274770 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:14.274738    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"]
Jul 15 23:48:14.278930 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:14.278905    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1a651f_75e4_4997_8b65_d147e5f7ff05.slice/crio-b104da12dabfb2b0c12544faf4c056d9c3dc09aa5b313282783b7741f9c3fe74 WatchSource:0}: Error finding container b104da12dabfb2b0c12544faf4c056d9c3dc09aa5b313282783b7741f9c3fe74: Status 404 returned error can't find the container with id b104da12dabfb2b0c12544faf4c056d9c3dc09aa5b313282783b7741f9c3fe74
Jul 15 23:48:14.483043 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:14.483008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p" event={"ID":"9c1a651f-75e4-4997-8b65-d147e5f7ff05","Type":"ContainerStarted","Data":"b104da12dabfb2b0c12544faf4c056d9c3dc09aa5b313282783b7741f9c3fe74"}
Jul 15 23:48:15.488697 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:15.488475    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwgfb" event={"ID":"91477475-8000-491f-806a-47df0f8e56b0","Type":"ContainerStarted","Data":"0b15a72b4fc4b176cb68ed3dff2ee046199248eb7b653316b20e1e2113ace67a"}
Jul 15 23:48:16.493077 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.493041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p" event={"ID":"9c1a651f-75e4-4997-8b65-d147e5f7ff05","Type":"ContainerStarted","Data":"04f1e15c6415a2211e4b6d906a9fb0c2feaa39032d34737d0ccec82150fec32d"}
Jul 15 23:48:16.493713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.493285    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"
Jul 15 23:48:16.498981 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.498954    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p"
Jul 15 23:48:16.507367 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.507316    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hqf4p" podStartSLOduration=3.347240007 podStartE2EDuration="4.507300055s" totalImagesPullingTime="1.160060048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:16.506690213 +0000 UTC m=+56.773287828" watchObservedRunningTime="2026-07-15 23:48:16.507300055 +0000 UTC m=+56.773897671"
Jul 15 23:48:16.663113 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.663083    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wbf8x"]
Jul 15 23:48:16.667984 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.667958    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.670346 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.670297    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 23:48:16.670462 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.670300    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9hn6s\""
Jul 15 23:48:16.670462 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.670302    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 23:48:16.670589 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.670575    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 23:48:16.670773 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.670753    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 23:48:16.670880 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.670778    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 23:48:16.677521 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.677387    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wbf8x"]
Jul 15 23:48:16.752969 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.752894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bd5c230-bc5d-493c-86f2-a257aa8779ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.752969 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.752959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd5c230-bc5d-493c-86f2-a257aa8779ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.753159 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.753072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctwfq\" (UniqueName: \"kubernetes.io/projected/1bd5c230-bc5d-493c-86f2-a257aa8779ca-kube-api-access-ctwfq\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.753159 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.753111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bd5c230-bc5d-493c-86f2-a257aa8779ca-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.854246 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.854212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bd5c230-bc5d-493c-86f2-a257aa8779ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.854428 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.854285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd5c230-bc5d-493c-86f2-a257aa8779ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.854428 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.854338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwfq\" (UniqueName: \"kubernetes.io/projected/1bd5c230-bc5d-493c-86f2-a257aa8779ca-kube-api-access-ctwfq\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.854428 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.854361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bd5c230-bc5d-493c-86f2-a257aa8779ca-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.855198 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.855152    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bd5c230-bc5d-493c-86f2-a257aa8779ca-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.858280 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.858253    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bd5c230-bc5d-493c-86f2-a257aa8779ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.858280 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.858274    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd5c230-bc5d-493c-86f2-a257aa8779ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.861764 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.861719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctwfq\" (UniqueName: \"kubernetes.io/projected/1bd5c230-bc5d-493c-86f2-a257aa8779ca-kube-api-access-ctwfq\") pod \"prometheus-operator-64785b6675-wbf8x\" (UID: \"1bd5c230-bc5d-493c-86f2-a257aa8779ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:16.979104 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:16.979065    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x"
Jul 15 23:48:18.087776 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:18.087749    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wbf8x"]
Jul 15 23:48:18.091362 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:18.091341    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd5c230_bc5d_493c_86f2_a257aa8779ca.slice/crio-a349194aca8e737d720dfad0505f3026b1d7e59e84d52e868e1236c66d4acf04 WatchSource:0}: Error finding container a349194aca8e737d720dfad0505f3026b1d7e59e84d52e868e1236c66d4acf04: Status 404 returned error can't find the container with id a349194aca8e737d720dfad0505f3026b1d7e59e84d52e868e1236c66d4acf04
Jul 15 23:48:18.501256 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:18.501217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwgfb" event={"ID":"91477475-8000-491f-806a-47df0f8e56b0","Type":"ContainerStarted","Data":"16a45951366e9585e3622b3608bd3331400479748849e2327e542c98b596befe"}
Jul 15 23:48:18.502336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:18.502314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x" event={"ID":"1bd5c230-bc5d-493c-86f2-a257aa8779ca","Type":"ContainerStarted","Data":"a349194aca8e737d720dfad0505f3026b1d7e59e84d52e868e1236c66d4acf04"}
Jul 15 23:48:18.516732 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:18.516687    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pwgfb" podStartSLOduration=1.436903171 podStartE2EDuration="16.516672566s" totalImagesPullingTime="15.079769395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:48:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:18.515491848 +0000 UTC m=+58.782089462" watchObservedRunningTime="2026-07-15 23:48:18.516672566 +0000 UTC m=+58.783270180"
Jul 15 23:48:19.507664 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:19.507630    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x" event={"ID":"1bd5c230-bc5d-493c-86f2-a257aa8779ca","Type":"ContainerStarted","Data":"7452b0ee1dc770820fd4091938be56dd2eb2d88848e35c361c216f66cb9adb17"}
Jul 15 23:48:19.508090 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:19.507689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x" event={"ID":"1bd5c230-bc5d-493c-86f2-a257aa8779ca","Type":"ContainerStarted","Data":"f9f63623ea5a0917f3442f0b3ef4f6d612330b70ea180b114ba234a61d42de8c"}
Jul 15 23:48:19.524553 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:19.524460    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-wbf8x" podStartSLOduration=2.26921214 podStartE2EDuration="3.524434619s" totalImagesPullingTime="1.255222479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:19.523687226 +0000 UTC m=+59.790284840" watchObservedRunningTime="2026-07-15 23:48:19.524434619 +0000 UTC m=+59.791032234"
Jul 15 23:48:20.474773 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:20.474746    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z8gwr"
Jul 15 23:48:21.033148 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.033116    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mxnwq"]
Jul 15 23:48:21.063038 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.063012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.065197 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.065171    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 23:48:21.065548 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.065528    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 23:48:21.065664 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.065539    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 23:48:21.065728 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.065702    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fvd28\""
Jul 15 23:48:21.085137 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.085106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-textfile\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.085137 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.085139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-wtmp\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.085330 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.085156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3a4629c-c4dd-4249-a73a-edb405f843dd-metrics-client-ca\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.085330 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.085196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skd62\" (UniqueName: \"kubernetes.io/projected/a3a4629c-c4dd-4249-a73a-edb405f843dd-kube-api-access-skd62\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.085330 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.085238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3a4629c-c4dd-4249-a73a-edb405f843dd-root\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.085330 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.085269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.085518 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.085365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3a4629c-c4dd-4249-a73a-edb405f843dd-sys\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.085518 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.085436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-tls\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.085518 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.085483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186685 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-textfile\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186685 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-wtmp\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3a4629c-c4dd-4249-a73a-edb405f843dd-metrics-client-ca\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skd62\" (UniqueName: \"kubernetes.io/projected/a3a4629c-c4dd-4249-a73a-edb405f843dd-kube-api-access-skd62\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3a4629c-c4dd-4249-a73a-edb405f843dd-root\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3a4629c-c4dd-4249-a73a-edb405f843dd-sys\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-wtmp\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3a4629c-c4dd-4249-a73a-edb405f843dd-root\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.186929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-tls\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.187236 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3a4629c-c4dd-4249-a73a-edb405f843dd-sys\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.187236 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.186979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.187236 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.187042    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-textfile\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.187371 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.187290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3a4629c-c4dd-4249-a73a-edb405f843dd-metrics-client-ca\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.187422 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.187405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.189207 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.189177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.189310 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.189221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3a4629c-c4dd-4249-a73a-edb405f843dd-node-exporter-tls\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.194012 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.193982    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skd62\" (UniqueName: \"kubernetes.io/projected/a3a4629c-c4dd-4249-a73a-edb405f843dd-kube-api-access-skd62\") pod \"node-exporter-mxnwq\" (UID: \"a3a4629c-c4dd-4249-a73a-edb405f843dd\") " pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.371927 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.371848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxnwq"
Jul 15 23:48:21.405109 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:21.405078    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a4629c_c4dd_4249_a73a_edb405f843dd.slice/crio-b26b621f3161f4bc5c9c0aedab0823c410f5649ca75d0d4d57c9b0fcca1249bf WatchSource:0}: Error finding container b26b621f3161f4bc5c9c0aedab0823c410f5649ca75d0d4d57c9b0fcca1249bf: Status 404 returned error can't find the container with id b26b621f3161f4bc5c9c0aedab0823c410f5649ca75d0d4d57c9b0fcca1249bf
Jul 15 23:48:21.407702 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.407581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ztgd"
Jul 15 23:48:21.515734 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:21.515700    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxnwq" event={"ID":"a3a4629c-c4dd-4249-a73a-edb405f843dd","Type":"ContainerStarted","Data":"b26b621f3161f4bc5c9c0aedab0823c410f5649ca75d0d4d57c9b0fcca1249bf"}
Jul 15 23:48:22.491342 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:22.491292    2576 patch_prober.go:28] interesting pod/image-registry-86db6bdb55-flpz9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 23:48:22.491700 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:22.491354    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86db6bdb55-flpz9" podUID="4514d8bb-98a6-45e6-af27-193be26b0dbe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 23:48:22.520429 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:22.520399    2576 generic.go:356] "Generic (PLEG): container finished" podID="a3a4629c-c4dd-4249-a73a-edb405f843dd" containerID="62c11d2612433eff1650938c1e5705abcc0d0c000af32213f69b51bf94182393" exitCode=0
Jul 15 23:48:22.520571 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:22.520468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxnwq" event={"ID":"a3a4629c-c4dd-4249-a73a-edb405f843dd","Type":"ContainerDied","Data":"62c11d2612433eff1650938c1e5705abcc0d0c000af32213f69b51bf94182393"}
Jul 15 23:48:23.525691 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:23.525652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxnwq" event={"ID":"a3a4629c-c4dd-4249-a73a-edb405f843dd","Type":"ContainerStarted","Data":"626da141190576fd9b03ec793f68a609396ebd7a9cdfe39a5f67f2a4972ba296"}
Jul 15 23:48:23.526159 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:23.525729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxnwq" event={"ID":"a3a4629c-c4dd-4249-a73a-edb405f843dd","Type":"ContainerStarted","Data":"a458c23f04e334f2f421a76b8a3e2772406422e2283e162a430f882836bf8217"}
Jul 15 23:48:23.541074 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:23.541026    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mxnwq" podStartSLOduration=1.559958199 podStartE2EDuration="2.541011689s" totalImagesPullingTime="919.027556ms" totalInitContainerRuntime="62.025934ms" isStatefulPod=true podCreationTimestamp="2026-07-15 23:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:23.539785939 +0000 UTC m=+63.806383552" watchObservedRunningTime="2026-07-15 23:48:23.541011689 +0000 UTC m=+63.807609281"
Jul 15 23:48:23.997845 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:23.997808    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"]
Jul 15 23:48:24.001393 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.001368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.003706 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.003684    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-h6zhb\""
Jul 15 23:48:24.003851 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.003684    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 23:48:24.003851 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.003685    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 23:48:24.003851 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.003787    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2uap7rh2jb2mk\""
Jul 15 23:48:24.004010 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.003859    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 23:48:24.004156 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.004138    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 23:48:24.004202 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.004157    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 23:48:24.013117 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.013098    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"]
Jul 15 23:48:24.115595 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.115553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.115798 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.115625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.115798 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.115661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-metrics-client-ca\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.115798 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.115695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.115798 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.115717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-tls\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.115798 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.115733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-grpc-tls\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.116020 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.115850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6mgk\" (UniqueName: \"kubernetes.io/projected/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-kube-api-access-d6mgk\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.116020 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.115901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.216588 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.216554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6mgk\" (UniqueName: \"kubernetes.io/projected/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-kube-api-access-d6mgk\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.216588 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.216595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.216867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.216637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.216867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.216665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.216867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.216683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-metrics-client-ca\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.216867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.216712    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.216867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.216735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-tls\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.216867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.216795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-grpc-tls\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.217631 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.217586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-metrics-client-ca\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.219740 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.219713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.219871 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.219717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-tls\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.219871 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.219777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.219871 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.219774    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.219970 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.219894    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-grpc-tls\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.220045 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.220027    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.224206 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.224186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6mgk\" (UniqueName: \"kubernetes.io/projected/bbf170af-ee49-4ee0-8f49-4a88b2bfb20e-kube-api-access-d6mgk\") pod \"thanos-querier-7bd9697b54-rbhzl\" (UID: \"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e\") " pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.310380 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.310299    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:24.440071 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.440041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"]
Jul 15 23:48:24.442831 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:24.442801    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf170af_ee49_4ee0_8f49_4a88b2bfb20e.slice/crio-5174d2c5e91f7fec33eaa92848f447ac26b2ef42d217dbdd4c38c2a76af79335 WatchSource:0}: Error finding container 5174d2c5e91f7fec33eaa92848f447ac26b2ef42d217dbdd4c38c2a76af79335: Status 404 returned error can't find the container with id 5174d2c5e91f7fec33eaa92848f447ac26b2ef42d217dbdd4c38c2a76af79335
Jul 15 23:48:24.453873 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.453855    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86db6bdb55-flpz9"
Jul 15 23:48:24.530781 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:24.530743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl" event={"ID":"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e","Type":"ContainerStarted","Data":"5174d2c5e91f7fec33eaa92848f447ac26b2ef42d217dbdd4c38c2a76af79335"}
Jul 15 23:48:25.832278 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.832250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:48:25.835990 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.835968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 23:48:25.844700 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.844680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/205b6fb8-3a06-4ccb-9b02-b60b25ae90d7-metrics-certs\") pod \"network-metrics-daemon-894z9\" (UID: \"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7\") " pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:48:25.852077 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.852057    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"]
Jul 15 23:48:25.855028 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.855013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:25.857706 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.857684    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jznjc\""
Jul 15 23:48:25.857801 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.857736    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 23:48:25.869729 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.869697    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"]
Jul 15 23:48:25.894419 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.894388    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-675cc88f85-8vpt5"]
Jul 15 23:48:25.897536 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.897514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:25.899655 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.899631    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 23:48:25.899655 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.899628    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 23:48:25.899812 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.899729    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-66hns\""
Jul 15 23:48:25.899812 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.899741    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 23:48:25.900132 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.900111    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 23:48:25.900222 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.900192    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 23:48:25.900280 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.900238    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 23:48:25.900484 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.900461    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 23:48:25.904845 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.904825    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 23:48:25.907922 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.907901    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675cc88f85-8vpt5"]
Jul 15 23:48:25.932844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.932800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbjbp\" (UniqueName: \"kubernetes.io/projected/5f8a3d21-8abc-460e-974d-4bcad36d7097-kube-api-access-rbjbp\") pod \"monitoring-plugin-5f68df7f58-rwzct\" (UID: \"5f8a3d21-8abc-460e-974d-4bcad36d7097\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:25.933009 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.932888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-console-config\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:25.933009 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.932921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-serving-cert\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:25.933009 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.932997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-oauth-config\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:25.933150 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.933041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd64f\" (UniqueName: \"kubernetes.io/projected/c2318f07-4122-43ca-b93e-4d865f9f3667-kube-api-access-qd64f\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:25.933150 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.933094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-service-ca\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:25.933227 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.933166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-oauth-serving-cert\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:25.933227 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.933208    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f8a3d21-8abc-460e-974d-4bcad36d7097-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-rwzct\" (UID: \"5f8a3d21-8abc-460e-974d-4bcad36d7097\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:25.933319 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.933240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-trusted-ca-bundle\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:25.933319 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.933301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:48:25.935242 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.935220    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 23:48:25.946417 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.946396    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65f72dc6-a50b-4bd4-a8e7-58d1fc98badb-original-pull-secret\") pod \"global-pull-secret-syncer-r8zt8\" (UID: \"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb\") " pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:48:25.991615 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.991573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8zt8"
Jul 15 23:48:25.999591 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:25.999571    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2fgm\""
Jul 15 23:48:26.008095 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.008068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-894z9"
Jul 15 23:48:26.034206 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:48:26.034336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-oauth-config\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.034336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd64f\" (UniqueName: \"kubernetes.io/projected/c2318f07-4122-43ca-b93e-4d865f9f3667-kube-api-access-qd64f\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.034336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-service-ca\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.034505 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-oauth-serving-cert\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.034505 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f8a3d21-8abc-460e-974d-4bcad36d7097-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-rwzct\" (UID: \"5f8a3d21-8abc-460e-974d-4bcad36d7097\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:26.034663 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-trusted-ca-bundle\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.034663 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbjbp\" (UniqueName: \"kubernetes.io/projected/5f8a3d21-8abc-460e-974d-4bcad36d7097-kube-api-access-rbjbp\") pod \"monitoring-plugin-5f68df7f58-rwzct\" (UID: \"5f8a3d21-8abc-460e-974d-4bcad36d7097\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:26.034663 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-console-config\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.034663 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.034659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-serving-cert\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.034883 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:48:26.034865    2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 23:48:26.034954 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:48:26.034937    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8a3d21-8abc-460e-974d-4bcad36d7097-monitoring-plugin-cert podName:5f8a3d21-8abc-460e-974d-4bcad36d7097 nodeName:}" failed. No retries permitted until 2026-07-15 23:48:26.534918083 +0000 UTC m=+66.801515679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5f8a3d21-8abc-460e-974d-4bcad36d7097-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-rwzct" (UID: "5f8a3d21-8abc-460e-974d-4bcad36d7097") : secret "monitoring-plugin-cert" not found
Jul 15 23:48:26.035073 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.035048    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-service-ca\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.035210 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.035184    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-oauth-serving-cert\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.035378 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.035352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-trusted-ca-bundle\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.035720 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.035692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-console-config\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.036392 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.036371    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 23:48:26.037530 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.037509    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-serving-cert\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.037530 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.037521    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-oauth-config\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.043232 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.043189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbjbp\" (UniqueName: \"kubernetes.io/projected/5f8a3d21-8abc-460e-974d-4bcad36d7097-kube-api-access-rbjbp\") pod \"monitoring-plugin-5f68df7f58-rwzct\" (UID: \"5f8a3d21-8abc-460e-974d-4bcad36d7097\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:26.043653 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.043626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd64f\" (UniqueName: \"kubernetes.io/projected/c2318f07-4122-43ca-b93e-4d865f9f3667-kube-api-access-qd64f\") pod \"console-675cc88f85-8vpt5\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") " pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.046938 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.046916    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 23:48:26.057617 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.057577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wb6t\" (UniqueName: \"kubernetes.io/projected/33c9778b-ca33-4993-99e1-81abfa9a8568-kube-api-access-8wb6t\") pod \"network-check-target-lf66r\" (UID: \"33c9778b-ca33-4993-99e1-81abfa9a8568\") " pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:48:26.209594 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.209555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:26.304214 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.304181    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwsxh\""
Jul 15 23:48:26.313401 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.313377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:48:26.541187 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.540169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f8a3d21-8abc-460e-974d-4bcad36d7097-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-rwzct\" (UID: \"5f8a3d21-8abc-460e-974d-4bcad36d7097\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:26.553185 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.553025    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f8a3d21-8abc-460e-974d-4bcad36d7097-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-rwzct\" (UID: \"5f8a3d21-8abc-460e-974d-4bcad36d7097\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:26.634687 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.634595    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-894z9"]
Jul 15 23:48:26.638693 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:26.638661    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205b6fb8_3a06_4ccb_9b02_b60b25ae90d7.slice/crio-25041e271dd1a442598e4877771d94e278abce24a2957c2ac4b7214e834a4fef WatchSource:0}: Error finding container 25041e271dd1a442598e4877771d94e278abce24a2957c2ac4b7214e834a4fef: Status 404 returned error can't find the container with id 25041e271dd1a442598e4877771d94e278abce24a2957c2ac4b7214e834a4fef
Jul 15 23:48:26.654436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.654402    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lf66r"]
Jul 15 23:48:26.763857 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.763835    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:26.881306 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.881266    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r8zt8"]
Jul 15 23:48:26.884446 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.884345    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675cc88f85-8vpt5"]
Jul 15 23:48:26.884550 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:26.884522    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f72dc6_a50b_4bd4_a8e7_58d1fc98badb.slice/crio-51226171bb49b1883e53c8dcec6153e2e4e2dd079368d1f19ba622375c3e8858 WatchSource:0}: Error finding container 51226171bb49b1883e53c8dcec6153e2e4e2dd079368d1f19ba622375c3e8858: Status 404 returned error can't find the container with id 51226171bb49b1883e53c8dcec6153e2e4e2dd079368d1f19ba622375c3e8858
Jul 15 23:48:26.887523 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:26.887497    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2318f07_4122_43ca_b93e_4d865f9f3667.slice/crio-fdfcd3027ef74b4aab620b14ccc39b3d12e729c6c4a8f89099b605b2ddb73e87 WatchSource:0}: Error finding container fdfcd3027ef74b4aab620b14ccc39b3d12e729c6c4a8f89099b605b2ddb73e87: Status 404 returned error can't find the container with id fdfcd3027ef74b4aab620b14ccc39b3d12e729c6c4a8f89099b605b2ddb73e87
Jul 15 23:48:26.890839 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:26.890705    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"]
Jul 15 23:48:26.895806 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:48:26.895785    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8a3d21_8abc_460e_974d_4bcad36d7097.slice/crio-61d6877db50898a8044789fb7d129a69e997761c0cad38d990327ac57ba7aded WatchSource:0}: Error finding container 61d6877db50898a8044789fb7d129a69e997761c0cad38d990327ac57ba7aded: Status 404 returned error can't find the container with id 61d6877db50898a8044789fb7d129a69e997761c0cad38d990327ac57ba7aded
Jul 15 23:48:27.553401 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:27.553261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-894z9" event={"ID":"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7","Type":"ContainerStarted","Data":"25041e271dd1a442598e4877771d94e278abce24a2957c2ac4b7214e834a4fef"}
Jul 15 23:48:27.556991 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:27.556955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl" event={"ID":"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e","Type":"ContainerStarted","Data":"611f0adbd944afcf4ddc4dd3280520476203aacf17f1928628ccd9e3f7bfbbf5"}
Jul 15 23:48:27.557189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:27.557052    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl" event={"ID":"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e","Type":"ContainerStarted","Data":"a9ff4e8c4d3f6f3a184ac67ebeca30e3cb83e95db1a84ca27ad91333d59c9862"}
Jul 15 23:48:27.557189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:27.557092    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl" event={"ID":"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e","Type":"ContainerStarted","Data":"1410b6f3b4487ba987bd514a14eab81415c00dced6e49cf4378decfbb3bc18d2"}
Jul 15 23:48:27.558861 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:27.558775    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lf66r" event={"ID":"33c9778b-ca33-4993-99e1-81abfa9a8568","Type":"ContainerStarted","Data":"7c5f0b300615ec6c309edae2056b046c20be1542475de332c759ca59ebd24a4c"}
Jul 15 23:48:27.561099 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:27.561019    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675cc88f85-8vpt5" event={"ID":"c2318f07-4122-43ca-b93e-4d865f9f3667","Type":"ContainerStarted","Data":"fdfcd3027ef74b4aab620b14ccc39b3d12e729c6c4a8f89099b605b2ddb73e87"}
Jul 15 23:48:27.563888 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:27.563859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r8zt8" event={"ID":"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb","Type":"ContainerStarted","Data":"51226171bb49b1883e53c8dcec6153e2e4e2dd079368d1f19ba622375c3e8858"}
Jul 15 23:48:27.565777 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:27.565751    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct" event={"ID":"5f8a3d21-8abc-460e-974d-4bcad36d7097","Type":"ContainerStarted","Data":"61d6877db50898a8044789fb7d129a69e997761c0cad38d990327ac57ba7aded"}
Jul 15 23:48:29.577474 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:29.577384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-894z9" event={"ID":"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7","Type":"ContainerStarted","Data":"855b422dea5d28772a49cfcbbc471a89d7c1816e9f0d2f02daab15f067dec330"}
Jul 15 23:48:29.580404 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:29.580356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl" event={"ID":"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e","Type":"ContainerStarted","Data":"4f6b2e1e330c91c2e86d1fdbacf23b49dafbcb7535bb74bc09060e216cd501cd"}
Jul 15 23:48:30.697954 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:30.697927    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675cc88f85-8vpt5"]
Jul 15 23:48:33.599471 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.599435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-894z9" event={"ID":"205b6fb8-3a06-4ccb-9b02-b60b25ae90d7","Type":"ContainerStarted","Data":"2c56591bd8570a183712a972259e1ec46c800e00b11fe39ee61ada632b08a78a"}
Jul 15 23:48:33.602523 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.602492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl" event={"ID":"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e","Type":"ContainerStarted","Data":"abc023bfa4edbbe2ace852ae7cc22b22009be4eeda2262021deff3dfbc00b480"}
Jul 15 23:48:33.602674 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.602561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl" event={"ID":"bbf170af-ee49-4ee0-8f49-4a88b2bfb20e","Type":"ContainerStarted","Data":"ea7c6010928524005fb1d6e154230ff6a070f5f3ea8a72e740f08272c92120af"}
Jul 15 23:48:33.602739 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.602726    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:33.604124 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.604105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lf66r" event={"ID":"33c9778b-ca33-4993-99e1-81abfa9a8568","Type":"ContainerStarted","Data":"39a15e9ae4a19501c2831fced5164056dfc53a6c300a2a799317d8459e6a3070"}
Jul 15 23:48:33.604206 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.604157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:48:33.606102 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.606074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675cc88f85-8vpt5" event={"ID":"c2318f07-4122-43ca-b93e-4d865f9f3667","Type":"ContainerStarted","Data":"96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54"}
Jul 15 23:48:33.607799 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.607778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r8zt8" event={"ID":"65f72dc6-a50b-4bd4-a8e7-58d1fc98badb","Type":"ContainerStarted","Data":"c9e122a5ee328bc5c1af58e4ebeaf24bedfbd78defd58055f7f2ea00d6c65110"}
Jul 15 23:48:33.609620 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.609574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct" event={"ID":"5f8a3d21-8abc-460e-974d-4bcad36d7097","Type":"ContainerStarted","Data":"1dd95143124018309119dd4659214ed8c22ad32419fa941fba6b3311b7743e07"}
Jul 15 23:48:33.609806 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.609780    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:33.610884 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.610866    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl"
Jul 15 23:48:33.614343 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.614326    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct"
Jul 15 23:48:33.640857 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.640810    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-894z9" podStartSLOduration=70.05473391 podStartE2EDuration="1m12.640796444s" totalImagesPullingTime="2.586062534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:33.63899534 +0000 UTC m=+73.905592954" watchObservedRunningTime="2026-07-15 23:48:33.640796444 +0000 UTC m=+73.907394055"
Jul 15 23:48:33.670975 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.670912    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7bd9697b54-rbhzl" podStartSLOduration=6.129654018 podStartE2EDuration="10.670893313s" totalImagesPullingTime="4.541239295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:48:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:33.669212455 +0000 UTC m=+73.935810082" watchObservedRunningTime="2026-07-15 23:48:33.670893313 +0000 UTC m=+73.937490927"
Jul 15 23:48:33.683866 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.683824    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lf66r" podStartSLOduration=66.26241858 podStartE2EDuration="1m12.683800575s" totalImagesPullingTime="6.421381995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:33.682946132 +0000 UTC m=+73.949543746" watchObservedRunningTime="2026-07-15 23:48:33.683800575 +0000 UTC m=+73.950398188"
Jul 15 23:48:33.700216 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.700164    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-rwzct" podStartSLOduration=2.50599863 podStartE2EDuration="8.700150857s" totalImagesPullingTime="6.194152227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:33.699040318 +0000 UTC m=+73.965637931" watchObservedRunningTime="2026-07-15 23:48:33.700150857 +0000 UTC m=+73.966748471"
Jul 15 23:48:33.716134 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.716082    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-675cc88f85-8vpt5" podStartSLOduration=2.511257208 podStartE2EDuration="8.716063817s" totalImagesPullingTime="6.204806609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:33.71512738 +0000 UTC m=+73.981724995" watchObservedRunningTime="2026-07-15 23:48:33.716063817 +0000 UTC m=+73.982661431"
Jul 15 23:48:33.736723 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:33.736682    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r8zt8" podStartSLOduration=66.51803588 podStartE2EDuration="1m12.736668128s" totalImagesPullingTime="6.218632248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:48:33.735873032 +0000 UTC m=+74.002470646" watchObservedRunningTime="2026-07-15 23:48:33.736668128 +0000 UTC m=+74.003265741"
Jul 15 23:48:36.210224 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:36.210192    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:58.626263 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.626203    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-675cc88f85-8vpt5" podUID="c2318f07-4122-43ca-b93e-4d865f9f3667" containerName="console" containerID="cri-o://96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54" gracePeriod=15
Jul 15 23:48:58.860152 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.860130    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:58.995508 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.995469    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-service-ca\") pod \"c2318f07-4122-43ca-b93e-4d865f9f3667\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") "
Jul 15 23:48:58.995732 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.995520    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd64f\" (UniqueName: \"kubernetes.io/projected/c2318f07-4122-43ca-b93e-4d865f9f3667-kube-api-access-qd64f\") pod \"c2318f07-4122-43ca-b93e-4d865f9f3667\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") "
Jul 15 23:48:58.995732 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.995556    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-console-config\") pod \"c2318f07-4122-43ca-b93e-4d865f9f3667\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") "
Jul 15 23:48:58.995732 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.995702    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-oauth-config\") pod \"c2318f07-4122-43ca-b93e-4d865f9f3667\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") "
Jul 15 23:48:58.995901 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.995748    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-trusted-ca-bundle\") pod \"c2318f07-4122-43ca-b93e-4d865f9f3667\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") "
Jul 15 23:48:58.995901 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.995794    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-serving-cert\") pod \"c2318f07-4122-43ca-b93e-4d865f9f3667\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") "
Jul 15 23:48:58.995901 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.995834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-oauth-serving-cert\") pod \"c2318f07-4122-43ca-b93e-4d865f9f3667\" (UID: \"c2318f07-4122-43ca-b93e-4d865f9f3667\") "
Jul 15 23:48:58.996272 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.996219    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-console-config" (OuterVolumeSpecName: "console-config") pod "c2318f07-4122-43ca-b93e-4d865f9f3667" (UID: "c2318f07-4122-43ca-b93e-4d865f9f3667"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:48:58.996393 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.996289    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-service-ca" (OuterVolumeSpecName: "service-ca") pod "c2318f07-4122-43ca-b93e-4d865f9f3667" (UID: "c2318f07-4122-43ca-b93e-4d865f9f3667"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:48:58.996393 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.996298    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c2318f07-4122-43ca-b93e-4d865f9f3667" (UID: "c2318f07-4122-43ca-b93e-4d865f9f3667"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:48:58.996393 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.996341    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c2318f07-4122-43ca-b93e-4d865f9f3667" (UID: "c2318f07-4122-43ca-b93e-4d865f9f3667"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:48:58.998075 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.998050    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c2318f07-4122-43ca-b93e-4d865f9f3667" (UID: "c2318f07-4122-43ca-b93e-4d865f9f3667"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:48:58.998158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.998102    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2318f07-4122-43ca-b93e-4d865f9f3667-kube-api-access-qd64f" (OuterVolumeSpecName: "kube-api-access-qd64f") pod "c2318f07-4122-43ca-b93e-4d865f9f3667" (UID: "c2318f07-4122-43ca-b93e-4d865f9f3667"). InnerVolumeSpecName "kube-api-access-qd64f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:48:58.998158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:58.998123    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c2318f07-4122-43ca-b93e-4d865f9f3667" (UID: "c2318f07-4122-43ca-b93e-4d865f9f3667"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:48:59.097178 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.097141    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-oauth-config\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:48:59.097178 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.097169    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-trusted-ca-bundle\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:48:59.097178 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.097178    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2318f07-4122-43ca-b93e-4d865f9f3667-console-serving-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:48:59.097178 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.097186    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-oauth-serving-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:48:59.097480 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.097196    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-service-ca\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:48:59.097480 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.097204    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd64f\" (UniqueName: \"kubernetes.io/projected/c2318f07-4122-43ca-b93e-4d865f9f3667-kube-api-access-qd64f\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:48:59.097480 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.097213    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2318f07-4122-43ca-b93e-4d865f9f3667-console-config\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:48:59.705057 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.705022    2576 generic.go:356] "Generic (PLEG): container finished" podID="c2318f07-4122-43ca-b93e-4d865f9f3667" containerID="96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54" exitCode=0
Jul 15 23:48:59.705647 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.705066    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675cc88f85-8vpt5"
Jul 15 23:48:59.705647 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.705105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675cc88f85-8vpt5" event={"ID":"c2318f07-4122-43ca-b93e-4d865f9f3667","Type":"ContainerDied","Data":"96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54"}
Jul 15 23:48:59.705647 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.705153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675cc88f85-8vpt5" event={"ID":"c2318f07-4122-43ca-b93e-4d865f9f3667","Type":"ContainerDied","Data":"fdfcd3027ef74b4aab620b14ccc39b3d12e729c6c4a8f89099b605b2ddb73e87"}
Jul 15 23:48:59.705647 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.705175    2576 scope.go:117] "RemoveContainer" containerID="96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54"
Jul 15 23:48:59.714046 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.714026    2576 scope.go:117] "RemoveContainer" containerID="96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54"
Jul 15 23:48:59.714308 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:48:59.714287    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54\": container with ID starting with 96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54 not found: ID does not exist" containerID="96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54"
Jul 15 23:48:59.714349 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.714318    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54"} err="failed to get container status \"96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54\": rpc error: code = NotFound desc = could not find container \"96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54\": container with ID starting with 96ba6bfb34a3f5b90b6417987f916fa98fbc7dbdabb69ed3f048055041768d54 not found: ID does not exist"
Jul 15 23:48:59.724783 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.724755    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675cc88f85-8vpt5"]
Jul 15 23:48:59.727694 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.727675    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-675cc88f85-8vpt5"]
Jul 15 23:48:59.946331 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:48:59.946307    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gq2lm_90bf70d5-2d3e-4b42-8fd0-d55d7db967e8/serve-healthcheck-canary/0.log"
Jul 15 23:49:00.185507 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:00.185478    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2318f07-4122-43ca-b93e-4d865f9f3667" path="/var/lib/kubelet/pods/c2318f07-4122-43ca-b93e-4d865f9f3667/volumes"
Jul 15 23:49:04.616000 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:04.615971    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lf66r"
Jul 15 23:49:48.203575 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.203542    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fd57996c6-c64m6"]
Jul 15 23:49:48.204004 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.203812    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2318f07-4122-43ca-b93e-4d865f9f3667" containerName="console"
Jul 15 23:49:48.204004 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.203824    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2318f07-4122-43ca-b93e-4d865f9f3667" containerName="console"
Jul 15 23:49:48.204004 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.203868    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2318f07-4122-43ca-b93e-4d865f9f3667" containerName="console"
Jul 15 23:49:48.206589 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.206572    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.208896 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.208872    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 23:49:48.209026 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.208955    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 23:49:48.209433 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.209410    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 23:49:48.209538 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.209416    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 23:49:48.209538 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.209441    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 23:49:48.209538 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.209468    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 23:49:48.209749 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.209735    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 23:49:48.209866 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.209849    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-66hns\""
Jul 15 23:49:48.213256 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.213244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 23:49:48.216455 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.216438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fd57996c6-c64m6"]
Jul 15 23:49:48.355588 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.355545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-console-config\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.355588 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.355582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-service-ca\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.355805 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.355667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-oauth-serving-cert\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.355805 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.355704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-trusted-ca-bundle\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.355805 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.355735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbmn7\" (UniqueName: \"kubernetes.io/projected/e4966530-5b32-4bff-9067-2846761c8c99-kube-api-access-nbmn7\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.355805 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.355769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-serving-cert\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.355933 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.355805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-oauth-config\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.456466 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.456366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbmn7\" (UniqueName: \"kubernetes.io/projected/e4966530-5b32-4bff-9067-2846761c8c99-kube-api-access-nbmn7\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.456466 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.456408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-serving-cert\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.456466 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.456425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-oauth-config\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.456466 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.456456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-console-config\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.456466 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.456472    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-service-ca\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.456867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.456496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-oauth-serving-cert\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.456867 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.456518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-trusted-ca-bundle\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.457280 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.457255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-oauth-serving-cert\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.457381 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.457342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-service-ca\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.457449 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.457389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-console-config\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.457686 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.457666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-trusted-ca-bundle\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.458957 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.458937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-serving-cert\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.459044 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.458992    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-oauth-config\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.463441 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.463415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbmn7\" (UniqueName: \"kubernetes.io/projected/e4966530-5b32-4bff-9067-2846761c8c99-kube-api-access-nbmn7\") pod \"console-fd57996c6-c64m6\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") " pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.516617 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.516561    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:48.642688 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.642635    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fd57996c6-c64m6"]
Jul 15 23:49:48.645418 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:49:48.645395    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4966530_5b32_4bff_9067_2846761c8c99.slice/crio-0c10923d82d9fa5c876b05ce2ed1adc7a9ba655d54210ec85afd9f781921fadf WatchSource:0}: Error finding container 0c10923d82d9fa5c876b05ce2ed1adc7a9ba655d54210ec85afd9f781921fadf: Status 404 returned error can't find the container with id 0c10923d82d9fa5c876b05ce2ed1adc7a9ba655d54210ec85afd9f781921fadf
Jul 15 23:49:48.873979 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.873885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd57996c6-c64m6" event={"ID":"e4966530-5b32-4bff-9067-2846761c8c99","Type":"ContainerStarted","Data":"6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442"}
Jul 15 23:49:48.873979 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.873941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd57996c6-c64m6" event={"ID":"e4966530-5b32-4bff-9067-2846761c8c99","Type":"ContainerStarted","Data":"0c10923d82d9fa5c876b05ce2ed1adc7a9ba655d54210ec85afd9f781921fadf"}
Jul 15 23:49:48.889367 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:48.889309    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fd57996c6-c64m6" podStartSLOduration=0.889289341 podStartE2EDuration="889.289341ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:49:48.888539396 +0000 UTC m=+149.155137009" watchObservedRunningTime="2026-07-15 23:49:48.889289341 +0000 UTC m=+149.155886957"
Jul 15 23:49:58.517026 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:58.516975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:58.517586 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:58.517045    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:58.521840 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:58.521822    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:49:58.911521 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:49:58.911496    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:50:33.001111 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.001034    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"]
Jul 15 23:50:33.004454 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.004438    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.006918 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.006892    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrrcq\""
Jul 15 23:50:33.007041 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.006904    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 23:50:33.007041 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.006905    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 23:50:33.012509 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.012482    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"]
Jul 15 23:50:33.081854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.081813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.082043 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.081880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.082043 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.081908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb488\" (UniqueName: \"kubernetes.io/projected/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-kube-api-access-cb488\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.182563 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.182536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.182743 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.182572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb488\" (UniqueName: \"kubernetes.io/projected/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-kube-api-access-cb488\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.182743 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.182657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.182933 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.182911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.182996 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.182954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.189949 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.189923    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb488\" (UniqueName: \"kubernetes.io/projected/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-kube-api-access-cb488\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.313751 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.313670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:50:33.441387 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:33.441364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"]
Jul 15 23:50:33.443906 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:50:33.443881    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae1a8d6_8221_4db8_aa1a_736f9ff07d30.slice/crio-b3f1ecaec887dec9a291b4699db8ca9912c0799497e64f2fc09fcc6dd67236df WatchSource:0}: Error finding container b3f1ecaec887dec9a291b4699db8ca9912c0799497e64f2fc09fcc6dd67236df: Status 404 returned error can't find the container with id b3f1ecaec887dec9a291b4699db8ca9912c0799497e64f2fc09fcc6dd67236df
Jul 15 23:50:34.026870 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:34.026834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc" event={"ID":"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30","Type":"ContainerStarted","Data":"b3f1ecaec887dec9a291b4699db8ca9912c0799497e64f2fc09fcc6dd67236df"}
Jul 15 23:50:41.054874 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:41.054838    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerID="2bd8544910914a459c01f6dd7cd0f1b219595a4d391d50bd1a89aff5d8f2a9ad" exitCode=0
Jul 15 23:50:41.055271 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:41.054881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc" event={"ID":"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30","Type":"ContainerDied","Data":"2bd8544910914a459c01f6dd7cd0f1b219595a4d391d50bd1a89aff5d8f2a9ad"}
Jul 15 23:50:58.112745 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:58.112651    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerID="5935e9d8c72c47238e9956879c9256d6fd76b9e13d667529b41a23dddab55703" exitCode=0
Jul 15 23:50:58.112745 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:50:58.112712    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc" event={"ID":"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30","Type":"ContainerDied","Data":"5935e9d8c72c47238e9956879c9256d6fd76b9e13d667529b41a23dddab55703"}
Jul 15 23:51:05.139493 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:05.139459    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerID="48372ab4a34b728bab04f661c86196a6129ee939b4c9d4966608b6969ef3dbf8" exitCode=0
Jul 15 23:51:05.139880 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:05.139505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc" event={"ID":"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30","Type":"ContainerDied","Data":"48372ab4a34b728bab04f661c86196a6129ee939b4c9d4966608b6969ef3dbf8"}
Jul 15 23:51:06.271579 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.271555    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:51:06.350937 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.350907    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-util\") pod \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") "
Jul 15 23:51:06.351075 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.350963    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-bundle\") pod \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") "
Jul 15 23:51:06.351075 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.351046    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb488\" (UniqueName: \"kubernetes.io/projected/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-kube-api-access-cb488\") pod \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\" (UID: \"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30\") "
Jul 15 23:51:06.351712 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.351674    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-bundle" (OuterVolumeSpecName: "bundle") pod "4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" (UID: "4ae1a8d6-8221-4db8-aa1a-736f9ff07d30"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:51:06.353161 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.353135    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-kube-api-access-cb488" (OuterVolumeSpecName: "kube-api-access-cb488") pod "4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" (UID: "4ae1a8d6-8221-4db8-aa1a-736f9ff07d30"). InnerVolumeSpecName "kube-api-access-cb488". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:51:06.355885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.355860    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-util" (OuterVolumeSpecName: "util") pod "4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" (UID: "4ae1a8d6-8221-4db8-aa1a-736f9ff07d30"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:51:06.452282 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.452184    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb488\" (UniqueName: \"kubernetes.io/projected/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-kube-api-access-cb488\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:51:06.452282 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.452224    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-util\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:51:06.452282 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:06.452234    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae1a8d6-8221-4db8-aa1a-736f9ff07d30-bundle\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:51:07.148107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:07.148075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc" event={"ID":"4ae1a8d6-8221-4db8-aa1a-736f9ff07d30","Type":"ContainerDied","Data":"b3f1ecaec887dec9a291b4699db8ca9912c0799497e64f2fc09fcc6dd67236df"}
Jul 15 23:51:07.148107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:07.148111    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zrbrc"
Jul 15 23:51:07.148288 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:07.148130    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3f1ecaec887dec9a291b4699db8ca9912c0799497e64f2fc09fcc6dd67236df"
Jul 15 23:51:11.049619 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.049578    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"]
Jul 15 23:51:11.049988 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.049847    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerName="util"
Jul 15 23:51:11.049988 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.049858    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerName="util"
Jul 15 23:51:11.049988 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.049868    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerName="pull"
Jul 15 23:51:11.049988 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.049874    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerName="pull"
Jul 15 23:51:11.049988 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.049893    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerName="extract"
Jul 15 23:51:11.049988 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.049899    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerName="extract"
Jul 15 23:51:11.049988 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.049938    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae1a8d6-8221-4db8-aa1a-736f9ff07d30" containerName="extract"
Jul 15 23:51:11.052940 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.052924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"
Jul 15 23:51:11.055143 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.055115    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:51:11.055143 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.055115    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 15 23:51:11.055425 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.055409    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-prv5v\""
Jul 15 23:51:11.067997 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.067977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"]
Jul 15 23:51:11.188312 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.188278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2mpc\" (UniqueName: \"kubernetes.io/projected/7b617f91-4701-4daa-a948-b72144b650a3-kube-api-access-f2mpc\") pod \"cert-manager-operator-controller-manager-55c444bf86-rjw8h\" (UID: \"7b617f91-4701-4daa-a948-b72144b650a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"
Jul 15 23:51:11.188312 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.188319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b617f91-4701-4daa-a948-b72144b650a3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rjw8h\" (UID: \"7b617f91-4701-4daa-a948-b72144b650a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"
Jul 15 23:51:11.289401 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.289369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2mpc\" (UniqueName: \"kubernetes.io/projected/7b617f91-4701-4daa-a948-b72144b650a3-kube-api-access-f2mpc\") pod \"cert-manager-operator-controller-manager-55c444bf86-rjw8h\" (UID: \"7b617f91-4701-4daa-a948-b72144b650a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"
Jul 15 23:51:11.289655 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.289412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b617f91-4701-4daa-a948-b72144b650a3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rjw8h\" (UID: \"7b617f91-4701-4daa-a948-b72144b650a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"
Jul 15 23:51:11.289839 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.289820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b617f91-4701-4daa-a948-b72144b650a3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rjw8h\" (UID: \"7b617f91-4701-4daa-a948-b72144b650a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"
Jul 15 23:51:11.298018 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.297987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2mpc\" (UniqueName: \"kubernetes.io/projected/7b617f91-4701-4daa-a948-b72144b650a3-kube-api-access-f2mpc\") pod \"cert-manager-operator-controller-manager-55c444bf86-rjw8h\" (UID: \"7b617f91-4701-4daa-a948-b72144b650a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"
Jul 15 23:51:11.362006 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.361922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"
Jul 15 23:51:11.486085 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:11.486025    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h"]
Jul 15 23:51:11.488720 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:51:11.488692    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b617f91_4701_4daa_a948_b72144b650a3.slice/crio-1b0ff6f6dd0d792f318a81fc1bb0f3144502f90435acb0e7285eb22c26898938 WatchSource:0}: Error finding container 1b0ff6f6dd0d792f318a81fc1bb0f3144502f90435acb0e7285eb22c26898938: Status 404 returned error can't find the container with id 1b0ff6f6dd0d792f318a81fc1bb0f3144502f90435acb0e7285eb22c26898938
Jul 15 23:51:12.166117 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:12.166075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h" event={"ID":"7b617f91-4701-4daa-a948-b72144b650a3","Type":"ContainerStarted","Data":"1b0ff6f6dd0d792f318a81fc1bb0f3144502f90435acb0e7285eb22c26898938"}
Jul 15 23:51:13.172065 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:13.172023    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h" event={"ID":"7b617f91-4701-4daa-a948-b72144b650a3","Type":"ContainerStarted","Data":"4c67b28a6486f8151755243d00b94797847806b1aaa78bffb0a1aef396dd8684"}
Jul 15 23:51:13.195731 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:13.195679    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rjw8h" podStartSLOduration=0.63271126 podStartE2EDuration="2.195664642s" totalImagesPullingTime="1.562953382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:51:13.194394527 +0000 UTC m=+233.460992147" watchObservedRunningTime="2026-07-15 23:51:13.195664642 +0000 UTC m=+233.462262255"
Jul 15 23:51:14.518848 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.518816    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"]
Jul 15 23:51:14.522163 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.522147    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.524379 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.524359    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 23:51:14.524955 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.524939    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrrcq\""
Jul 15 23:51:14.524955 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.524948    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 23:51:14.532982 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.532955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"]
Jul 15 23:51:14.618241 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.618207    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.618417 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.618285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.618417 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.618318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/bb664faf-9d68-4f6c-8be7-9905331605ab-kube-api-access-grtq8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.719626 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.719552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.719626 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.719627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/bb664faf-9d68-4f6c-8be7-9905331605ab-kube-api-access-grtq8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.719861 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.719681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.720036 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.720014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.720036 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.720026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.739511 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.739485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/bb664faf-9d68-4f6c-8be7-9905331605ab-kube-api-access-grtq8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.831234 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.831156    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:14.957263 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:14.957233    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"]
Jul 15 23:51:14.959945 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:51:14.959920    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb664faf_9d68_4f6c_8be7_9905331605ab.slice/crio-a7b24ad7217750d24b628b044755c74dbc9e19921732728c3116f2ca1225d722 WatchSource:0}: Error finding container a7b24ad7217750d24b628b044755c74dbc9e19921732728c3116f2ca1225d722: Status 404 returned error can't find the container with id a7b24ad7217750d24b628b044755c74dbc9e19921732728c3116f2ca1225d722
Jul 15 23:51:15.181491 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:15.181464    2576 generic.go:356] "Generic (PLEG): container finished" podID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerID="37c4cb059109696295a10543697585f9cb1919796be6f376277ba98401365dcf" exitCode=0
Jul 15 23:51:15.181679 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:15.181503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj" event={"ID":"bb664faf-9d68-4f6c-8be7-9905331605ab","Type":"ContainerDied","Data":"37c4cb059109696295a10543697585f9cb1919796be6f376277ba98401365dcf"}
Jul 15 23:51:15.181679 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:15.181555    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj" event={"ID":"bb664faf-9d68-4f6c-8be7-9905331605ab","Type":"ContainerStarted","Data":"a7b24ad7217750d24b628b044755c74dbc9e19921732728c3116f2ca1225d722"}
Jul 15 23:51:17.192014 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.191980    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj" event={"ID":"bb664faf-9d68-4f6c-8be7-9905331605ab","Type":"ContainerStarted","Data":"14949e693735b579e896b2ca9699338452a3fc105448dfa29d5185cc49929cbf"}
Jul 15 23:51:17.544673 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.541624    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"]
Jul 15 23:51:17.545916 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.545897    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"
Jul 15 23:51:17.548294 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.548272    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 23:51:17.548422 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.548332    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 23:51:17.548422 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.548332    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-r5tgf\""
Jul 15 23:51:17.552140 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.552102    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"]
Jul 15 23:51:17.645801 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.645759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z66r7\" (UniqueName: \"kubernetes.io/projected/cb189949-7a75-4c4a-85ae-04e7e4ab278c-kube-api-access-z66r7\") pod \"cert-manager-cainjector-559cdd8c87-vw5lc\" (UID: \"cb189949-7a75-4c4a-85ae-04e7e4ab278c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"
Jul 15 23:51:17.645975 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.645848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb189949-7a75-4c4a-85ae-04e7e4ab278c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vw5lc\" (UID: \"cb189949-7a75-4c4a-85ae-04e7e4ab278c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"
Jul 15 23:51:17.747099 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.747069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb189949-7a75-4c4a-85ae-04e7e4ab278c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vw5lc\" (UID: \"cb189949-7a75-4c4a-85ae-04e7e4ab278c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"
Jul 15 23:51:17.747259 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.747128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z66r7\" (UniqueName: \"kubernetes.io/projected/cb189949-7a75-4c4a-85ae-04e7e4ab278c-kube-api-access-z66r7\") pod \"cert-manager-cainjector-559cdd8c87-vw5lc\" (UID: \"cb189949-7a75-4c4a-85ae-04e7e4ab278c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"
Jul 15 23:51:17.754422 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.754389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb189949-7a75-4c4a-85ae-04e7e4ab278c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vw5lc\" (UID: \"cb189949-7a75-4c4a-85ae-04e7e4ab278c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"
Jul 15 23:51:17.754533 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.754520    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z66r7\" (UniqueName: \"kubernetes.io/projected/cb189949-7a75-4c4a-85ae-04e7e4ab278c-kube-api-access-z66r7\") pod \"cert-manager-cainjector-559cdd8c87-vw5lc\" (UID: \"cb189949-7a75-4c4a-85ae-04e7e4ab278c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"
Jul 15 23:51:17.865772 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.865677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"
Jul 15 23:51:17.990135 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:17.990106    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc"]
Jul 15 23:51:17.993074 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:51:17.993047    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb189949_7a75_4c4a_85ae_04e7e4ab278c.slice/crio-c4b1de91b65672f61d707ba910d03faaecf3b173319021acab9fba290ca7d899 WatchSource:0}: Error finding container c4b1de91b65672f61d707ba910d03faaecf3b173319021acab9fba290ca7d899: Status 404 returned error can't find the container with id c4b1de91b65672f61d707ba910d03faaecf3b173319021acab9fba290ca7d899
Jul 15 23:51:18.196583 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:18.196549    2576 generic.go:356] "Generic (PLEG): container finished" podID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerID="14949e693735b579e896b2ca9699338452a3fc105448dfa29d5185cc49929cbf" exitCode=0
Jul 15 23:51:18.197028 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:18.196638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj" event={"ID":"bb664faf-9d68-4f6c-8be7-9905331605ab","Type":"ContainerDied","Data":"14949e693735b579e896b2ca9699338452a3fc105448dfa29d5185cc49929cbf"}
Jul 15 23:51:18.197799 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:18.197778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc" event={"ID":"cb189949-7a75-4c4a-85ae-04e7e4ab278c","Type":"ContainerStarted","Data":"c4b1de91b65672f61d707ba910d03faaecf3b173319021acab9fba290ca7d899"}
Jul 15 23:51:19.204882 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:19.204846    2576 generic.go:356] "Generic (PLEG): container finished" podID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerID="98f98586c42dc177bc4a4f85574466232eeb73801a497c89d965bd183202b412" exitCode=0
Jul 15 23:51:19.205358 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:19.204924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj" event={"ID":"bb664faf-9d68-4f6c-8be7-9905331605ab","Type":"ContainerDied","Data":"98f98586c42dc177bc4a4f85574466232eeb73801a497c89d965bd183202b412"}
Jul 15 23:51:20.437140 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.437117    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:20.570906 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.570880    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-util\") pod \"bb664faf-9d68-4f6c-8be7-9905331605ab\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") "
Jul 15 23:51:20.571071 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.570937    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/bb664faf-9d68-4f6c-8be7-9905331605ab-kube-api-access-grtq8\") pod \"bb664faf-9d68-4f6c-8be7-9905331605ab\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") "
Jul 15 23:51:20.571071 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.570984    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-bundle\") pod \"bb664faf-9d68-4f6c-8be7-9905331605ab\" (UID: \"bb664faf-9d68-4f6c-8be7-9905331605ab\") "
Jul 15 23:51:20.571438 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.571401    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-bundle" (OuterVolumeSpecName: "bundle") pod "bb664faf-9d68-4f6c-8be7-9905331605ab" (UID: "bb664faf-9d68-4f6c-8be7-9905331605ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:51:20.573125 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.573102    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb664faf-9d68-4f6c-8be7-9905331605ab-kube-api-access-grtq8" (OuterVolumeSpecName: "kube-api-access-grtq8") pod "bb664faf-9d68-4f6c-8be7-9905331605ab" (UID: "bb664faf-9d68-4f6c-8be7-9905331605ab"). InnerVolumeSpecName "kube-api-access-grtq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:51:20.580287 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.580261    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-util" (OuterVolumeSpecName: "util") pod "bb664faf-9d68-4f6c-8be7-9905331605ab" (UID: "bb664faf-9d68-4f6c-8be7-9905331605ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:51:20.672336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.672305    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-bundle\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:51:20.672336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.672331    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb664faf-9d68-4f6c-8be7-9905331605ab-util\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:51:20.672336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:20.672342    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grtq8\" (UniqueName: \"kubernetes.io/projected/bb664faf-9d68-4f6c-8be7-9905331605ab-kube-api-access-grtq8\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:51:21.214259 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:21.214222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc" event={"ID":"cb189949-7a75-4c4a-85ae-04e7e4ab278c","Type":"ContainerStarted","Data":"fc1393df6097212c3716817dc07e0a47f465cdc11a70a879b7b959e1ba7ea6c6"}
Jul 15 23:51:21.215958 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:21.215934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj" event={"ID":"bb664faf-9d68-4f6c-8be7-9905331605ab","Type":"ContainerDied","Data":"a7b24ad7217750d24b628b044755c74dbc9e19921732728c3116f2ca1225d722"}
Jul 15 23:51:21.216066 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:21.215980    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7b24ad7217750d24b628b044755c74dbc9e19921732728c3116f2ca1225d722"
Jul 15 23:51:21.216066 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:21.215985    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbrjmj"
Jul 15 23:51:21.233208 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:21.233159    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vw5lc" podStartSLOduration=1.7412022679999999 podStartE2EDuration="4.233143697s" totalImagesPullingTime="2.491941429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:51:21.23183613 +0000 UTC m=+241.498433746" watchObservedRunningTime="2026-07-15 23:51:21.233143697 +0000 UTC m=+241.499741310"
Jul 15 23:51:26.414924 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.414891    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vtqfw"]
Jul 15 23:51:26.415287 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.415148    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerName="extract"
Jul 15 23:51:26.415287 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.415159    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerName="extract"
Jul 15 23:51:26.415287 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.415167    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerName="util"
Jul 15 23:51:26.415287 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.415172    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerName="util"
Jul 15 23:51:26.415287 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.415193    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerName="pull"
Jul 15 23:51:26.415287 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.415198    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerName="pull"
Jul 15 23:51:26.415287 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.415245    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb664faf-9d68-4f6c-8be7-9905331605ab" containerName="extract"
Jul 15 23:51:26.420648 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.420631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vtqfw"
Jul 15 23:51:26.422713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.422688    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rv5xx\""
Jul 15 23:51:26.425218 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.425192    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vtqfw"]
Jul 15 23:51:26.518231 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.518202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0ede8f8-7ce8-4678-934b-861f7036808f-bound-sa-token\") pod \"cert-manager-55b4d954d5-vtqfw\" (UID: \"b0ede8f8-7ce8-4678-934b-861f7036808f\") " pod="cert-manager/cert-manager-55b4d954d5-vtqfw"
Jul 15 23:51:26.518391 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.518270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9mhj\" (UniqueName: \"kubernetes.io/projected/b0ede8f8-7ce8-4678-934b-861f7036808f-kube-api-access-b9mhj\") pod \"cert-manager-55b4d954d5-vtqfw\" (UID: \"b0ede8f8-7ce8-4678-934b-861f7036808f\") " pod="cert-manager/cert-manager-55b4d954d5-vtqfw"
Jul 15 23:51:26.619074 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.619041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9mhj\" (UniqueName: \"kubernetes.io/projected/b0ede8f8-7ce8-4678-934b-861f7036808f-kube-api-access-b9mhj\") pod \"cert-manager-55b4d954d5-vtqfw\" (UID: \"b0ede8f8-7ce8-4678-934b-861f7036808f\") " pod="cert-manager/cert-manager-55b4d954d5-vtqfw"
Jul 15 23:51:26.619074 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.619078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0ede8f8-7ce8-4678-934b-861f7036808f-bound-sa-token\") pod \"cert-manager-55b4d954d5-vtqfw\" (UID: \"b0ede8f8-7ce8-4678-934b-861f7036808f\") " pod="cert-manager/cert-manager-55b4d954d5-vtqfw"
Jul 15 23:51:26.626959 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.626936    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0ede8f8-7ce8-4678-934b-861f7036808f-bound-sa-token\") pod \"cert-manager-55b4d954d5-vtqfw\" (UID: \"b0ede8f8-7ce8-4678-934b-861f7036808f\") " pod="cert-manager/cert-manager-55b4d954d5-vtqfw"
Jul 15 23:51:26.627081 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.627017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9mhj\" (UniqueName: \"kubernetes.io/projected/b0ede8f8-7ce8-4678-934b-861f7036808f-kube-api-access-b9mhj\") pod \"cert-manager-55b4d954d5-vtqfw\" (UID: \"b0ede8f8-7ce8-4678-934b-861f7036808f\") " pod="cert-manager/cert-manager-55b4d954d5-vtqfw"
Jul 15 23:51:26.729876 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.729805    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vtqfw"
Jul 15 23:51:26.851432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:26.851401    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vtqfw"]
Jul 15 23:51:26.853685 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:51:26.853661    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0ede8f8_7ce8_4678_934b_861f7036808f.slice/crio-8fde5fe164e53b78f56996436464045f5058c923ccc90fc77bcd9a083cf841ab WatchSource:0}: Error finding container 8fde5fe164e53b78f56996436464045f5058c923ccc90fc77bcd9a083cf841ab: Status 404 returned error can't find the container with id 8fde5fe164e53b78f56996436464045f5058c923ccc90fc77bcd9a083cf841ab
Jul 15 23:51:27.241068 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.241033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vtqfw" event={"ID":"b0ede8f8-7ce8-4678-934b-861f7036808f","Type":"ContainerStarted","Data":"504ad4b95d1b205bbfc0fe0dd0a7532829c607d382763d863d6a14fdfaf55ed8"}
Jul 15 23:51:27.241236 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.241076    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vtqfw" event={"ID":"b0ede8f8-7ce8-4678-934b-861f7036808f","Type":"ContainerStarted","Data":"8fde5fe164e53b78f56996436464045f5058c923ccc90fc77bcd9a083cf841ab"}
Jul 15 23:51:27.256428 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.256382    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-vtqfw" podStartSLOduration=1.256369752 podStartE2EDuration="1.256369752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:51:27.255398709 +0000 UTC m=+247.521996334" watchObservedRunningTime="2026-07-15 23:51:27.256369752 +0000 UTC m=+247.522967366"
Jul 15 23:51:27.401943 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.401908    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"]
Jul 15 23:51:27.405356 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.405340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"
Jul 15 23:51:27.407265 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.407240    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-g55d7\""
Jul 15 23:51:27.407265 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.407244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 23:51:27.407447 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.407273    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:51:27.413367 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.413343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"]
Jul 15 23:51:27.423864 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.423839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6b0cea3-00b2-4c0c-beb3-55812cc4454d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-r2rwz\" (UID: \"c6b0cea3-00b2-4c0c-beb3-55812cc4454d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"
Jul 15 23:51:27.424138 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.423895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl4pm\" (UniqueName: \"kubernetes.io/projected/c6b0cea3-00b2-4c0c-beb3-55812cc4454d-kube-api-access-cl4pm\") pod \"openshift-lws-operator-fd8ccff4c-r2rwz\" (UID: \"c6b0cea3-00b2-4c0c-beb3-55812cc4454d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"
Jul 15 23:51:27.525267 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.525180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl4pm\" (UniqueName: \"kubernetes.io/projected/c6b0cea3-00b2-4c0c-beb3-55812cc4454d-kube-api-access-cl4pm\") pod \"openshift-lws-operator-fd8ccff4c-r2rwz\" (UID: \"c6b0cea3-00b2-4c0c-beb3-55812cc4454d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"
Jul 15 23:51:27.525267 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.525229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6b0cea3-00b2-4c0c-beb3-55812cc4454d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-r2rwz\" (UID: \"c6b0cea3-00b2-4c0c-beb3-55812cc4454d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"
Jul 15 23:51:27.525577 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.525556    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6b0cea3-00b2-4c0c-beb3-55812cc4454d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-r2rwz\" (UID: \"c6b0cea3-00b2-4c0c-beb3-55812cc4454d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"
Jul 15 23:51:27.533203 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.533185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl4pm\" (UniqueName: \"kubernetes.io/projected/c6b0cea3-00b2-4c0c-beb3-55812cc4454d-kube-api-access-cl4pm\") pod \"openshift-lws-operator-fd8ccff4c-r2rwz\" (UID: \"c6b0cea3-00b2-4c0c-beb3-55812cc4454d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"
Jul 15 23:51:27.713957 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.713921    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"
Jul 15 23:51:27.843869 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:27.843826    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz"]
Jul 15 23:51:27.846744 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:51:27.846713    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6b0cea3_00b2_4c0c_beb3_55812cc4454d.slice/crio-070be4e4df90ab20f09970b4314a75396ca8f94f7ed665deb9e9429592fc6c6e WatchSource:0}: Error finding container 070be4e4df90ab20f09970b4314a75396ca8f94f7ed665deb9e9429592fc6c6e: Status 404 returned error can't find the container with id 070be4e4df90ab20f09970b4314a75396ca8f94f7ed665deb9e9429592fc6c6e
Jul 15 23:51:28.245933 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:28.245896    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz" event={"ID":"c6b0cea3-00b2-4c0c-beb3-55812cc4454d","Type":"ContainerStarted","Data":"070be4e4df90ab20f09970b4314a75396ca8f94f7ed665deb9e9429592fc6c6e"}
Jul 15 23:51:33.267136 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:33.267096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz" event={"ID":"c6b0cea3-00b2-4c0c-beb3-55812cc4454d","Type":"ContainerStarted","Data":"ce8d5df62fa2f5dbebb9f898091c1bcc5fef10f9c9907c28bf851f015258277c"}
Jul 15 23:51:33.283007 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:33.282960    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r2rwz" podStartSLOduration=1.756569767 podStartE2EDuration="6.282944553s" totalImagesPullingTime="4.526374786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:51:33.281085494 +0000 UTC m=+253.547683108" watchObservedRunningTime="2026-07-15 23:51:33.282944553 +0000 UTC m=+253.549542166"
Jul 15 23:51:36.566412 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.566379    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"]
Jul 15 23:51:36.568852 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.568834    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.571064 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.571044    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 23:51:36.571161 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.571135    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 23:51:36.571787 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.571771    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrrcq\""
Jul 15 23:51:36.577891 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.577870    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"]
Jul 15 23:51:36.591489 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.591461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.591631 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.591501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.591631 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.591531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhr94\" (UniqueName: \"kubernetes.io/projected/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-kube-api-access-jhr94\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.692503 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.692467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.692704 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.692541    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhr94\" (UniqueName: \"kubernetes.io/projected/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-kube-api-access-jhr94\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.692704 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.692658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.692930 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.692912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.693027 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.693013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.699496 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.699474    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhr94\" (UniqueName: \"kubernetes.io/projected/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-kube-api-access-jhr94\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:36.877652 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:36.877547    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:37.021031 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:37.021007    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"]
Jul 15 23:51:37.023452 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:51:37.023426    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8907dca_0e9d_4c41_be4c_b3b5f9c18a94.slice/crio-02aed84cb6325ee31ca2d199d23b25ef31e50e0ecbc3dbeb090edd7841202547 WatchSource:0}: Error finding container 02aed84cb6325ee31ca2d199d23b25ef31e50e0ecbc3dbeb090edd7841202547: Status 404 returned error can't find the container with id 02aed84cb6325ee31ca2d199d23b25ef31e50e0ecbc3dbeb090edd7841202547
Jul 15 23:51:37.285854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:37.285819    2576 generic.go:356] "Generic (PLEG): container finished" podID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerID="e2d42a40c913c65b5d9dcc71adc34d430d2af6c56403a9e6f70919b57d6c579d" exitCode=0
Jul 15 23:51:37.286018 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:37.285890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh" event={"ID":"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94","Type":"ContainerDied","Data":"e2d42a40c913c65b5d9dcc71adc34d430d2af6c56403a9e6f70919b57d6c579d"}
Jul 15 23:51:37.286018 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:37.285941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh" event={"ID":"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94","Type":"ContainerStarted","Data":"02aed84cb6325ee31ca2d199d23b25ef31e50e0ecbc3dbeb090edd7841202547"}
Jul 15 23:51:38.291910 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:38.291827    2576 generic.go:356] "Generic (PLEG): container finished" podID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerID="37bf4b402d82df00aaad3fa4a9108186484859ca8b6353113ae39c8a62dc0282" exitCode=0
Jul 15 23:51:38.291910 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:38.291887    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh" event={"ID":"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94","Type":"ContainerDied","Data":"37bf4b402d82df00aaad3fa4a9108186484859ca8b6353113ae39c8a62dc0282"}
Jul 15 23:51:39.299044 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:39.299010    2576 generic.go:356] "Generic (PLEG): container finished" podID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerID="fa60b01f2c9268fc5be02c22094d7fd45961787fb90a2a37ee17fc3db57e0b6d" exitCode=0
Jul 15 23:51:39.299428 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:39.299096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh" event={"ID":"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94","Type":"ContainerDied","Data":"fa60b01f2c9268fc5be02c22094d7fd45961787fb90a2a37ee17fc3db57e0b6d"}
Jul 15 23:51:40.428277 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.428254    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:40.521049 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.521017    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhr94\" (UniqueName: \"kubernetes.io/projected/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-kube-api-access-jhr94\") pod \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") "
Jul 15 23:51:40.521189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.521065    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-bundle\") pod \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") "
Jul 15 23:51:40.521189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.521097    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-util\") pod \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\" (UID: \"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94\") "
Jul 15 23:51:40.521812 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.521784    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-bundle" (OuterVolumeSpecName: "bundle") pod "d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" (UID: "d8907dca-0e9d-4c41-be4c-b3b5f9c18a94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:51:40.522994 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.522965    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-kube-api-access-jhr94" (OuterVolumeSpecName: "kube-api-access-jhr94") pod "d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" (UID: "d8907dca-0e9d-4c41-be4c-b3b5f9c18a94"). InnerVolumeSpecName "kube-api-access-jhr94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:51:40.526522 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.526502    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-util" (OuterVolumeSpecName: "util") pod "d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" (UID: "d8907dca-0e9d-4c41-be4c-b3b5f9c18a94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:51:40.622565 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.622480    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhr94\" (UniqueName: \"kubernetes.io/projected/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-kube-api-access-jhr94\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:51:40.622565 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.622521    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-bundle\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:51:40.622565 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:40.622530    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8907dca-0e9d-4c41-be4c-b3b5f9c18a94-util\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:51:41.309191 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:41.309166    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh"
Jul 15 23:51:41.309355 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:41.309166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkw6gh" event={"ID":"d8907dca-0e9d-4c41-be4c-b3b5f9c18a94","Type":"ContainerDied","Data":"02aed84cb6325ee31ca2d199d23b25ef31e50e0ecbc3dbeb090edd7841202547"}
Jul 15 23:51:41.309355 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:41.309282    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02aed84cb6325ee31ca2d199d23b25ef31e50e0ecbc3dbeb090edd7841202547"
Jul 15 23:51:48.860984 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.860899    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"]
Jul 15 23:51:48.861432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.861228    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerName="util"
Jul 15 23:51:48.861432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.861240    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerName="util"
Jul 15 23:51:48.861432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.861247    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerName="extract"
Jul 15 23:51:48.861432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.861252    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerName="extract"
Jul 15 23:51:48.861432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.861259    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerName="pull"
Jul 15 23:51:48.861432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.861264    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerName="pull"
Jul 15 23:51:48.861432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.861312    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8907dca-0e9d-4c41-be4c-b3b5f9c18a94" containerName="extract"
Jul 15 23:51:48.864531 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.864511    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:48.866691 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.866665    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 23:51:48.866800 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.866733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-25q44\""
Jul 15 23:51:48.866800 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.866771    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 23:51:48.866912 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.866814    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 23:51:48.866912 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.866870    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 23:51:48.883306 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.883282    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"]
Jul 15 23:51:48.983582 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.983546    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:48.983582 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.983582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-manifests\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:48.983800 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.983683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c46pz\" (UniqueName: \"kubernetes.io/projected/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-kube-api-access-c46pz\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:48.983800 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.983723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:48.983800 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:48.983764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-tmp\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.084685 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.084654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46pz\" (UniqueName: \"kubernetes.io/projected/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-kube-api-access-c46pz\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.084685 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.084692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.084906 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.084724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-tmp\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.084906 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.084749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.084906 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.084766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-manifests\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.085104 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.085087    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-manifests\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.087108 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.087077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-tmp\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.087327 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.087303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.087388 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.087317    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.091369 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.091351    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c46pz\" (UniqueName: \"kubernetes.io/projected/6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb-kube-api-access-c46pz\") pod \"opendatahub-operator-controller-manager-7b4446c48-c45tz\" (UID: \"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb\") " pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.174372 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.174343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:49.307063 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.307031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"]
Jul 15 23:51:49.309527 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:51:49.309496    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7b9dc2_98d6_453f_b3e2_7b7c6584ecbb.slice/crio-410a4eaef18f4680eed25c6964de731aa7506e07418358c4644ff4a7d5f3db4d WatchSource:0}: Error finding container 410a4eaef18f4680eed25c6964de731aa7506e07418358c4644ff4a7d5f3db4d: Status 404 returned error can't find the container with id 410a4eaef18f4680eed25c6964de731aa7506e07418358c4644ff4a7d5f3db4d
Jul 15 23:51:49.343073 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:49.343046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz" event={"ID":"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb","Type":"ContainerStarted","Data":"410a4eaef18f4680eed25c6964de731aa7506e07418358c4644ff4a7d5f3db4d"}
Jul 15 23:51:52.358823 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:52.358788    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz" event={"ID":"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb","Type":"ContainerStarted","Data":"f50613217c0488e641176f62a37b310ad8cdc6bf3fc07a9736c59b1a5ca49df2"}
Jul 15 23:51:53.365066 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:53.365038    2576 generic.go:356] "Generic (PLEG): container finished" podID="6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb" containerID="f50613217c0488e641176f62a37b310ad8cdc6bf3fc07a9736c59b1a5ca49df2" exitCode=0
Jul 15 23:51:53.365379 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:53.365120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz" event={"ID":"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb","Type":"ContainerDied","Data":"f50613217c0488e641176f62a37b310ad8cdc6bf3fc07a9736c59b1a5ca49df2"}
Jul 15 23:51:54.371682 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:54.371632    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz" event={"ID":"6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb","Type":"ContainerStarted","Data":"2c7ac22f019350b52943cca2d3773556ad0671df0f288baea00c00a4b0923f2f"}
Jul 15 23:51:54.372102 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:54.371764    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:51:54.391790 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:51:54.391739    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz" podStartSLOduration=2.114703929 podStartE2EDuration="6.391720367s" totalImagesPullingTime="3.270669009s" totalInitContainerRuntime="1.006347429s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:51:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:51:54.390199858 +0000 UTC m=+274.656797471" watchObservedRunningTime="2026-07-15 23:51:54.391720367 +0000 UTC m=+274.658317981"
Jul 15 23:52:05.378993 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:05.378965    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b4446c48-c45tz"
Jul 15 23:52:07.882989 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:07.882949    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"]
Jul 15 23:52:07.896885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:07.896860    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:07.901188 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:07.901151    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"]
Jul 15 23:52:07.901457 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:07.901433    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 23:52:07.901643 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:07.901621    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 23:52:07.901742 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:07.901634    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 23:52:07.902032 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:07.902018    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 23:52:07.902553 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:07.902538    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qkhkj\""
Jul 15 23:52:08.047299 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.047263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmcfr\" (UniqueName: \"kubernetes.io/projected/d8e7bd56-d384-4f16-a015-689b9bc9d12b-kube-api-access-zmcfr\") pod \"kube-auth-proxy-797ddd4965-5w98x\" (UID: \"d8e7bd56-d384-4f16-a015-689b9bc9d12b\") " pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.047494 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.047308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e7bd56-d384-4f16-a015-689b9bc9d12b-tls-certs\") pod \"kube-auth-proxy-797ddd4965-5w98x\" (UID: \"d8e7bd56-d384-4f16-a015-689b9bc9d12b\") " pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.047494 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.047423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8e7bd56-d384-4f16-a015-689b9bc9d12b-tmp\") pod \"kube-auth-proxy-797ddd4965-5w98x\" (UID: \"d8e7bd56-d384-4f16-a015-689b9bc9d12b\") " pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.125940 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.125909    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2mm67"]
Jul 15 23:52:08.129304 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.129288    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:08.131633 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.131591    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 23:52:08.131744 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.131689    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jmf8s\""
Jul 15 23:52:08.142329 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.142306    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2mm67"]
Jul 15 23:52:08.148572 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.148547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8e7bd56-d384-4f16-a015-689b9bc9d12b-tmp\") pod \"kube-auth-proxy-797ddd4965-5w98x\" (UID: \"d8e7bd56-d384-4f16-a015-689b9bc9d12b\") " pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.148692 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.148637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmcfr\" (UniqueName: \"kubernetes.io/projected/d8e7bd56-d384-4f16-a015-689b9bc9d12b-kube-api-access-zmcfr\") pod \"kube-auth-proxy-797ddd4965-5w98x\" (UID: \"d8e7bd56-d384-4f16-a015-689b9bc9d12b\") " pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.148692 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.148683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e7bd56-d384-4f16-a015-689b9bc9d12b-tls-certs\") pod \"kube-auth-proxy-797ddd4965-5w98x\" (UID: \"d8e7bd56-d384-4f16-a015-689b9bc9d12b\") " pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.150951 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.150929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8e7bd56-d384-4f16-a015-689b9bc9d12b-tmp\") pod \"kube-auth-proxy-797ddd4965-5w98x\" (UID: \"d8e7bd56-d384-4f16-a015-689b9bc9d12b\") " pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.151485 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.151465    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e7bd56-d384-4f16-a015-689b9bc9d12b-tls-certs\") pod \"kube-auth-proxy-797ddd4965-5w98x\" (UID: \"d8e7bd56-d384-4f16-a015-689b9bc9d12b\") " pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.158909 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.158890    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmcfr\" (UniqueName: \"kubernetes.io/projected/d8e7bd56-d384-4f16-a015-689b9bc9d12b-kube-api-access-zmcfr\") pod \"kube-auth-proxy-797ddd4965-5w98x\" (UID: \"d8e7bd56-d384-4f16-a015-689b9bc9d12b\") " pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.208372 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.208323    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"
Jul 15 23:52:08.249414 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.249385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53f83ad8-d610-41c9-a230-db8bb149dbe0-cert\") pod \"odh-model-controller-7998c67dc4-2mm67\" (UID: \"53f83ad8-d610-41c9-a230-db8bb149dbe0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:08.249577 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.249474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctwhz\" (UniqueName: \"kubernetes.io/projected/53f83ad8-d610-41c9-a230-db8bb149dbe0-kube-api-access-ctwhz\") pod \"odh-model-controller-7998c67dc4-2mm67\" (UID: \"53f83ad8-d610-41c9-a230-db8bb149dbe0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:08.348179 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.348156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-797ddd4965-5w98x"]
Jul 15 23:52:08.349985 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.349959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwhz\" (UniqueName: \"kubernetes.io/projected/53f83ad8-d610-41c9-a230-db8bb149dbe0-kube-api-access-ctwhz\") pod \"odh-model-controller-7998c67dc4-2mm67\" (UID: \"53f83ad8-d610-41c9-a230-db8bb149dbe0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:08.350128 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.350010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53f83ad8-d610-41c9-a230-db8bb149dbe0-cert\") pod \"odh-model-controller-7998c67dc4-2mm67\" (UID: \"53f83ad8-d610-41c9-a230-db8bb149dbe0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:08.350844 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:52:08.350820    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e7bd56_d384_4f16_a015_689b9bc9d12b.slice/crio-0826be32d1dcc266e81dfdb41d585d105feda943aa30b3cfacf16341d6a16d38 WatchSource:0}: Error finding container 0826be32d1dcc266e81dfdb41d585d105feda943aa30b3cfacf16341d6a16d38: Status 404 returned error can't find the container with id 0826be32d1dcc266e81dfdb41d585d105feda943aa30b3cfacf16341d6a16d38
Jul 15 23:52:08.352422 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.352401    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53f83ad8-d610-41c9-a230-db8bb149dbe0-cert\") pod \"odh-model-controller-7998c67dc4-2mm67\" (UID: \"53f83ad8-d610-41c9-a230-db8bb149dbe0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:08.357994 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.357971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctwhz\" (UniqueName: \"kubernetes.io/projected/53f83ad8-d610-41c9-a230-db8bb149dbe0-kube-api-access-ctwhz\") pod \"odh-model-controller-7998c67dc4-2mm67\" (UID: \"53f83ad8-d610-41c9-a230-db8bb149dbe0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:08.433739 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.433645    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x" event={"ID":"d8e7bd56-d384-4f16-a015-689b9bc9d12b","Type":"ContainerStarted","Data":"0826be32d1dcc266e81dfdb41d585d105feda943aa30b3cfacf16341d6a16d38"}
Jul 15 23:52:08.438923 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.438908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:08.598269 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:08.598237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2mm67"]
Jul 15 23:52:08.601893 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:52:08.601865    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f83ad8_d610_41c9_a230_db8bb149dbe0.slice/crio-c499aeefae70c0ba339297af5b5a5d4a119796b26a8bd72d34d293f2cda5cda8 WatchSource:0}: Error finding container c499aeefae70c0ba339297af5b5a5d4a119796b26a8bd72d34d293f2cda5cda8: Status 404 returned error can't find the container with id c499aeefae70c0ba339297af5b5a5d4a119796b26a8bd72d34d293f2cda5cda8
Jul 15 23:52:09.072034 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.072002    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"]
Jul 15 23:52:09.075505 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.075477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.077876 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.077537    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 23:52:09.077876 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.077651    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 23:52:09.077876 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.077747    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 23:52:09.077876 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.077768    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 23:52:09.077876 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.077869    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7vcll\""
Jul 15 23:52:09.088549 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.088527    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"]
Jul 15 23:52:09.156092 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.156035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-token\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.156092 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.156077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkttn\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-kube-api-access-dkttn\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.156285 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.156153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-cacerts\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.156285 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.156216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.156285 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.156266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ac75b4-435f-4640-b1b0-0a1378e07947-local-certs\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.156436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.156298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.156436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.156388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.257405 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.257360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.257584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.257427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ac75b4-435f-4640-b1b0-0a1378e07947-local-certs\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.257584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.257460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.257584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.257518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.257584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.257554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-token\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.257584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.257578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkttn\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-kube-api-access-dkttn\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.257868 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.257631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-cacerts\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.258581 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.258420    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.261344 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.261296    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ac75b4-435f-4640-b1b0-0a1378e07947-local-certs\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.262098 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.262057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.262843 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.262801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-cacerts\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.264764 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.264739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.267592 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.267550    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkttn\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-kube-api-access-dkttn\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.268847 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.268806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-token\") pod \"istiod-openshift-gateway-7574459656-5cwpb\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.389165 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.388715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:09.441887 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.441837    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2mm67" event={"ID":"53f83ad8-d610-41c9-a230-db8bb149dbe0","Type":"ContainerStarted","Data":"c499aeefae70c0ba339297af5b5a5d4a119796b26a8bd72d34d293f2cda5cda8"}
Jul 15 23:52:09.576764 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:09.575469    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"]
Jul 15 23:52:09.580360 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:52:09.580327    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ac75b4_435f_4640_b1b0_0a1378e07947.slice/crio-d5fc52084cc18677940abebee9d0a10fb56d00e89aac87e0511e2aced500b571 WatchSource:0}: Error finding container d5fc52084cc18677940abebee9d0a10fb56d00e89aac87e0511e2aced500b571: Status 404 returned error can't find the container with id d5fc52084cc18677940abebee9d0a10fb56d00e89aac87e0511e2aced500b571
Jul 15 23:52:10.453657 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:10.453566    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb" event={"ID":"51ac75b4-435f-4640-b1b0-0a1378e07947","Type":"ContainerStarted","Data":"d5fc52084cc18677940abebee9d0a10fb56d00e89aac87e0511e2aced500b571"}
Jul 15 23:52:13.581912 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:13.581833    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:52:13.582325 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:13.581911    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:52:14.476711 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.476666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb" event={"ID":"51ac75b4-435f-4640-b1b0-0a1378e07947","Type":"ContainerStarted","Data":"03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e"}
Jul 15 23:52:14.477090 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.477069    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:14.484062 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.484033    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5cwpb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 23:52:14.484319 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.484279    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb" podUID="51ac75b4-435f-4640-b1b0-0a1378e07947" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 23:52:14.485168 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.485138    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x" event={"ID":"d8e7bd56-d384-4f16-a015-689b9bc9d12b","Type":"ContainerStarted","Data":"0abeedc8ec46890b7b5fb8beba3d71d5e0258dc5adbf39e49bc120dce0cc3522"}
Jul 15 23:52:14.486956 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.486935    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2mm67" event={"ID":"53f83ad8-d610-41c9-a230-db8bb149dbe0","Type":"ContainerStarted","Data":"9389c723a12f90dad6d50db04f89647e0a8ea4a5d33b896cfc97ddc2b3f4495c"}
Jul 15 23:52:14.487092 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.487074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:14.502301 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.502257    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb" podStartSLOduration=1.503685387 podStartE2EDuration="5.502243774s" totalImagesPullingTime="3.998558387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:52:14.50095696 +0000 UTC m=+294.767554575" watchObservedRunningTime="2026-07-15 23:52:14.502243774 +0000 UTC m=+294.768841388"
Jul 15 23:52:14.515692 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.515647    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-797ddd4965-5w98x" podStartSLOduration=2.293424876 podStartE2EDuration="7.51563357s" totalImagesPullingTime="5.222208694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:52:14.51451196 +0000 UTC m=+294.781109589" watchObservedRunningTime="2026-07-15 23:52:14.51563357 +0000 UTC m=+294.782231201"
Jul 15 23:52:14.528116 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:14.528074    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2mm67" podStartSLOduration=1.550633616 podStartE2EDuration="6.528058173s" totalImagesPullingTime="4.977424557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:52:14.527869177 +0000 UTC m=+294.794466792" watchObservedRunningTime="2026-07-15 23:52:14.528058173 +0000 UTC m=+294.794655791"
Jul 15 23:52:15.492483 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:15.492455    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:19.341715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.341671    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"]
Jul 15 23:52:19.347185 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.347160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:19.351099 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.351071    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lc5cw\""
Jul 15 23:52:19.351099 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.351093    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 23:52:19.357133 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.357106    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"]
Jul 15 23:52:19.360327 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.360309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:19.365808 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:52:19.365775    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"llmisvc-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" type="*v1.Secret"
Jul 15 23:52:19.365808 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:52:19.365777    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"llmisvc-controller-manager-dockercfg-gzxmv\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gzxmv\"" type="*v1.Secret"
Jul 15 23:52:19.368444 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.368421    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"]
Jul 15 23:52:19.385662 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.385640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"]
Jul 15 23:52:19.454956 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.454929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da6dde6-5159-42e8-be68-e7ea7e3569ad-cert\") pod \"kserve-controller-manager-d6f4b65b8-kkvj4\" (UID: \"5da6dde6-5159-42e8-be68-e7ea7e3569ad\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:19.455124 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.454983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdpvr\" (UniqueName: \"kubernetes.io/projected/5da6dde6-5159-42e8-be68-e7ea7e3569ad-kube-api-access-fdpvr\") pod \"kserve-controller-manager-d6f4b65b8-kkvj4\" (UID: \"5da6dde6-5159-42e8-be68-e7ea7e3569ad\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:19.455124 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.455010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d0d2432-bbb9-4875-bb46-5f6444a02c29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k99b6\" (UID: \"4d0d2432-bbb9-4875-bb46-5f6444a02c29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:19.455124 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.455045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s8zh\" (UniqueName: \"kubernetes.io/projected/4d0d2432-bbb9-4875-bb46-5f6444a02c29-kube-api-access-7s8zh\") pod \"llmisvc-controller-manager-777c6bd7d5-k99b6\" (UID: \"4d0d2432-bbb9-4875-bb46-5f6444a02c29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:19.555994 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.555957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d0d2432-bbb9-4875-bb46-5f6444a02c29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k99b6\" (UID: \"4d0d2432-bbb9-4875-bb46-5f6444a02c29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:19.556199 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.556013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s8zh\" (UniqueName: \"kubernetes.io/projected/4d0d2432-bbb9-4875-bb46-5f6444a02c29-kube-api-access-7s8zh\") pod \"llmisvc-controller-manager-777c6bd7d5-k99b6\" (UID: \"4d0d2432-bbb9-4875-bb46-5f6444a02c29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:19.556199 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.556081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da6dde6-5159-42e8-be68-e7ea7e3569ad-cert\") pod \"kserve-controller-manager-d6f4b65b8-kkvj4\" (UID: \"5da6dde6-5159-42e8-be68-e7ea7e3569ad\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:19.556199 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.556159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdpvr\" (UniqueName: \"kubernetes.io/projected/5da6dde6-5159-42e8-be68-e7ea7e3569ad-kube-api-access-fdpvr\") pod \"kserve-controller-manager-d6f4b65b8-kkvj4\" (UID: \"5da6dde6-5159-42e8-be68-e7ea7e3569ad\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:19.563300 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.563225    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da6dde6-5159-42e8-be68-e7ea7e3569ad-cert\") pod \"kserve-controller-manager-d6f4b65b8-kkvj4\" (UID: \"5da6dde6-5159-42e8-be68-e7ea7e3569ad\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:19.566471 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.566445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdpvr\" (UniqueName: \"kubernetes.io/projected/5da6dde6-5159-42e8-be68-e7ea7e3569ad-kube-api-access-fdpvr\") pod \"kserve-controller-manager-d6f4b65b8-kkvj4\" (UID: \"5da6dde6-5159-42e8-be68-e7ea7e3569ad\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:19.566578 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.566442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s8zh\" (UniqueName: \"kubernetes.io/projected/4d0d2432-bbb9-4875-bb46-5f6444a02c29-kube-api-access-7s8zh\") pod \"llmisvc-controller-manager-777c6bd7d5-k99b6\" (UID: \"4d0d2432-bbb9-4875-bb46-5f6444a02c29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:19.657975 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.657944    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:19.790330 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:19.790273    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"]
Jul 15 23:52:19.792808 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:52:19.792777    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da6dde6_5159_42e8_be68_e7ea7e3569ad.slice/crio-7cb6a6736dfcadad48a902a9260a718b2cafcbc7b8814008c756eac3ef2225fe WatchSource:0}: Error finding container 7cb6a6736dfcadad48a902a9260a718b2cafcbc7b8814008c756eac3ef2225fe: Status 404 returned error can't find the container with id 7cb6a6736dfcadad48a902a9260a718b2cafcbc7b8814008c756eac3ef2225fe
Jul 15 23:52:20.033015 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:20.032931    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 15 23:52:20.035029 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:20.034998    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 15 23:52:20.040945 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:20.040927    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 23:52:20.190853 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:20.190730    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 23:52:20.204253 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:52:20.196802    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 15 23:52:20.204253 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:52:20.196856    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d0d2432-bbb9-4875-bb46-5f6444a02c29-cert podName:4d0d2432-bbb9-4875-bb46-5f6444a02c29 nodeName:}" failed. No retries permitted until 2026-07-15 23:52:20.696839898 +0000 UTC m=+300.963437490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4d0d2432-bbb9-4875-bb46-5f6444a02c29-cert") pod "llmisvc-controller-manager-777c6bd7d5-k99b6" (UID: "4d0d2432-bbb9-4875-bb46-5f6444a02c29") : secret "llmisvc-webhook-server-cert" not found
Jul 15 23:52:20.339667 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:20.339573    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gzxmv\""
Jul 15 23:52:20.520145 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:20.520079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4" event={"ID":"5da6dde6-5159-42e8-be68-e7ea7e3569ad","Type":"ContainerStarted","Data":"7cb6a6736dfcadad48a902a9260a718b2cafcbc7b8814008c756eac3ef2225fe"}
Jul 15 23:52:20.766551 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:20.766509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d0d2432-bbb9-4875-bb46-5f6444a02c29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k99b6\" (UID: \"4d0d2432-bbb9-4875-bb46-5f6444a02c29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:20.767028 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:52:20.766739    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 15 23:52:20.767204 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:52:20.767088    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d0d2432-bbb9-4875-bb46-5f6444a02c29-cert podName:4d0d2432-bbb9-4875-bb46-5f6444a02c29 nodeName:}" failed. No retries permitted until 2026-07-15 23:52:21.767065655 +0000 UTC m=+302.033663255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4d0d2432-bbb9-4875-bb46-5f6444a02c29-cert") pod "llmisvc-controller-manager-777c6bd7d5-k99b6" (UID: "4d0d2432-bbb9-4875-bb46-5f6444a02c29") : secret "llmisvc-webhook-server-cert" not found
Jul 15 23:52:21.774713 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:21.774672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d0d2432-bbb9-4875-bb46-5f6444a02c29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k99b6\" (UID: \"4d0d2432-bbb9-4875-bb46-5f6444a02c29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:21.777178 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:21.777111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d0d2432-bbb9-4875-bb46-5f6444a02c29-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k99b6\" (UID: \"4d0d2432-bbb9-4875-bb46-5f6444a02c29\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:22.070234 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:22.070155    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:22.216666 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:22.216637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"]
Jul 15 23:52:22.218380 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:52:22.218335    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4d0d2432_bbb9_4875_bb46_5f6444a02c29.slice/crio-40280834ff63ceb1412819e7e55d89e0fdd145e2ed6f1c847847d07ff3d34058 WatchSource:0}: Error finding container 40280834ff63ceb1412819e7e55d89e0fdd145e2ed6f1c847847d07ff3d34058: Status 404 returned error can't find the container with id 40280834ff63ceb1412819e7e55d89e0fdd145e2ed6f1c847847d07ff3d34058
Jul 15 23:52:22.220040 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:22.220012    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:52:22.531247 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:22.531215    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4" event={"ID":"5da6dde6-5159-42e8-be68-e7ea7e3569ad","Type":"ContainerStarted","Data":"3e73e9e1db41a83f7259b216c2be5d79cdcae16014af91d666178543a6a37965"}
Jul 15 23:52:22.531414 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:22.531343    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:22.532416 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:22.532394    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6" event={"ID":"4d0d2432-bbb9-4875-bb46-5f6444a02c29","Type":"ContainerStarted","Data":"40280834ff63ceb1412819e7e55d89e0fdd145e2ed6f1c847847d07ff3d34058"}
Jul 15 23:52:22.548417 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:22.548347    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4" podStartSLOduration=1.4978455560000001 podStartE2EDuration="3.548333498s" totalImagesPullingTime="2.050487942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:52:22.547142771 +0000 UTC m=+302.813740386" watchObservedRunningTime="2026-07-15 23:52:22.548333498 +0000 UTC m=+302.814931174"
Jul 15 23:52:25.494143 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:25.494108    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2mm67"
Jul 15 23:52:25.553092 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:25.553059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6" event={"ID":"4d0d2432-bbb9-4875-bb46-5f6444a02c29","Type":"ContainerStarted","Data":"bc94884a6251d852c053bec440318c1591c74ddef587411bd3f21f6d2c8d6757"}
Jul 15 23:52:25.553276 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:25.553214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:52:25.570446 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:25.570387    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6" podStartSLOduration=3.85249064 podStartE2EDuration="6.570356676s" totalImagesPullingTime="2.717866036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:52:25.569218418 +0000 UTC m=+305.835816033" watchObservedRunningTime="2026-07-15 23:52:25.570356676 +0000 UTC m=+305.836954296"
Jul 15 23:52:27.834613 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:27.834577    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"]
Jul 15 23:52:27.835034 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:27.834800    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb" podUID="51ac75b4-435f-4640-b1b0-0a1378e07947" containerName="discovery" containerID="cri-o://03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e" gracePeriod=30
Jul 15 23:52:28.099902 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.099874    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:28.124841 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.124812    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ac75b4-435f-4640-b1b0-0a1378e07947-local-certs\") pod \"51ac75b4-435f-4640-b1b0-0a1378e07947\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") "
Jul 15 23:52:28.124995 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.124875    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-cacerts\") pod \"51ac75b4-435f-4640-b1b0-0a1378e07947\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") "
Jul 15 23:52:28.124995 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.124908    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-kubeconfig\") pod \"51ac75b4-435f-4640-b1b0-0a1378e07947\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") "
Jul 15 23:52:28.124995 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.124930    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-dns-cert\") pod \"51ac75b4-435f-4640-b1b0-0a1378e07947\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") "
Jul 15 23:52:28.124995 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.124969    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-token\") pod \"51ac75b4-435f-4640-b1b0-0a1378e07947\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") "
Jul 15 23:52:28.125228 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.125011    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-ca-configmap\") pod \"51ac75b4-435f-4640-b1b0-0a1378e07947\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") "
Jul 15 23:52:28.125228 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.125070    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkttn\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-kube-api-access-dkttn\") pod \"51ac75b4-435f-4640-b1b0-0a1378e07947\" (UID: \"51ac75b4-435f-4640-b1b0-0a1378e07947\") "
Jul 15 23:52:28.125717 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.125664    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "51ac75b4-435f-4640-b1b0-0a1378e07947" (UID: "51ac75b4-435f-4640-b1b0-0a1378e07947"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:52:28.127286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.127246    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-cacerts" (OuterVolumeSpecName: "cacerts") pod "51ac75b4-435f-4640-b1b0-0a1378e07947" (UID: "51ac75b4-435f-4640-b1b0-0a1378e07947"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:52:28.127407 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.127374    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ac75b4-435f-4640-b1b0-0a1378e07947-local-certs" (OuterVolumeSpecName: "local-certs") pod "51ac75b4-435f-4640-b1b0-0a1378e07947" (UID: "51ac75b4-435f-4640-b1b0-0a1378e07947"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:52:28.127510 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.127433    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "51ac75b4-435f-4640-b1b0-0a1378e07947" (UID: "51ac75b4-435f-4640-b1b0-0a1378e07947"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:52:28.128025 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.128002    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "51ac75b4-435f-4640-b1b0-0a1378e07947" (UID: "51ac75b4-435f-4640-b1b0-0a1378e07947"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:52:28.128122 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.128024    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-kube-api-access-dkttn" (OuterVolumeSpecName: "kube-api-access-dkttn") pod "51ac75b4-435f-4640-b1b0-0a1378e07947" (UID: "51ac75b4-435f-4640-b1b0-0a1378e07947"). InnerVolumeSpecName "kube-api-access-dkttn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:52:28.128122 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.128049    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-token" (OuterVolumeSpecName: "istio-token") pod "51ac75b4-435f-4640-b1b0-0a1378e07947" (UID: "51ac75b4-435f-4640-b1b0-0a1378e07947"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:52:28.225657 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.225632    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkttn\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-kube-api-access-dkttn\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:52:28.225657 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.225657    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51ac75b4-435f-4640-b1b0-0a1378e07947-local-certs\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:52:28.225824 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.225666    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-cacerts\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:52:28.225824 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.225673    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-kubeconfig\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:52:28.225824 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.225681    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-dns-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:52:28.225824 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.225688    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-token\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:52:28.225824 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.225696    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51ac75b4-435f-4640-b1b0-0a1378e07947-istio-csr-ca-configmap\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:52:28.568807 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.568771    2576 generic.go:356] "Generic (PLEG): container finished" podID="51ac75b4-435f-4640-b1b0-0a1378e07947" containerID="03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e" exitCode=0
Jul 15 23:52:28.568958 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.568815    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"
Jul 15 23:52:28.568958 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.568847    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb" event={"ID":"51ac75b4-435f-4640-b1b0-0a1378e07947","Type":"ContainerDied","Data":"03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e"}
Jul 15 23:52:28.568958 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.568902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb" event={"ID":"51ac75b4-435f-4640-b1b0-0a1378e07947","Type":"ContainerDied","Data":"d5fc52084cc18677940abebee9d0a10fb56d00e89aac87e0511e2aced500b571"}
Jul 15 23:52:28.568958 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.568928    2576 scope.go:117] "RemoveContainer" containerID="03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e"
Jul 15 23:52:28.578313 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.578293    2576 scope.go:117] "RemoveContainer" containerID="03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e"
Jul 15 23:52:28.578584 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:52:28.578560    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e\": container with ID starting with 03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e not found: ID does not exist" containerID="03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e"
Jul 15 23:52:28.578692 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.578591    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e"} err="failed to get container status \"03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e\": rpc error: code = NotFound desc = could not find container \"03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e\": container with ID starting with 03c2db069623a2c5f6dc47cffee64e786c2164b195d48041ffc36fc56cc74b1e not found: ID does not exist"
Jul 15 23:52:28.585015 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.584994    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"]
Jul 15 23:52:28.588874 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:28.588855    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cwpb"]
Jul 15 23:52:30.186079 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:30.186046    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ac75b4-435f-4640-b1b0-0a1378e07947" path="/var/lib/kubelet/pods/51ac75b4-435f-4640-b1b0-0a1378e07947/volumes"
Jul 15 23:52:53.544557 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:53.544529    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkvj4"
Jul 15 23:52:56.559479 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:52:56.559450    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k99b6"
Jul 15 23:53:08.948586 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:08.948546    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8rcs"]
Jul 15 23:53:08.949128 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:08.949022    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ac75b4-435f-4640-b1b0-0a1378e07947" containerName="discovery"
Jul 15 23:53:08.949128 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:08.949041    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ac75b4-435f-4640-b1b0-0a1378e07947" containerName="discovery"
Jul 15 23:53:08.949242 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:08.949155    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ac75b4-435f-4640-b1b0-0a1378e07947" containerName="discovery"
Jul 15 23:53:08.963647 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:08.963595    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8rcs"]
Jul 15 23:53:08.963788 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:08.963728    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs"
Jul 15 23:53:08.966076 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:08.966055    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 23:53:08.966198 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:08.966061    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qvrg6\""
Jul 15 23:53:08.966876 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:08.966858    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 23:53:09.061241 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.061208    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wklgq\" (UniqueName: \"kubernetes.io/projected/316724a7-1ede-4a64-93e9-e19b9bf60164-kube-api-access-wklgq\") pod \"kuadrant-operator-catalog-l8rcs\" (UID: \"316724a7-1ede-4a64-93e9-e19b9bf60164\") " pod="kuadrant-system/kuadrant-operator-catalog-l8rcs"
Jul 15 23:53:09.162524 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.162490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wklgq\" (UniqueName: \"kubernetes.io/projected/316724a7-1ede-4a64-93e9-e19b9bf60164-kube-api-access-wklgq\") pod \"kuadrant-operator-catalog-l8rcs\" (UID: \"316724a7-1ede-4a64-93e9-e19b9bf60164\") " pod="kuadrant-system/kuadrant-operator-catalog-l8rcs"
Jul 15 23:53:09.170319 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.170297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wklgq\" (UniqueName: \"kubernetes.io/projected/316724a7-1ede-4a64-93e9-e19b9bf60164-kube-api-access-wklgq\") pod \"kuadrant-operator-catalog-l8rcs\" (UID: \"316724a7-1ede-4a64-93e9-e19b9bf60164\") " pod="kuadrant-system/kuadrant-operator-catalog-l8rcs"
Jul 15 23:53:09.274923 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.274843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs"
Jul 15 23:53:09.316052 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.316017    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8rcs"]
Jul 15 23:53:09.406162 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.406139    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8rcs"]
Jul 15 23:53:09.408053 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:09.408029    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316724a7_1ede_4a64_93e9_e19b9bf60164.slice/crio-b694f150233d9e64f59dcf1e9fe906553eef6d7d514eee77a4e5d3ee499af5db WatchSource:0}: Error finding container b694f150233d9e64f59dcf1e9fe906553eef6d7d514eee77a4e5d3ee499af5db: Status 404 returned error can't find the container with id b694f150233d9e64f59dcf1e9fe906553eef6d7d514eee77a4e5d3ee499af5db
Jul 15 23:53:09.526132 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.526046    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvptw"]
Jul 15 23:53:09.530799 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.530783    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvptw"
Jul 15 23:53:09.537017 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.536993    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvptw"]
Jul 15 23:53:09.666777 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.666743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhwhk\" (UniqueName: \"kubernetes.io/projected/3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0-kube-api-access-xhwhk\") pod \"kuadrant-operator-catalog-lvptw\" (UID: \"3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0\") " pod="kuadrant-system/kuadrant-operator-catalog-lvptw"
Jul 15 23:53:09.763806 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.763771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs" event={"ID":"316724a7-1ede-4a64-93e9-e19b9bf60164","Type":"ContainerStarted","Data":"b694f150233d9e64f59dcf1e9fe906553eef6d7d514eee77a4e5d3ee499af5db"}
Jul 15 23:53:09.768192 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.768173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhwhk\" (UniqueName: \"kubernetes.io/projected/3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0-kube-api-access-xhwhk\") pod \"kuadrant-operator-catalog-lvptw\" (UID: \"3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0\") " pod="kuadrant-system/kuadrant-operator-catalog-lvptw"
Jul 15 23:53:09.776480 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.776428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhwhk\" (UniqueName: \"kubernetes.io/projected/3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0-kube-api-access-xhwhk\") pod \"kuadrant-operator-catalog-lvptw\" (UID: \"3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0\") " pod="kuadrant-system/kuadrant-operator-catalog-lvptw"
Jul 15 23:53:09.841195 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.841164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvptw"
Jul 15 23:53:09.974044 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:09.973979    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvptw"]
Jul 15 23:53:09.976197 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:09.976158    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7f58d7_2d5b_4e30_88c9_eea7ff8415f0.slice/crio-8be8f403be058e303e1dd4f25c00c496d873516d646edcaa8f4ca4b90f51aa7e WatchSource:0}: Error finding container 8be8f403be058e303e1dd4f25c00c496d873516d646edcaa8f4ca4b90f51aa7e: Status 404 returned error can't find the container with id 8be8f403be058e303e1dd4f25c00c496d873516d646edcaa8f4ca4b90f51aa7e
Jul 15 23:53:10.770904 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:10.770864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvptw" event={"ID":"3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0","Type":"ContainerStarted","Data":"8be8f403be058e303e1dd4f25c00c496d873516d646edcaa8f4ca4b90f51aa7e"}
Jul 15 23:53:11.779207 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:11.779176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvptw" event={"ID":"3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0","Type":"ContainerStarted","Data":"30d5cd9f80ce657524ebf07d64632805de38f039b8d56bdeaf6845fdbf6fa55e"}
Jul 15 23:53:11.780967 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:11.780941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs" event={"ID":"316724a7-1ede-4a64-93e9-e19b9bf60164","Type":"ContainerStarted","Data":"70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892"}
Jul 15 23:53:11.781090 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:11.780992    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs" podUID="316724a7-1ede-4a64-93e9-e19b9bf60164" containerName="registry-server" containerID="cri-o://70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892" gracePeriod=2
Jul 15 23:53:11.794369 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:11.794316    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lvptw" podStartSLOduration=1.078840423 podStartE2EDuration="2.794296048s" totalImagesPullingTime="1.715455625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:53:11.792801385 +0000 UTC m=+352.059399001" watchObservedRunningTime="2026-07-15 23:53:11.794296048 +0000 UTC m=+352.060893665"
Jul 15 23:53:11.808367 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:11.808297    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs" podStartSLOduration=1.525805098 podStartE2EDuration="3.808282215s" totalImagesPullingTime="2.282477117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:53:11.806918135 +0000 UTC m=+352.073515750" watchObservedRunningTime="2026-07-15 23:53:11.808282215 +0000 UTC m=+352.074879828"
Jul 15 23:53:12.015141 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.015118    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l8rcs_316724a7-1ede-4a64-93e9-e19b9bf60164/registry-server/0.log"
Jul 15 23:53:12.017560 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.017541    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs"
Jul 15 23:53:12.188356 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.188326    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wklgq\" (UniqueName: \"kubernetes.io/projected/316724a7-1ede-4a64-93e9-e19b9bf60164-kube-api-access-wklgq\") pod \"316724a7-1ede-4a64-93e9-e19b9bf60164\" (UID: \"316724a7-1ede-4a64-93e9-e19b9bf60164\") "
Jul 15 23:53:12.190432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.190401    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/316724a7-1ede-4a64-93e9-e19b9bf60164-kube-api-access-wklgq" (OuterVolumeSpecName: "kube-api-access-wklgq") pod "316724a7-1ede-4a64-93e9-e19b9bf60164" (UID: "316724a7-1ede-4a64-93e9-e19b9bf60164"). InnerVolumeSpecName "kube-api-access-wklgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:53:12.289213 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.289137    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wklgq\" (UniqueName: \"kubernetes.io/projected/316724a7-1ede-4a64-93e9-e19b9bf60164-kube-api-access-wklgq\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:12.787010 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.786985    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-l8rcs_316724a7-1ede-4a64-93e9-e19b9bf60164/registry-server/0.log"
Jul 15 23:53:12.787408 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.787021    2576 generic.go:356] "Generic (PLEG): container finished" podID="316724a7-1ede-4a64-93e9-e19b9bf60164" containerID="70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892" exitCode=2
Jul 15 23:53:12.787408 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.787067    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs"
Jul 15 23:53:12.787408 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.787105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs" event={"ID":"316724a7-1ede-4a64-93e9-e19b9bf60164","Type":"ContainerDied","Data":"70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892"}
Jul 15 23:53:12.787408 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.787152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8rcs" event={"ID":"316724a7-1ede-4a64-93e9-e19b9bf60164","Type":"ContainerDied","Data":"b694f150233d9e64f59dcf1e9fe906553eef6d7d514eee77a4e5d3ee499af5db"}
Jul 15 23:53:12.787408 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.787175    2576 scope.go:117] "RemoveContainer" containerID="70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892"
Jul 15 23:53:12.796055 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.796036    2576 scope.go:117] "RemoveContainer" containerID="70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892"
Jul 15 23:53:12.796276 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:53:12.796257    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892\": container with ID starting with 70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892 not found: ID does not exist" containerID="70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892"
Jul 15 23:53:12.796348 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.796281    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892"} err="failed to get container status \"70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892\": rpc error: code = NotFound desc = could not find container \"70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892\": container with ID starting with 70f768296590e246bad1263c68c3569a4ba75810347a36fa5f6f04bc98433892 not found: ID does not exist"
Jul 15 23:53:12.807240 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.807219    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8rcs"]
Jul 15 23:53:12.808768 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:12.808751    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8rcs"]
Jul 15 23:53:14.186421 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:14.186384    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="316724a7-1ede-4a64-93e9-e19b9bf60164" path="/var/lib/kubelet/pods/316724a7-1ede-4a64-93e9-e19b9bf60164/volumes"
Jul 15 23:53:19.841559 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:19.841530    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lvptw"
Jul 15 23:53:19.841986 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:19.841587    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lvptw"
Jul 15 23:53:19.863583 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:19.863554    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lvptw"
Jul 15 23:53:20.846044 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:20.846016    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lvptw"
Jul 15 23:53:24.912430 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:24.912399    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"]
Jul 15 23:53:24.912853 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:24.912725    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="316724a7-1ede-4a64-93e9-e19b9bf60164" containerName="registry-server"
Jul 15 23:53:24.912853 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:24.912736    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="316724a7-1ede-4a64-93e9-e19b9bf60164" containerName="registry-server"
Jul 15 23:53:24.912853 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:24.912781    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="316724a7-1ede-4a64-93e9-e19b9bf60164" containerName="registry-server"
Jul 15 23:53:24.917249 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:24.917233    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:24.919328 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:24.919307    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-drrn9\""
Jul 15 23:53:24.923992 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:24.923970    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"]
Jul 15 23:53:25.089793 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.089745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.089793 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.089797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.090035 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.089895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sft54\" (UniqueName: \"kubernetes.io/projected/749d2926-7925-4e79-b0db-ed575618f5a4-kube-api-access-sft54\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.191272 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.191187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sft54\" (UniqueName: \"kubernetes.io/projected/749d2926-7925-4e79-b0db-ed575618f5a4-kube-api-access-sft54\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.191272 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.191241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.191272 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.191261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.191583 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.191563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.191657 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.191572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.199191 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.199168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sft54\" (UniqueName: \"kubernetes.io/projected/749d2926-7925-4e79-b0db-ed575618f5a4-kube-api-access-sft54\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.227877 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.227852    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:25.311158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.311126    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"]
Jul 15 23:53:25.316187 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.316166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.322534 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.322508    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"]
Jul 15 23:53:25.364238 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.364214    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"]
Jul 15 23:53:25.366621 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:25.366578    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749d2926_7925_4e79_b0db_ed575618f5a4.slice/crio-c1dec6e572a73af2fef8ec57cbec7134f8c118d2ba6c4ab1a5842efe0d018284 WatchSource:0}: Error finding container c1dec6e572a73af2fef8ec57cbec7134f8c118d2ba6c4ab1a5842efe0d018284: Status 404 returned error can't find the container with id c1dec6e572a73af2fef8ec57cbec7134f8c118d2ba6c4ab1a5842efe0d018284
Jul 15 23:53:25.397086 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.397065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6qkj\" (UniqueName: \"kubernetes.io/projected/13990d74-b3aa-4881-a85a-4ce64573add0-kube-api-access-f6qkj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.397164 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.397104    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.397220 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.397188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.497690 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.497661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.497808 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.497702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qkj\" (UniqueName: \"kubernetes.io/projected/13990d74-b3aa-4881-a85a-4ce64573add0-kube-api-access-f6qkj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.497808 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.497735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.498061 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.498046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.498098 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.498044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.505942 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.505918    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6qkj\" (UniqueName: \"kubernetes.io/projected/13990d74-b3aa-4881-a85a-4ce64573add0-kube-api-access-f6qkj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.627746 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.627706    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:25.715755 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.715685    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"]
Jul 15 23:53:25.719661 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.719636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:25.730377 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.730313    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"]
Jul 15 23:53:25.761058 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.761035    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"]
Jul 15 23:53:25.762749 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:25.762722    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13990d74_b3aa_4881_a85a_4ce64573add0.slice/crio-becc1c5d5e691ecb8f4ea6b698ab4edf97f31e152f10932b46650770a7e9fa2f WatchSource:0}: Error finding container becc1c5d5e691ecb8f4ea6b698ab4edf97f31e152f10932b46650770a7e9fa2f: Status 404 returned error can't find the container with id becc1c5d5e691ecb8f4ea6b698ab4edf97f31e152f10932b46650770a7e9fa2f
Jul 15 23:53:25.800546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.800519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:25.800668 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.800618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:25.800733 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.800688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bvsj\" (UniqueName: \"kubernetes.io/projected/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-kube-api-access-5bvsj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:25.848459 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.848418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs" event={"ID":"13990d74-b3aa-4881-a85a-4ce64573add0","Type":"ContainerStarted","Data":"91d7844c72578adf0fb8c0bb0b0eb8264689e5c3392e1265351570c20ff4fdde"}
Jul 15 23:53:25.848646 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.848483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs" event={"ID":"13990d74-b3aa-4881-a85a-4ce64573add0","Type":"ContainerStarted","Data":"becc1c5d5e691ecb8f4ea6b698ab4edf97f31e152f10932b46650770a7e9fa2f"}
Jul 15 23:53:25.849953 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.849918    2576 generic.go:356] "Generic (PLEG): container finished" podID="749d2926-7925-4e79-b0db-ed575618f5a4" containerID="25c28b73174e867cd3d0bb2692c7f9019cd320383c297b1f9ad5d6bafad075b8" exitCode=0
Jul 15 23:53:25.850057 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.849951    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt" event={"ID":"749d2926-7925-4e79-b0db-ed575618f5a4","Type":"ContainerDied","Data":"25c28b73174e867cd3d0bb2692c7f9019cd320383c297b1f9ad5d6bafad075b8"}
Jul 15 23:53:25.850057 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.850001    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt" event={"ID":"749d2926-7925-4e79-b0db-ed575618f5a4","Type":"ContainerStarted","Data":"c1dec6e572a73af2fef8ec57cbec7134f8c118d2ba6c4ab1a5842efe0d018284"}
Jul 15 23:53:25.901220 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.901190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bvsj\" (UniqueName: \"kubernetes.io/projected/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-kube-api-access-5bvsj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:25.901374 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.901258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:25.901374 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.901310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:25.901748 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.901723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:25.901813 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.901733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:25.909595 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:25.909575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bvsj\" (UniqueName: \"kubernetes.io/projected/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-kube-api-access-5bvsj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:26.031544 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.031464    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:26.113889 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.113861    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"]
Jul 15 23:53:26.118996 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.118936    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.124147 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.124123    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"]
Jul 15 23:53:26.167763 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.167743    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"]
Jul 15 23:53:26.169145 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:26.169117    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3a5d3d_004d_4ca2_8264_0d5df9402d0f.slice/crio-a21cfc0368d7ad8f7f2c8b6f327050fafe5cbcf3c70d772d60e79c7886ff4b24 WatchSource:0}: Error finding container a21cfc0368d7ad8f7f2c8b6f327050fafe5cbcf3c70d772d60e79c7886ff4b24: Status 404 returned error can't find the container with id a21cfc0368d7ad8f7f2c8b6f327050fafe5cbcf3c70d772d60e79c7886ff4b24
Jul 15 23:53:26.203992 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.203962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.204107 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.204013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.204191 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.204158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m82kb\" (UniqueName: \"kubernetes.io/projected/df33f5d7-09ed-4135-a209-edc1b34e7117-kube-api-access-m82kb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.305220 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.305193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m82kb\" (UniqueName: \"kubernetes.io/projected/df33f5d7-09ed-4135-a209-edc1b34e7117-kube-api-access-m82kb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.305336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.305285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.305336 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.305326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.305678 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.305654    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.305753 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.305666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.313475 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.313447    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m82kb\" (UniqueName: \"kubernetes.io/projected/df33f5d7-09ed-4135-a209-edc1b34e7117-kube-api-access-m82kb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.430516 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.430491    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:26.560344 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.560316    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"]
Jul 15 23:53:26.573596 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:26.573566    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf33f5d7_09ed_4135_a209_edc1b34e7117.slice/crio-1441d0e3e75867099dd1b0491ad844826456d7ffd462a8b9ab531fdeb2cb5d35 WatchSource:0}: Error finding container 1441d0e3e75867099dd1b0491ad844826456d7ffd462a8b9ab531fdeb2cb5d35: Status 404 returned error can't find the container with id 1441d0e3e75867099dd1b0491ad844826456d7ffd462a8b9ab531fdeb2cb5d35
Jul 15 23:53:26.856291 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.856211    2576 generic.go:356] "Generic (PLEG): container finished" podID="13990d74-b3aa-4881-a85a-4ce64573add0" containerID="91d7844c72578adf0fb8c0bb0b0eb8264689e5c3392e1265351570c20ff4fdde" exitCode=0
Jul 15 23:53:26.856291 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.856271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs" event={"ID":"13990d74-b3aa-4881-a85a-4ce64573add0","Type":"ContainerDied","Data":"91d7844c72578adf0fb8c0bb0b0eb8264689e5c3392e1265351570c20ff4fdde"}
Jul 15 23:53:26.858161 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.858137    2576 generic.go:356] "Generic (PLEG): container finished" podID="749d2926-7925-4e79-b0db-ed575618f5a4" containerID="11025f064ed3f18bc1950e793958c13a68bf99e31c171cf0e61e68398e5376a3" exitCode=0
Jul 15 23:53:26.858283 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.858224    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt" event={"ID":"749d2926-7925-4e79-b0db-ed575618f5a4","Type":"ContainerDied","Data":"11025f064ed3f18bc1950e793958c13a68bf99e31c171cf0e61e68398e5376a3"}
Jul 15 23:53:26.859917 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.859892    2576 generic.go:356] "Generic (PLEG): container finished" podID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerID="ac784e15719272bd169bf581e294aa0dff9c0cade5721f8116958749774d9093" exitCode=0
Jul 15 23:53:26.860029 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.859957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg" event={"ID":"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f","Type":"ContainerDied","Data":"ac784e15719272bd169bf581e294aa0dff9c0cade5721f8116958749774d9093"}
Jul 15 23:53:26.860029 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.860015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg" event={"ID":"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f","Type":"ContainerStarted","Data":"a21cfc0368d7ad8f7f2c8b6f327050fafe5cbcf3c70d772d60e79c7886ff4b24"}
Jul 15 23:53:26.861767 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.861749    2576 generic.go:356] "Generic (PLEG): container finished" podID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerID="edc1556b61d3da04b9cfa956a70e3cc6032ba986c90c827b3cc9ba6d5d9274e0" exitCode=0
Jul 15 23:53:26.861869 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.861779    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk" event={"ID":"df33f5d7-09ed-4135-a209-edc1b34e7117","Type":"ContainerDied","Data":"edc1556b61d3da04b9cfa956a70e3cc6032ba986c90c827b3cc9ba6d5d9274e0"}
Jul 15 23:53:26.861869 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:26.861813    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk" event={"ID":"df33f5d7-09ed-4135-a209-edc1b34e7117","Type":"ContainerStarted","Data":"1441d0e3e75867099dd1b0491ad844826456d7ffd462a8b9ab531fdeb2cb5d35"}
Jul 15 23:53:27.872492 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:27.872458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk" event={"ID":"df33f5d7-09ed-4135-a209-edc1b34e7117","Type":"ContainerStarted","Data":"78bcf69c6190d498322c0536034a60fdcb799f350a637c8fc9fc861b654f73e6"}
Jul 15 23:53:27.874871 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:27.874848    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs" event={"ID":"13990d74-b3aa-4881-a85a-4ce64573add0","Type":"ContainerStarted","Data":"58c797d00ad13d09b1b6d1392c00266b058822c4d5d98511525187d6089d1b55"}
Jul 15 23:53:27.877258 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:27.877238    2576 generic.go:356] "Generic (PLEG): container finished" podID="749d2926-7925-4e79-b0db-ed575618f5a4" containerID="72420c329f7e93c30d82d505a366975fc4ad5575fbb255ddfe2d92096da54393" exitCode=0
Jul 15 23:53:27.877350 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:27.877293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt" event={"ID":"749d2926-7925-4e79-b0db-ed575618f5a4","Type":"ContainerDied","Data":"72420c329f7e93c30d82d505a366975fc4ad5575fbb255ddfe2d92096da54393"}
Jul 15 23:53:28.884498 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.884464    2576 generic.go:356] "Generic (PLEG): container finished" podID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerID="78bcf69c6190d498322c0536034a60fdcb799f350a637c8fc9fc861b654f73e6" exitCode=0
Jul 15 23:53:28.884498 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.884487    2576 generic.go:356] "Generic (PLEG): container finished" podID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerID="97dbd357cffd40885f80459e1006d4334d56becaf2b967ddec60e0f506776db9" exitCode=0
Jul 15 23:53:28.884959 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.884581    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk" event={"ID":"df33f5d7-09ed-4135-a209-edc1b34e7117","Type":"ContainerDied","Data":"78bcf69c6190d498322c0536034a60fdcb799f350a637c8fc9fc861b654f73e6"}
Jul 15 23:53:28.884959 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.884637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk" event={"ID":"df33f5d7-09ed-4135-a209-edc1b34e7117","Type":"ContainerDied","Data":"97dbd357cffd40885f80459e1006d4334d56becaf2b967ddec60e0f506776db9"}
Jul 15 23:53:28.886630 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.886590    2576 generic.go:356] "Generic (PLEG): container finished" podID="13990d74-b3aa-4881-a85a-4ce64573add0" containerID="58c797d00ad13d09b1b6d1392c00266b058822c4d5d98511525187d6089d1b55" exitCode=0
Jul 15 23:53:28.886630 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.886628    2576 generic.go:356] "Generic (PLEG): container finished" podID="13990d74-b3aa-4881-a85a-4ce64573add0" containerID="aa30e2cf798b321ec7ac1716877244600099f778c11d04cbc176741984fe9634" exitCode=0
Jul 15 23:53:28.886798 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.886636    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs" event={"ID":"13990d74-b3aa-4881-a85a-4ce64573add0","Type":"ContainerDied","Data":"58c797d00ad13d09b1b6d1392c00266b058822c4d5d98511525187d6089d1b55"}
Jul 15 23:53:28.886798 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.886695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs" event={"ID":"13990d74-b3aa-4881-a85a-4ce64573add0","Type":"ContainerDied","Data":"aa30e2cf798b321ec7ac1716877244600099f778c11d04cbc176741984fe9634"}
Jul 15 23:53:28.888339 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.888319    2576 generic.go:356] "Generic (PLEG): container finished" podID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerID="6a3b7f599e179ffe92cd2ab34f3a5b3f33cca70f95f6eff7e2e23d7e4dc74dad" exitCode=0
Jul 15 23:53:28.888445 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:28.888401    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg" event={"ID":"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f","Type":"ContainerDied","Data":"6a3b7f599e179ffe92cd2ab34f3a5b3f33cca70f95f6eff7e2e23d7e4dc74dad"}
Jul 15 23:53:29.029359 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.029289    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:29.131426 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.131398    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-bundle\") pod \"749d2926-7925-4e79-b0db-ed575618f5a4\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") "
Jul 15 23:53:29.131574 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.131463    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-util\") pod \"749d2926-7925-4e79-b0db-ed575618f5a4\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") "
Jul 15 23:53:29.131574 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.131494    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sft54\" (UniqueName: \"kubernetes.io/projected/749d2926-7925-4e79-b0db-ed575618f5a4-kube-api-access-sft54\") pod \"749d2926-7925-4e79-b0db-ed575618f5a4\" (UID: \"749d2926-7925-4e79-b0db-ed575618f5a4\") "
Jul 15 23:53:29.131982 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.131954    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-bundle" (OuterVolumeSpecName: "bundle") pod "749d2926-7925-4e79-b0db-ed575618f5a4" (UID: "749d2926-7925-4e79-b0db-ed575618f5a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:53:29.133532 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.133512    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/749d2926-7925-4e79-b0db-ed575618f5a4-kube-api-access-sft54" (OuterVolumeSpecName: "kube-api-access-sft54") pod "749d2926-7925-4e79-b0db-ed575618f5a4" (UID: "749d2926-7925-4e79-b0db-ed575618f5a4"). InnerVolumeSpecName "kube-api-access-sft54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:53:29.137273 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.137252    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-util" (OuterVolumeSpecName: "util") pod "749d2926-7925-4e79-b0db-ed575618f5a4" (UID: "749d2926-7925-4e79-b0db-ed575618f5a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:53:29.232449 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.232423    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-bundle\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:29.232449 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.232447    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749d2926-7925-4e79-b0db-ed575618f5a4-util\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:29.232567 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.232456    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sft54\" (UniqueName: \"kubernetes.io/projected/749d2926-7925-4e79-b0db-ed575618f5a4-kube-api-access-sft54\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:29.895145 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.895115    2576 generic.go:356] "Generic (PLEG): container finished" podID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerID="2b3da4447aca3586a8d5cb9cc1997e2c591514829cf09fecbf4c787ba58fe5c8" exitCode=0
Jul 15 23:53:29.895516 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.895203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg" event={"ID":"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f","Type":"ContainerDied","Data":"2b3da4447aca3586a8d5cb9cc1997e2c591514829cf09fecbf4c787ba58fe5c8"}
Jul 15 23:53:29.897015 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.896971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt" event={"ID":"749d2926-7925-4e79-b0db-ed575618f5a4","Type":"ContainerDied","Data":"c1dec6e572a73af2fef8ec57cbec7134f8c118d2ba6c4ab1a5842efe0d018284"}
Jul 15 23:53:29.897015 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.897004    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt"
Jul 15 23:53:29.897161 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:29.897023    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1dec6e572a73af2fef8ec57cbec7134f8c118d2ba6c4ab1a5842efe0d018284"
Jul 15 23:53:30.046775 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.046749    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:30.079286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.079262    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:30.138844 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.138812    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-bundle\") pod \"13990d74-b3aa-4881-a85a-4ce64573add0\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") "
Jul 15 23:53:30.138978 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.138860    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-bundle\") pod \"df33f5d7-09ed-4135-a209-edc1b34e7117\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") "
Jul 15 23:53:30.138978 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.138883    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6qkj\" (UniqueName: \"kubernetes.io/projected/13990d74-b3aa-4881-a85a-4ce64573add0-kube-api-access-f6qkj\") pod \"13990d74-b3aa-4881-a85a-4ce64573add0\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") "
Jul 15 23:53:30.138978 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.138931    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-util\") pod \"df33f5d7-09ed-4135-a209-edc1b34e7117\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") "
Jul 15 23:53:30.138978 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.138951    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m82kb\" (UniqueName: \"kubernetes.io/projected/df33f5d7-09ed-4135-a209-edc1b34e7117-kube-api-access-m82kb\") pod \"df33f5d7-09ed-4135-a209-edc1b34e7117\" (UID: \"df33f5d7-09ed-4135-a209-edc1b34e7117\") "
Jul 15 23:53:30.139233 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.139002    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-util\") pod \"13990d74-b3aa-4881-a85a-4ce64573add0\" (UID: \"13990d74-b3aa-4881-a85a-4ce64573add0\") "
Jul 15 23:53:30.139514 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.139483    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-bundle" (OuterVolumeSpecName: "bundle") pod "13990d74-b3aa-4881-a85a-4ce64573add0" (UID: "13990d74-b3aa-4881-a85a-4ce64573add0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:53:30.139642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.139512    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-bundle" (OuterVolumeSpecName: "bundle") pod "df33f5d7-09ed-4135-a209-edc1b34e7117" (UID: "df33f5d7-09ed-4135-a209-edc1b34e7117"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:53:30.141221 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.141189    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df33f5d7-09ed-4135-a209-edc1b34e7117-kube-api-access-m82kb" (OuterVolumeSpecName: "kube-api-access-m82kb") pod "df33f5d7-09ed-4135-a209-edc1b34e7117" (UID: "df33f5d7-09ed-4135-a209-edc1b34e7117"). InnerVolumeSpecName "kube-api-access-m82kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:53:30.141357 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.141334    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13990d74-b3aa-4881-a85a-4ce64573add0-kube-api-access-f6qkj" (OuterVolumeSpecName: "kube-api-access-f6qkj") pod "13990d74-b3aa-4881-a85a-4ce64573add0" (UID: "13990d74-b3aa-4881-a85a-4ce64573add0"). InnerVolumeSpecName "kube-api-access-f6qkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:53:30.145478 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.145433    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-util" (OuterVolumeSpecName: "util") pod "13990d74-b3aa-4881-a85a-4ce64573add0" (UID: "13990d74-b3aa-4881-a85a-4ce64573add0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:53:30.146044 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.146021    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-util" (OuterVolumeSpecName: "util") pod "df33f5d7-09ed-4135-a209-edc1b34e7117" (UID: "df33f5d7-09ed-4135-a209-edc1b34e7117"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:53:30.239940 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.239914    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6qkj\" (UniqueName: \"kubernetes.io/projected/13990d74-b3aa-4881-a85a-4ce64573add0-kube-api-access-f6qkj\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:30.239940 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.239939    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-util\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:30.240068 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.239949    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m82kb\" (UniqueName: \"kubernetes.io/projected/df33f5d7-09ed-4135-a209-edc1b34e7117-kube-api-access-m82kb\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:30.240068 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.239958    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-util\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:30.240068 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.239966    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13990d74-b3aa-4881-a85a-4ce64573add0-bundle\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:30.240068 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.239973    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df33f5d7-09ed-4135-a209-edc1b34e7117-bundle\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:30.904061 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.904031    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk"
Jul 15 23:53:30.904464 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.904066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk" event={"ID":"df33f5d7-09ed-4135-a209-edc1b34e7117","Type":"ContainerDied","Data":"1441d0e3e75867099dd1b0491ad844826456d7ffd462a8b9ab531fdeb2cb5d35"}
Jul 15 23:53:30.904464 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.904112    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1441d0e3e75867099dd1b0491ad844826456d7ffd462a8b9ab531fdeb2cb5d35"
Jul 15 23:53:30.906198 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.906057    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs"
Jul 15 23:53:30.906198 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.906055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs" event={"ID":"13990d74-b3aa-4881-a85a-4ce64573add0","Type":"ContainerDied","Data":"becc1c5d5e691ecb8f4ea6b698ab4edf97f31e152f10932b46650770a7e9fa2f"}
Jul 15 23:53:30.906198 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:30.906100    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="becc1c5d5e691ecb8f4ea6b698ab4edf97f31e152f10932b46650770a7e9fa2f"
Jul 15 23:53:31.033759 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.033729    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:31.146905 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.146875    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-bundle\") pod \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") "
Jul 15 23:53:31.147095 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.146931    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-util\") pod \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") "
Jul 15 23:53:31.147095 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.146968    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bvsj\" (UniqueName: \"kubernetes.io/projected/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-kube-api-access-5bvsj\") pod \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\" (UID: \"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f\") "
Jul 15 23:53:31.147434 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.147384    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-bundle" (OuterVolumeSpecName: "bundle") pod "7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" (UID: "7b3a5d3d-004d-4ca2-8264-0d5df9402d0f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:53:31.149053 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.149020    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-kube-api-access-5bvsj" (OuterVolumeSpecName: "kube-api-access-5bvsj") pod "7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" (UID: "7b3a5d3d-004d-4ca2-8264-0d5df9402d0f"). InnerVolumeSpecName "kube-api-access-5bvsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:53:31.152536 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.152516    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-util" (OuterVolumeSpecName: "util") pod "7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" (UID: "7b3a5d3d-004d-4ca2-8264-0d5df9402d0f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:53:31.248224 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.248139    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-bundle\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:31.248224 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.248168    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-util\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:31.248224 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.248177    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bvsj\" (UniqueName: \"kubernetes.io/projected/7b3a5d3d-004d-4ca2-8264-0d5df9402d0f-kube-api-access-5bvsj\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:53:31.912997 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.912959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg" event={"ID":"7b3a5d3d-004d-4ca2-8264-0d5df9402d0f","Type":"ContainerDied","Data":"a21cfc0368d7ad8f7f2c8b6f327050fafe5cbcf3c70d772d60e79c7886ff4b24"}
Jul 15 23:53:31.913369 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.913007    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg"
Jul 15 23:53:31.913369 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:31.913014    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a21cfc0368d7ad8f7f2c8b6f327050fafe5cbcf3c70d772d60e79c7886ff4b24"
Jul 15 23:53:38.223586 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223551    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b58c648cf-6w4cq"]
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223862    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13990d74-b3aa-4881-a85a-4ce64573add0" containerName="util"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223874    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="13990d74-b3aa-4881-a85a-4ce64573add0" containerName="util"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223886    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerName="util"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223892    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerName="util"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223900    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerName="pull"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223906    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerName="pull"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223913    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13990d74-b3aa-4881-a85a-4ce64573add0" containerName="pull"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223919    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="13990d74-b3aa-4881-a85a-4ce64573add0" containerName="pull"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223930    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13990d74-b3aa-4881-a85a-4ce64573add0" containerName="extract"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223935    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="13990d74-b3aa-4881-a85a-4ce64573add0" containerName="extract"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223941    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerName="extract"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223946    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerName="extract"
Jul 15 23:53:38.223948 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223952    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerName="extract"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223957    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerName="extract"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223964    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749d2926-7925-4e79-b0db-ed575618f5a4" containerName="util"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223968    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="749d2926-7925-4e79-b0db-ed575618f5a4" containerName="util"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223974    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749d2926-7925-4e79-b0db-ed575618f5a4" containerName="extract"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223979    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="749d2926-7925-4e79-b0db-ed575618f5a4" containerName="extract"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223989    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerName="util"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.223994    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerName="util"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.224000    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749d2926-7925-4e79-b0db-ed575618f5a4" containerName="pull"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.224005    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="749d2926-7925-4e79-b0db-ed575618f5a4" containerName="pull"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.224012    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerName="pull"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.224017    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerName="pull"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.224063    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="df33f5d7-09ed-4135-a209-edc1b34e7117" containerName="extract"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.224073    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b3a5d3d-004d-4ca2-8264-0d5df9402d0f" containerName="extract"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.224079    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="749d2926-7925-4e79-b0db-ed575618f5a4" containerName="extract"
Jul 15 23:53:38.224324 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.224087    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="13990d74-b3aa-4881-a85a-4ce64573add0" containerName="extract"
Jul 15 23:53:38.227189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.227173    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.241786 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.241762    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b58c648cf-6w4cq"]
Jul 15 23:53:38.305706 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.305679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-oauth-serving-cert\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.305838 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.305714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-console-config\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.305838 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.305731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-console-serving-cert\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.305838 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.305820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-trusted-ca-bundle\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.305949 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.305851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkfp7\" (UniqueName: \"kubernetes.io/projected/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-kube-api-access-rkfp7\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.305949 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.305893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-service-ca\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.305949 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.305942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-console-oauth-config\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.406316 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.406285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-oauth-serving-cert\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.406489 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.406326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-console-config\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.406489 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.406346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-console-serving-cert\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.406489 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.406391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-trusted-ca-bundle\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.406489 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.406416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfp7\" (UniqueName: \"kubernetes.io/projected/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-kube-api-access-rkfp7\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.406744 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.406580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-service-ca\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.406744 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.406657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-console-oauth-config\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.407116 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.407093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-console-config\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.407228 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.407091    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-oauth-serving-cert\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.407297 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.407233    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-service-ca\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.407354 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.407291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-trusted-ca-bundle\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.408698 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.408679    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-console-serving-cert\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.408997 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.408966    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-console-oauth-config\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.415862 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.415838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfp7\" (UniqueName: \"kubernetes.io/projected/e05a6db6-ad5c-4697-b5f9-fc38be0768d1-kube-api-access-rkfp7\") pod \"console-b58c648cf-6w4cq\" (UID: \"e05a6db6-ad5c-4697-b5f9-fc38be0768d1\") " pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.536467 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.536384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:38.667263 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.667243    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b58c648cf-6w4cq"]
Jul 15 23:53:38.669255 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:38.669230    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05a6db6_ad5c_4697_b5f9_fc38be0768d1.slice/crio-44de6f7fca4037560c07270e49624396c44cf519c780f86ea085dc384c0064c2 WatchSource:0}: Error finding container 44de6f7fca4037560c07270e49624396c44cf519c780f86ea085dc384c0064c2: Status 404 returned error can't find the container with id 44de6f7fca4037560c07270e49624396c44cf519c780f86ea085dc384c0064c2
Jul 15 23:53:38.948217 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.948178    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b58c648cf-6w4cq" event={"ID":"e05a6db6-ad5c-4697-b5f9-fc38be0768d1","Type":"ContainerStarted","Data":"f2e9dfbaa47ab8dbbc2e11fdea49b507f99c4bfed14c356f853dbcb1aaaf47a0"}
Jul 15 23:53:38.948422 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.948255    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b58c648cf-6w4cq" event={"ID":"e05a6db6-ad5c-4697-b5f9-fc38be0768d1","Type":"ContainerStarted","Data":"44de6f7fca4037560c07270e49624396c44cf519c780f86ea085dc384c0064c2"}
Jul 15 23:53:38.964859 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:38.964811    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b58c648cf-6w4cq" podStartSLOduration=0.964795856 podStartE2EDuration="964.795856ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:53:38.963036395 +0000 UTC m=+379.229634008" watchObservedRunningTime="2026-07-15 23:53:38.964795856 +0000 UTC m=+379.231393470"
Jul 15 23:53:42.657983 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.657951    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"]
Jul 15 23:53:42.661220 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.661200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:53:42.664060 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.664040    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fqwtz\""
Jul 15 23:53:42.680120 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.680091    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"]
Jul 15 23:53:42.746468 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.746436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gppnb\" (UniqueName: \"kubernetes.io/projected/5f64013b-a4d1-47db-80d5-c9df76947dc2-kube-api-access-gppnb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" (UID: \"5f64013b-a4d1-47db-80d5-c9df76947dc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:53:42.746637 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.746486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f64013b-a4d1-47db-80d5-c9df76947dc2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" (UID: \"5f64013b-a4d1-47db-80d5-c9df76947dc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:53:42.847797 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.847757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppnb\" (UniqueName: \"kubernetes.io/projected/5f64013b-a4d1-47db-80d5-c9df76947dc2-kube-api-access-gppnb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" (UID: \"5f64013b-a4d1-47db-80d5-c9df76947dc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:53:42.847926 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.847817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f64013b-a4d1-47db-80d5-c9df76947dc2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" (UID: \"5f64013b-a4d1-47db-80d5-c9df76947dc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:53:42.848173 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.848155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f64013b-a4d1-47db-80d5-c9df76947dc2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" (UID: \"5f64013b-a4d1-47db-80d5-c9df76947dc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:53:42.868349 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.868324    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gppnb\" (UniqueName: \"kubernetes.io/projected/5f64013b-a4d1-47db-80d5-c9df76947dc2-kube-api-access-gppnb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" (UID: \"5f64013b-a4d1-47db-80d5-c9df76947dc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:53:42.971099 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:42.971020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:53:43.102294 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:43.102271    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"]
Jul 15 23:53:43.103756 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:43.103726    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f64013b_a4d1_47db_80d5_c9df76947dc2.slice/crio-63b17535d3c741e388f5013b553bf6f474df655d55674ed52500f6063060d645 WatchSource:0}: Error finding container 63b17535d3c741e388f5013b553bf6f474df655d55674ed52500f6063060d645: Status 404 returned error can't find the container with id 63b17535d3c741e388f5013b553bf6f474df655d55674ed52500f6063060d645
Jul 15 23:53:43.973493 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:43.973461    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg" event={"ID":"5f64013b-a4d1-47db-80d5-c9df76947dc2","Type":"ContainerStarted","Data":"63b17535d3c741e388f5013b553bf6f474df655d55674ed52500f6063060d645"}
Jul 15 23:53:45.285014 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.284972    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"]
Jul 15 23:53:45.288525 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.288509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"
Jul 15 23:53:45.291157 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.291138    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mxvdp\""
Jul 15 23:53:45.298175 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.298152    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"]
Jul 15 23:53:45.370157 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.370131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtpx5\" (UniqueName: \"kubernetes.io/projected/2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc-kube-api-access-dtpx5\") pod \"authorino-operator-75cc8d5cb7-kf5dh\" (UID: \"2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"
Jul 15 23:53:45.471003 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.470966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtpx5\" (UniqueName: \"kubernetes.io/projected/2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc-kube-api-access-dtpx5\") pod \"authorino-operator-75cc8d5cb7-kf5dh\" (UID: \"2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"
Jul 15 23:53:45.483243 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.483215    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtpx5\" (UniqueName: \"kubernetes.io/projected/2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc-kube-api-access-dtpx5\") pod \"authorino-operator-75cc8d5cb7-kf5dh\" (UID: \"2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"
Jul 15 23:53:45.600690 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.600616    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"
Jul 15 23:53:45.750931 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.750724    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"]
Jul 15 23:53:45.754079 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:45.754052    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aaa9c51_67ff_4881_8bd9_4f9b7e329ffc.slice/crio-fd8b8763f5d5ccf959d4b3a9c97d98fbbbdf133224d6535f94cd26400b014040 WatchSource:0}: Error finding container fd8b8763f5d5ccf959d4b3a9c97d98fbbbdf133224d6535f94cd26400b014040: Status 404 returned error can't find the container with id fd8b8763f5d5ccf959d4b3a9c97d98fbbbdf133224d6535f94cd26400b014040
Jul 15 23:53:45.986532 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:45.986496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh" event={"ID":"2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc","Type":"ContainerStarted","Data":"fd8b8763f5d5ccf959d4b3a9c97d98fbbbdf133224d6535f94cd26400b014040"}
Jul 15 23:53:48.536762 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:48.536720    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:48.537232 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:48.537025    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:48.544042 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:48.544016    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:49.006016 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:49.005992    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b58c648cf-6w4cq"
Jul 15 23:53:49.057343 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:49.057319    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fd57996c6-c64m6"]
Jul 15 23:53:50.008814 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:50.008777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh" event={"ID":"2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc","Type":"ContainerStarted","Data":"7bb3ab88ebdc382404cd69aef94cf6c659803264120afe03bfa6429d38451bdd"}
Jul 15 23:53:50.009294 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:50.008915    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"
Jul 15 23:53:50.010553 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:50.010523    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg" event={"ID":"5f64013b-a4d1-47db-80d5-c9df76947dc2","Type":"ContainerStarted","Data":"41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da"}
Jul 15 23:53:50.010848 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:50.010829    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:53:50.025691 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:50.025647    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh" podStartSLOduration=1.765723719 podStartE2EDuration="5.025633971s" totalImagesPullingTime="3.259910252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:53:50.023233888 +0000 UTC m=+390.289831503" watchObservedRunningTime="2026-07-15 23:53:50.025633971 +0000 UTC m=+390.292231582"
Jul 15 23:53:50.041727 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:50.041675    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg" podStartSLOduration=2.169844309 podStartE2EDuration="8.041660959s" totalImagesPullingTime="5.87181665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:53:50.041018577 +0000 UTC m=+390.307616192" watchObservedRunningTime="2026-07-15 23:53:50.041660959 +0000 UTC m=+390.308258575"
Jul 15 23:53:51.581536 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.581500    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"]
Jul 15 23:53:51.585180 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.585158    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.587452 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.587431    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 23:53:51.587565 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.587441    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 23:53:51.587565 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.587476    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-drrn9\""
Jul 15 23:53:51.592530 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.592243    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"]
Jul 15 23:53:51.723393 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.723360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjx8d\" (UniqueName: \"kubernetes.io/projected/ce458c4f-14d7-4d5e-b44b-81ccd86d28f4-kube-api-access-hjx8d\") pod \"kuadrant-console-plugin-66b5774985-mdkss\" (UID: \"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.723584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.723412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce458c4f-14d7-4d5e-b44b-81ccd86d28f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mdkss\" (UID: \"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.723584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.723481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ce458c4f-14d7-4d5e-b44b-81ccd86d28f4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mdkss\" (UID: \"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.824731 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.824699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce458c4f-14d7-4d5e-b44b-81ccd86d28f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mdkss\" (UID: \"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.824895 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.824739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ce458c4f-14d7-4d5e-b44b-81ccd86d28f4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mdkss\" (UID: \"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.824895 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.824790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjx8d\" (UniqueName: \"kubernetes.io/projected/ce458c4f-14d7-4d5e-b44b-81ccd86d28f4-kube-api-access-hjx8d\") pod \"kuadrant-console-plugin-66b5774985-mdkss\" (UID: \"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.825463 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.825436    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ce458c4f-14d7-4d5e-b44b-81ccd86d28f4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mdkss\" (UID: \"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.827119 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.827089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce458c4f-14d7-4d5e-b44b-81ccd86d28f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mdkss\" (UID: \"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.832845 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.832780    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjx8d\" (UniqueName: \"kubernetes.io/projected/ce458c4f-14d7-4d5e-b44b-81ccd86d28f4-kube-api-access-hjx8d\") pod \"kuadrant-console-plugin-66b5774985-mdkss\" (UID: \"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:51.896233 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:51.896208    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"
Jul 15 23:53:52.023939 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:52.023918    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss"]
Jul 15 23:53:52.025372 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:53:52.025345    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce458c4f_14d7_4d5e_b44b_81ccd86d28f4.slice/crio-240e911d8a423e187f5f9b774385868bf7ac00a6758278d8137a201fc617f929 WatchSource:0}: Error finding container 240e911d8a423e187f5f9b774385868bf7ac00a6758278d8137a201fc617f929: Status 404 returned error can't find the container with id 240e911d8a423e187f5f9b774385868bf7ac00a6758278d8137a201fc617f929
Jul 15 23:53:53.027222 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:53:53.027183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss" event={"ID":"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4","Type":"ContainerStarted","Data":"240e911d8a423e187f5f9b774385868bf7ac00a6758278d8137a201fc617f929"}
Jul 15 23:54:01.017755 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:01.017723    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kf5dh"
Jul 15 23:54:01.018245 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:01.017802    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:02.579071 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.579033    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"]
Jul 15 23:54:02.632941 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.632903    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"]
Jul 15 23:54:02.633140 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.633030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:02.698313 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.698270    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"]
Jul 15 23:54:02.698882 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:02.698846    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-xjc4w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9" podUID="f4fd42f6-b3ee-43f6-a099-ba827d42da43"
Jul 15 23:54:02.726922 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.726884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjc4w\" (UniqueName: \"kubernetes.io/projected/f4fd42f6-b3ee-43f6-a099-ba827d42da43-kube-api-access-xjc4w\") pod \"kuadrant-operator-controller-manager-55467d9f7-cxxf9\" (UID: \"f4fd42f6-b3ee-43f6-a099-ba827d42da43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:02.727095 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.726961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4fd42f6-b3ee-43f6-a099-ba827d42da43-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cxxf9\" (UID: \"f4fd42f6-b3ee-43f6-a099-ba827d42da43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:02.737499 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.737469    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"]
Jul 15 23:54:02.746638 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.746589    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"]
Jul 15 23:54:02.746762 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.746682    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:02.756268 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.756248    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"]
Jul 15 23:54:02.759470 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.759446    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"]
Jul 15 23:54:02.766547 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.766518    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"]
Jul 15 23:54:02.766833 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.766780    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" containerName="manager" containerID="cri-o://41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da" gracePeriod=2
Jul 15 23:54:02.787208 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.787180    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"]
Jul 15 23:54:02.794491 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:02.794290    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5f64013b-a4d1-47db-80d5-c9df76947dc2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\": pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:02.798361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.798335    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"]
Jul 15 23:54:02.799012 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.798989    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" containerName="manager"
Jul 15 23:54:02.799012 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.799012    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" containerName="manager"
Jul 15 23:54:02.799246 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.799104    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" containerName="manager"
Jul 15 23:54:02.804352 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.804326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:02.806391 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:02.806363    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:02.818716 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.818686    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"]
Jul 15 23:54:02.827385 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.827353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae277b41-54e2-4d56-8ec4-ef0fad11131b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w8qq9\" (UID: \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:02.827529 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.827497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4554\" (UniqueName: \"kubernetes.io/projected/ae277b41-54e2-4d56-8ec4-ef0fad11131b-kube-api-access-c4554\") pod \"kuadrant-operator-controller-manager-86878c769f-w8qq9\" (UID: \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:02.827626 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.827581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjc4w\" (UniqueName: \"kubernetes.io/projected/f4fd42f6-b3ee-43f6-a099-ba827d42da43-kube-api-access-xjc4w\") pod \"kuadrant-operator-controller-manager-55467d9f7-cxxf9\" (UID: \"f4fd42f6-b3ee-43f6-a099-ba827d42da43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:02.827753 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.827734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4fd42f6-b3ee-43f6-a099-ba827d42da43-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cxxf9\" (UID: \"f4fd42f6-b3ee-43f6-a099-ba827d42da43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:02.828207 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.828183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4fd42f6-b3ee-43f6-a099-ba827d42da43-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cxxf9\" (UID: \"f4fd42f6-b3ee-43f6-a099-ba827d42da43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:02.832553 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:02.832505    2576 projected.go:196] Error preparing data for projected volume kube-api-access-xjc4w for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-cxxf9" not found
Jul 15 23:54:02.832667 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:02.832570    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4fd42f6-b3ee-43f6-a099-ba827d42da43-kube-api-access-xjc4w podName:f4fd42f6-b3ee-43f6-a099-ba827d42da43 nodeName:}" failed. No retries permitted until 2026-07-15 23:54:03.332552695 +0000 UTC m=+403.599150288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xjc4w" (UniqueName: "kubernetes.io/projected/f4fd42f6-b3ee-43f6-a099-ba827d42da43-kube-api-access-xjc4w") pod "kuadrant-operator-controller-manager-55467d9f7-cxxf9" (UID: "f4fd42f6-b3ee-43f6-a099-ba827d42da43") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-cxxf9" not found
Jul 15 23:54:02.928754 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.928716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpgss\" (UniqueName: \"kubernetes.io/projected/bd933d79-2281-4c63-8447-5658a527f253-kube-api-access-qpgss\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsxlk\" (UID: \"bd933d79-2281-4c63-8447-5658a527f253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:02.928926 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.928771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd933d79-2281-4c63-8447-5658a527f253-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsxlk\" (UID: \"bd933d79-2281-4c63-8447-5658a527f253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:02.928926 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.928840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae277b41-54e2-4d56-8ec4-ef0fad11131b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w8qq9\" (UID: \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:02.928926 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.928891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4554\" (UniqueName: \"kubernetes.io/projected/ae277b41-54e2-4d56-8ec4-ef0fad11131b-kube-api-access-c4554\") pod \"kuadrant-operator-controller-manager-86878c769f-w8qq9\" (UID: \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:02.929182 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.929160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae277b41-54e2-4d56-8ec4-ef0fad11131b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w8qq9\" (UID: \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:02.946802 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:02.946769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4554\" (UniqueName: \"kubernetes.io/projected/ae277b41-54e2-4d56-8ec4-ef0fad11131b-kube-api-access-c4554\") pod \"kuadrant-operator-controller-manager-86878c769f-w8qq9\" (UID: \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:03.029854 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.029812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpgss\" (UniqueName: \"kubernetes.io/projected/bd933d79-2281-4c63-8447-5658a527f253-kube-api-access-qpgss\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsxlk\" (UID: \"bd933d79-2281-4c63-8447-5658a527f253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:03.030028 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.029888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd933d79-2281-4c63-8447-5658a527f253-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsxlk\" (UID: \"bd933d79-2281-4c63-8447-5658a527f253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:03.030284 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.030263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd933d79-2281-4c63-8447-5658a527f253-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsxlk\" (UID: \"bd933d79-2281-4c63-8447-5658a527f253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:03.038911 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.038880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpgss\" (UniqueName: \"kubernetes.io/projected/bd933d79-2281-4c63-8447-5658a527f253-kube-api-access-qpgss\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsxlk\" (UID: \"bd933d79-2281-4c63-8447-5658a527f253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:03.060452 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.060426    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:03.088990 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.088908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:03.091037 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:03.091004    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cxxf9\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="f4fd42f6-b3ee-43f6-a099-ba827d42da43" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:03.092796 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:03.092769    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:03.098158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.098141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:03.100083 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:03.100057    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:03.101824 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:03.101798    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cxxf9\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="f4fd42f6-b3ee-43f6-a099-ba827d42da43" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:03.165907 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.165870    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:03.232280 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.232238    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4fd42f6-b3ee-43f6-a099-ba827d42da43-extensions-socket-volume\") pod \"f4fd42f6-b3ee-43f6-a099-ba827d42da43\" (UID: \"f4fd42f6-b3ee-43f6-a099-ba827d42da43\") "
Jul 15 23:54:03.232495 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.232475    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjc4w\" (UniqueName: \"kubernetes.io/projected/f4fd42f6-b3ee-43f6-a099-ba827d42da43-kube-api-access-xjc4w\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:03.232569 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.232508    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4fd42f6-b3ee-43f6-a099-ba827d42da43-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f4fd42f6-b3ee-43f6-a099-ba827d42da43" (UID: "f4fd42f6-b3ee-43f6-a099-ba827d42da43"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:54:03.333263 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:03.333228    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4fd42f6-b3ee-43f6-a099-ba827d42da43-extensions-socket-volume\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:04.094352 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:04.094316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:04.096488 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:04.096462    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cxxf9\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="f4fd42f6-b3ee-43f6-a099-ba827d42da43" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:04.098118 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:04.098095    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:04.102273 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:04.102246    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-cxxf9\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="f4fd42f6-b3ee-43f6-a099-ba827d42da43" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cxxf9"
Jul 15 23:54:04.103813 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:04.103794    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:04.188356 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:04.188319    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4fd42f6-b3ee-43f6-a099-ba827d42da43" path="/var/lib/kubelet/pods/f4fd42f6-b3ee-43f6-a099-ba827d42da43/volumes"
Jul 15 23:54:13.031545 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.031519    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:13.033572 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:13.033544    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:13.038740 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.038719    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"]
Jul 15 23:54:13.040383 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:54:13.040357    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae277b41_54e2_4d56_8ec4_ef0fad11131b.slice/crio-c0d642f32ebbae882e5f627fc6bc9b98adb9ecdc82ac84b4d092c15b60217ff9 WatchSource:0}: Error finding container c0d642f32ebbae882e5f627fc6bc9b98adb9ecdc82ac84b4d092c15b60217ff9: Status 404 returned error can't find the container with id c0d642f32ebbae882e5f627fc6bc9b98adb9ecdc82ac84b4d092c15b60217ff9
Jul 15 23:54:13.054886 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.054861    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"]
Jul 15 23:54:13.059755 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:54:13.059728    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd933d79_2281_4c63_8447_5658a527f253.slice/crio-37c8fc35bcae83a1341566f1fbe04a82a987a4ad9b0d90cd2a81b37fd0a9e074 WatchSource:0}: Error finding container 37c8fc35bcae83a1341566f1fbe04a82a987a4ad9b0d90cd2a81b37fd0a9e074: Status 404 returned error can't find the container with id 37c8fc35bcae83a1341566f1fbe04a82a987a4ad9b0d90cd2a81b37fd0a9e074
Jul 15 23:54:13.128729 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.128659    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gppnb\" (UniqueName: \"kubernetes.io/projected/5f64013b-a4d1-47db-80d5-c9df76947dc2-kube-api-access-gppnb\") pod \"5f64013b-a4d1-47db-80d5-c9df76947dc2\" (UID: \"5f64013b-a4d1-47db-80d5-c9df76947dc2\") "
Jul 15 23:54:13.128848 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.128731    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f64013b-a4d1-47db-80d5-c9df76947dc2-extensions-socket-volume\") pod \"5f64013b-a4d1-47db-80d5-c9df76947dc2\" (UID: \"5f64013b-a4d1-47db-80d5-c9df76947dc2\") "
Jul 15 23:54:13.129201 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.129179    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f64013b-a4d1-47db-80d5-c9df76947dc2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5f64013b-a4d1-47db-80d5-c9df76947dc2" (UID: "5f64013b-a4d1-47db-80d5-c9df76947dc2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:54:13.130621 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.130579    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f64013b-a4d1-47db-80d5-c9df76947dc2-kube-api-access-gppnb" (OuterVolumeSpecName: "kube-api-access-gppnb") pod "5f64013b-a4d1-47db-80d5-c9df76947dc2" (UID: "5f64013b-a4d1-47db-80d5-c9df76947dc2"). InnerVolumeSpecName "kube-api-access-gppnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:54:13.149792 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.149761    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f64013b-a4d1-47db-80d5-c9df76947dc2" containerID="41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da" exitCode=0
Jul 15 23:54:13.149980 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.149828    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:13.149980 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.149868    2576 scope.go:117] "RemoveContainer" containerID="41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da"
Jul 15 23:54:13.152057 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.152024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss" event={"ID":"ce458c4f-14d7-4d5e-b44b-81ccd86d28f4","Type":"ContainerStarted","Data":"bd697373533af1f2043a2b8d92034da61d12f4766dd287ab3048e26d8f042651"}
Jul 15 23:54:13.152288 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:13.152261    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:13.154690 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.154205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk" event={"ID":"bd933d79-2281-4c63-8447-5658a527f253","Type":"ContainerStarted","Data":"d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b"}
Jul 15 23:54:13.154690 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.154258    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk" event={"ID":"bd933d79-2281-4c63-8447-5658a527f253","Type":"ContainerStarted","Data":"37c8fc35bcae83a1341566f1fbe04a82a987a4ad9b0d90cd2a81b37fd0a9e074"}
Jul 15 23:54:13.154690 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.154291    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:13.156084 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.156057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9" event={"ID":"ae277b41-54e2-4d56-8ec4-ef0fad11131b","Type":"ContainerStarted","Data":"4dcc487d5fa95a14031fdd2e9d2f9d93fe7ca28e80d6a303fa1e490ef93ef427"}
Jul 15 23:54:13.156175 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.156109    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9" event={"ID":"ae277b41-54e2-4d56-8ec4-ef0fad11131b","Type":"ContainerStarted","Data":"c0d642f32ebbae882e5f627fc6bc9b98adb9ecdc82ac84b4d092c15b60217ff9"}
Jul 15 23:54:13.161711 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.161688    2576 scope.go:117] "RemoveContainer" containerID="41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da"
Jul 15 23:54:13.161982 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:13.161963    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da\": container with ID starting with 41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da not found: ID does not exist" containerID="41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da"
Jul 15 23:54:13.162050 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.161990    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da"} err="failed to get container status \"41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da\": rpc error: code = NotFound desc = could not find container \"41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da\": container with ID starting with 41ac588c2537270559f8358b35901956a4d2a6fb0cdd7da915cf119ab58286da not found: ID does not exist"
Jul 15 23:54:13.169505 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.169464    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mdkss" podStartSLOduration=1.224079597 podStartE2EDuration="22.169451939s" totalImagesPullingTime="20.945372342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:13.168060605 +0000 UTC m=+413.434658219" watchObservedRunningTime="2026-07-15 23:54:13.169451939 +0000 UTC m=+413.436049531"
Jul 15 23:54:13.170062 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:13.170039    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:13.192432 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.192374    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk" podStartSLOduration=11.192354732 podStartE2EDuration="11.192354732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:13.190090412 +0000 UTC m=+413.456688031" watchObservedRunningTime="2026-07-15 23:54:13.192354732 +0000 UTC m=+413.458952347"
Jul 15 23:54:13.207288 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:13.207252    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4f4lg\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4f4lg"
Jul 15 23:54:13.207727 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.207685    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9" podStartSLOduration=11.207670677 podStartE2EDuration="11.207670677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:13.20551331 +0000 UTC m=+413.472110925" watchObservedRunningTime="2026-07-15 23:54:13.207670677 +0000 UTC m=+413.474268290"
Jul 15 23:54:13.229970 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.229933    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gppnb\" (UniqueName: \"kubernetes.io/projected/5f64013b-a4d1-47db-80d5-c9df76947dc2-kube-api-access-gppnb\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:13.229970 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:13.229969    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f64013b-a4d1-47db-80d5-c9df76947dc2-extensions-socket-volume\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:14.082046 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.081979    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fd57996c6-c64m6" podUID="e4966530-5b32-4bff-9067-2846761c8c99" containerName="console" containerID="cri-o://6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442" gracePeriod=15
Jul 15 23:54:14.162657 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.162632    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:14.186751 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.186724    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f64013b-a4d1-47db-80d5-c9df76947dc2" path="/var/lib/kubelet/pods/5f64013b-a4d1-47db-80d5-c9df76947dc2/volumes"
Jul 15 23:54:14.339461 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.339438    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:54:14.438826 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.438730    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbmn7\" (UniqueName: \"kubernetes.io/projected/e4966530-5b32-4bff-9067-2846761c8c99-kube-api-access-nbmn7\") pod \"e4966530-5b32-4bff-9067-2846761c8c99\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") "
Jul 15 23:54:14.438826 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.438776    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-console-config\") pod \"e4966530-5b32-4bff-9067-2846761c8c99\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") "
Jul 15 23:54:14.438826 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.438818    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-serving-cert\") pod \"e4966530-5b32-4bff-9067-2846761c8c99\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") "
Jul 15 23:54:14.439099 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.438861    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-trusted-ca-bundle\") pod \"e4966530-5b32-4bff-9067-2846761c8c99\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") "
Jul 15 23:54:14.439099 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.439020    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-oauth-config\") pod \"e4966530-5b32-4bff-9067-2846761c8c99\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") "
Jul 15 23:54:14.439099 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.439087    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-service-ca\") pod \"e4966530-5b32-4bff-9067-2846761c8c99\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") "
Jul 15 23:54:14.439245 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.439119    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-oauth-serving-cert\") pod \"e4966530-5b32-4bff-9067-2846761c8c99\" (UID: \"e4966530-5b32-4bff-9067-2846761c8c99\") "
Jul 15 23:54:14.439373 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.439335    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e4966530-5b32-4bff-9067-2846761c8c99" (UID: "e4966530-5b32-4bff-9067-2846761c8c99"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:54:14.439373 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.439361    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-console-config" (OuterVolumeSpecName: "console-config") pod "e4966530-5b32-4bff-9067-2846761c8c99" (UID: "e4966530-5b32-4bff-9067-2846761c8c99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:54:14.439567 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.439506    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4966530-5b32-4bff-9067-2846761c8c99" (UID: "e4966530-5b32-4bff-9067-2846761c8c99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:54:14.439658 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.439637    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4966530-5b32-4bff-9067-2846761c8c99" (UID: "e4966530-5b32-4bff-9067-2846761c8c99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:54:14.441036 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.441006    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4966530-5b32-4bff-9067-2846761c8c99" (UID: "e4966530-5b32-4bff-9067-2846761c8c99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:54:14.441036 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.441020    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4966530-5b32-4bff-9067-2846761c8c99" (UID: "e4966530-5b32-4bff-9067-2846761c8c99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:54:14.441153 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.441005    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4966530-5b32-4bff-9067-2846761c8c99-kube-api-access-nbmn7" (OuterVolumeSpecName: "kube-api-access-nbmn7") pod "e4966530-5b32-4bff-9067-2846761c8c99" (UID: "e4966530-5b32-4bff-9067-2846761c8c99"). InnerVolumeSpecName "kube-api-access-nbmn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:54:14.540158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.540130    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-console-config\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:14.540158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.540153    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-serving-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:14.540158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.540164    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-trusted-ca-bundle\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:14.540362 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.540173    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4966530-5b32-4bff-9067-2846761c8c99-console-oauth-config\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:14.540362 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.540182    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-service-ca\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:14.540362 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.540192    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4966530-5b32-4bff-9067-2846761c8c99-oauth-serving-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:14.540362 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:14.540200    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbmn7\" (UniqueName: \"kubernetes.io/projected/e4966530-5b32-4bff-9067-2846761c8c99-kube-api-access-nbmn7\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:15.169417 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:15.169383    2576 generic.go:356] "Generic (PLEG): container finished" podID="e4966530-5b32-4bff-9067-2846761c8c99" containerID="6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442" exitCode=0
Jul 15 23:54:15.169947 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:15.169427    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd57996c6-c64m6"
Jul 15 23:54:15.169947 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:15.169477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd57996c6-c64m6" event={"ID":"e4966530-5b32-4bff-9067-2846761c8c99","Type":"ContainerDied","Data":"6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442"}
Jul 15 23:54:15.169947 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:15.169532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd57996c6-c64m6" event={"ID":"e4966530-5b32-4bff-9067-2846761c8c99","Type":"ContainerDied","Data":"0c10923d82d9fa5c876b05ce2ed1adc7a9ba655d54210ec85afd9f781921fadf"}
Jul 15 23:54:15.169947 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:15.169568    2576 scope.go:117] "RemoveContainer" containerID="6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442"
Jul 15 23:54:15.179031 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:15.179011    2576 scope.go:117] "RemoveContainer" containerID="6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442"
Jul 15 23:54:15.179290 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:15.179273    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442\": container with ID starting with 6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442 not found: ID does not exist" containerID="6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442"
Jul 15 23:54:15.179334 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:15.179299    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442"} err="failed to get container status \"6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442\": rpc error: code = NotFound desc = could not find container \"6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442\": container with ID starting with 6ea8f7d8e5cdd42e798a494ccd0c187d5dc940a066bdbd197bee0063f6b7d442 not found: ID does not exist"
Jul 15 23:54:15.193297 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:15.193268    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fd57996c6-c64m6"]
Jul 15 23:54:15.198777 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:15.198752    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fd57996c6-c64m6"]
Jul 15 23:54:16.186553 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:16.186519    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4966530-5b32-4bff-9067-2846761c8c99" path="/var/lib/kubelet/pods/e4966530-5b32-4bff-9067-2846761c8c99/volumes"
Jul 15 23:54:24.165592 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:24.165562    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:25.172266 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:25.172239    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 15 23:54:25.223506 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:25.223447    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"]
Jul 15 23:54:25.223766 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:25.223728    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk" podUID="bd933d79-2281-4c63-8447-5658a527f253" containerName="manager" containerID="cri-o://d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b" gracePeriod=10
Jul 15 23:54:25.992217 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:25.992189    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:26.047929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.047902    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd933d79-2281-4c63-8447-5658a527f253-extensions-socket-volume\") pod \"bd933d79-2281-4c63-8447-5658a527f253\" (UID: \"bd933d79-2281-4c63-8447-5658a527f253\") "
Jul 15 23:54:26.048116 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.047973    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpgss\" (UniqueName: \"kubernetes.io/projected/bd933d79-2281-4c63-8447-5658a527f253-kube-api-access-qpgss\") pod \"bd933d79-2281-4c63-8447-5658a527f253\" (UID: \"bd933d79-2281-4c63-8447-5658a527f253\") "
Jul 15 23:54:26.048263 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.048240    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd933d79-2281-4c63-8447-5658a527f253-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bd933d79-2281-4c63-8447-5658a527f253" (UID: "bd933d79-2281-4c63-8447-5658a527f253"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:54:26.050031 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.050002    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd933d79-2281-4c63-8447-5658a527f253-kube-api-access-qpgss" (OuterVolumeSpecName: "kube-api-access-qpgss") pod "bd933d79-2281-4c63-8447-5658a527f253" (UID: "bd933d79-2281-4c63-8447-5658a527f253"). InnerVolumeSpecName "kube-api-access-qpgss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:54:26.149235 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.149197    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd933d79-2281-4c63-8447-5658a527f253-extensions-socket-volume\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:26.149235 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.149229    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpgss\" (UniqueName: \"kubernetes.io/projected/bd933d79-2281-4c63-8447-5658a527f253-kube-api-access-qpgss\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:26.229831 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.229796    2576 generic.go:356] "Generic (PLEG): container finished" podID="bd933d79-2281-4c63-8447-5658a527f253" containerID="d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b" exitCode=0
Jul 15 23:54:26.230256 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.229841    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"
Jul 15 23:54:26.230256 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.229878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk" event={"ID":"bd933d79-2281-4c63-8447-5658a527f253","Type":"ContainerDied","Data":"d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b"}
Jul 15 23:54:26.230256 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.229928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk" event={"ID":"bd933d79-2281-4c63-8447-5658a527f253","Type":"ContainerDied","Data":"37c8fc35bcae83a1341566f1fbe04a82a987a4ad9b0d90cd2a81b37fd0a9e074"}
Jul 15 23:54:26.230256 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.229955    2576 scope.go:117] "RemoveContainer" containerID="d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b"
Jul 15 23:54:26.238763 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.238744    2576 scope.go:117] "RemoveContainer" containerID="d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b"
Jul 15 23:54:26.239015 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:26.238996    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b\": container with ID starting with d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b not found: ID does not exist" containerID="d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b"
Jul 15 23:54:26.239088 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.239023    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b"} err="failed to get container status \"d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b\": rpc error: code = NotFound desc = could not find container \"d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b\": container with ID starting with d5651d8e64792fc80fbca1c48d9212bb40f6efc529791b34ec400351cfd9eb0b not found: ID does not exist"
Jul 15 23:54:26.248017 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.247990    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"]
Jul 15 23:54:26.253765 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:26.253741    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsxlk"]
Jul 15 23:54:28.187190 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:28.187157    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd933d79-2281-4c63-8447-5658a527f253" path="/var/lib/kubelet/pods/bd933d79-2281-4c63-8447-5658a527f253/volumes"
Jul 15 23:54:41.541848 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.541808    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"]
Jul 15 23:54:41.542384 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.542368    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd933d79-2281-4c63-8447-5658a527f253" containerName="manager"
Jul 15 23:54:41.542451 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.542387    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd933d79-2281-4c63-8447-5658a527f253" containerName="manager"
Jul 15 23:54:41.542451 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.542410    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4966530-5b32-4bff-9067-2846761c8c99" containerName="console"
Jul 15 23:54:41.542451 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.542418    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4966530-5b32-4bff-9067-2846761c8c99" containerName="console"
Jul 15 23:54:41.542548 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.542491    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4966530-5b32-4bff-9067-2846761c8c99" containerName="console"
Jul 15 23:54:41.542548 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.542507    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd933d79-2281-4c63-8447-5658a527f253" containerName="manager"
Jul 15 23:54:41.593624 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.593567    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"]
Jul 15 23:54:41.593779 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.593702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.596045 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.596025    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-j9mhh\""
Jul 15 23:54:41.596045 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.596043    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 23:54:41.677291 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.677261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.677450 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.677295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.677450 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.677330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.677450 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.677428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.677645 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.677457    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.677645 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.677561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.677645 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.677631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.677792 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.677670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.677792 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.677707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhk6g\" (UniqueName: \"kubernetes.io/projected/6ddcaa21-41ef-41a3-836c-dbda32baa60b-kube-api-access-bhk6g\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779334 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779334 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779334 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhk6g\" (UniqueName: \"kubernetes.io/projected/6ddcaa21-41ef-41a3-836c-dbda32baa60b-kube-api-access-bhk6g\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779334 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779263    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779334 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779625 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779625 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779387    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779625 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779794 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.779869 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.779849    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.780019 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.780000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.780140 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.780114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.780547 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.780524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.781961 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.781941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.782149 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.782130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.786823 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.786800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ddcaa21-41ef-41a3-836c-dbda32baa60b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.787003 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.786983    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhk6g\" (UniqueName: \"kubernetes.io/projected/6ddcaa21-41ef-41a3-836c-dbda32baa60b-kube-api-access-bhk6g\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxh2p\" (UID: \"6ddcaa21-41ef-41a3-836c-dbda32baa60b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:41.904130 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:41.904095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:42.038931 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:42.038898    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"]
Jul 15 23:54:42.041952 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:54:42.041925    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ddcaa21_41ef_41a3_836c_dbda32baa60b.slice/crio-ec1cbe4daeb8180de92819fe30fdc28ab8c532ae7321585500e583973457c8ae WatchSource:0}: Error finding container ec1cbe4daeb8180de92819fe30fdc28ab8c532ae7321585500e583973457c8ae: Status 404 returned error can't find the container with id ec1cbe4daeb8180de92819fe30fdc28ab8c532ae7321585500e583973457c8ae
Jul 15 23:54:42.315833 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:42.315746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p" event={"ID":"6ddcaa21-41ef-41a3-836c-dbda32baa60b","Type":"ContainerStarted","Data":"ec1cbe4daeb8180de92819fe30fdc28ab8c532ae7321585500e583973457c8ae"}
Jul 15 23:54:44.542824 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:44.542784    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:54:44.543203 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:44.542886    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:54:44.543203 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:44.542939    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:54:45.335095 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:45.335055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p" event={"ID":"6ddcaa21-41ef-41a3-836c-dbda32baa60b","Type":"ContainerStarted","Data":"a27807701846eb439c7fe88e15149427123a7247107e4cc30e06c898d662a550"}
Jul 15 23:54:45.355272 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:45.355223    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p" podStartSLOduration=1.856981048 podStartE2EDuration="4.355208201s" totalImagesPullingTime="2.498227153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:45.352578065 +0000 UTC m=+445.619175691" watchObservedRunningTime="2026-07-15 23:54:45.355208201 +0000 UTC m=+445.621805907"
Jul 15 23:54:45.905151 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:45.905113    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:45.909965 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:45.909947    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:46.313089 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.313008    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zswrr"]
Jul 15 23:54:46.316836 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.316815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:54:46.319068 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.319050    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 23:54:46.324507 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.324469    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zswrr"]
Jul 15 23:54:46.341748 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.341723    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:46.342920 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.342897    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:54:46.413886 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.413850    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zswrr"]
Jul 15 23:54:46.417846 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.417820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d742776f-18a3-47bd-8658-4bb882e35400-config-file\") pod \"limitador-limitador-64c94fd64f-zswrr\" (UID: \"d742776f-18a3-47bd-8658-4bb882e35400\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:54:46.417999 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.417966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wzvg\" (UniqueName: \"kubernetes.io/projected/d742776f-18a3-47bd-8658-4bb882e35400-kube-api-access-9wzvg\") pod \"limitador-limitador-64c94fd64f-zswrr\" (UID: \"d742776f-18a3-47bd-8658-4bb882e35400\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:54:46.519277 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.519229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d742776f-18a3-47bd-8658-4bb882e35400-config-file\") pod \"limitador-limitador-64c94fd64f-zswrr\" (UID: \"d742776f-18a3-47bd-8658-4bb882e35400\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:54:46.519496 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.519398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wzvg\" (UniqueName: \"kubernetes.io/projected/d742776f-18a3-47bd-8658-4bb882e35400-kube-api-access-9wzvg\") pod \"limitador-limitador-64c94fd64f-zswrr\" (UID: \"d742776f-18a3-47bd-8658-4bb882e35400\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:54:46.520186 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.520160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d742776f-18a3-47bd-8658-4bb882e35400-config-file\") pod \"limitador-limitador-64c94fd64f-zswrr\" (UID: \"d742776f-18a3-47bd-8658-4bb882e35400\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:54:46.527874 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.527824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wzvg\" (UniqueName: \"kubernetes.io/projected/d742776f-18a3-47bd-8658-4bb882e35400-kube-api-access-9wzvg\") pod \"limitador-limitador-64c94fd64f-zswrr\" (UID: \"d742776f-18a3-47bd-8658-4bb882e35400\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:54:46.629143 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.629058    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:54:46.791698 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:46.791673    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zswrr"]
Jul 15 23:54:46.793336 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:54:46.793310    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd742776f_18a3_47bd_8658_4bb882e35400.slice/crio-d1c2c22616eae7a279afef5fc44722ffde53822f66de1131fe552a87b0e6455a WatchSource:0}: Error finding container d1c2c22616eae7a279afef5fc44722ffde53822f66de1131fe552a87b0e6455a: Status 404 returned error can't find the container with id d1c2c22616eae7a279afef5fc44722ffde53822f66de1131fe552a87b0e6455a
Jul 15 23:54:47.103014 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.102982    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-g8k9w"]
Jul 15 23:54:47.107957 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.107936    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g8k9w"
Jul 15 23:54:47.110137 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.110118    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-59bdj\""
Jul 15 23:54:47.113523 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.113498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8k9w"]
Jul 15 23:54:47.219285 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.219253    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7pqn"]
Jul 15 23:54:47.222894 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.222812    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7pqn"
Jul 15 23:54:47.225478 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.225454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sptpp\" (UniqueName: \"kubernetes.io/projected/b54657be-6d7f-4c61-b61d-84e5bd21d2ee-kube-api-access-sptpp\") pod \"authorino-58cd955675-g8k9w\" (UID: \"b54657be-6d7f-4c61-b61d-84e5bd21d2ee\") " pod="kuadrant-system/authorino-58cd955675-g8k9w"
Jul 15 23:54:47.230376 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.230243    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7pqn"]
Jul 15 23:54:47.325994 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.325960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2vsn\" (UniqueName: \"kubernetes.io/projected/490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e-kube-api-access-w2vsn\") pod \"authorino-75d556bd77-b7pqn\" (UID: \"490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e\") " pod="kuadrant-system/authorino-75d556bd77-b7pqn"
Jul 15 23:54:47.326166 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.326006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sptpp\" (UniqueName: \"kubernetes.io/projected/b54657be-6d7f-4c61-b61d-84e5bd21d2ee-kube-api-access-sptpp\") pod \"authorino-58cd955675-g8k9w\" (UID: \"b54657be-6d7f-4c61-b61d-84e5bd21d2ee\") " pod="kuadrant-system/authorino-58cd955675-g8k9w"
Jul 15 23:54:47.334192 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.334166    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sptpp\" (UniqueName: \"kubernetes.io/projected/b54657be-6d7f-4c61-b61d-84e5bd21d2ee-kube-api-access-sptpp\") pod \"authorino-58cd955675-g8k9w\" (UID: \"b54657be-6d7f-4c61-b61d-84e5bd21d2ee\") " pod="kuadrant-system/authorino-58cd955675-g8k9w"
Jul 15 23:54:47.348669 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.348634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr" event={"ID":"d742776f-18a3-47bd-8658-4bb882e35400","Type":"ContainerStarted","Data":"d1c2c22616eae7a279afef5fc44722ffde53822f66de1131fe552a87b0e6455a"}
Jul 15 23:54:47.418826 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.418795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g8k9w"
Jul 15 23:54:47.428040 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.427672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2vsn\" (UniqueName: \"kubernetes.io/projected/490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e-kube-api-access-w2vsn\") pod \"authorino-75d556bd77-b7pqn\" (UID: \"490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e\") " pod="kuadrant-system/authorino-75d556bd77-b7pqn"
Jul 15 23:54:47.436691 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.436663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2vsn\" (UniqueName: \"kubernetes.io/projected/490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e-kube-api-access-w2vsn\") pod \"authorino-75d556bd77-b7pqn\" (UID: \"490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e\") " pod="kuadrant-system/authorino-75d556bd77-b7pqn"
Jul 15 23:54:47.533793 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.533710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7pqn"
Jul 15 23:54:47.607720 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.607584    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8k9w"]
Jul 15 23:54:47.746937 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:47.746897    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7pqn"]
Jul 15 23:54:47.749246 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:54:47.749218    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod490d6c8b_2d9e_4c6b_8582_7eaf28ac6d1e.slice/crio-2ca76e4c23e5b7100f5e33ce1f239ff031ff718d632cc7687edec7fa80c6486c WatchSource:0}: Error finding container 2ca76e4c23e5b7100f5e33ce1f239ff031ff718d632cc7687edec7fa80c6486c: Status 404 returned error can't find the container with id 2ca76e4c23e5b7100f5e33ce1f239ff031ff718d632cc7687edec7fa80c6486c
Jul 15 23:54:48.362464 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:48.362424    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7pqn" event={"ID":"490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e","Type":"ContainerStarted","Data":"2ca76e4c23e5b7100f5e33ce1f239ff031ff718d632cc7687edec7fa80c6486c"}
Jul 15 23:54:48.365757 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:48.365713    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g8k9w" event={"ID":"b54657be-6d7f-4c61-b61d-84e5bd21d2ee","Type":"ContainerStarted","Data":"2cdc0957610caf6530fe92d4afb414c59b369c9e220570eb45995e57b6923d2f"}
Jul 15 23:54:52.390794 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:52.390757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g8k9w" event={"ID":"b54657be-6d7f-4c61-b61d-84e5bd21d2ee","Type":"ContainerStarted","Data":"f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9"}
Jul 15 23:54:52.392245 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:52.392221    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr" event={"ID":"d742776f-18a3-47bd-8658-4bb882e35400","Type":"ContainerStarted","Data":"2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b"}
Jul 15 23:54:52.392361 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:52.392322    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:54:52.393782 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:52.393755    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7pqn" event={"ID":"490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e","Type":"ContainerStarted","Data":"03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331"}
Jul 15 23:54:52.406383 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:52.406342    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-g8k9w" podStartSLOduration=1.321057133 podStartE2EDuration="5.406327513s" totalImagesPullingTime="4.08527038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:52.404053181 +0000 UTC m=+452.670650795" watchObservedRunningTime="2026-07-15 23:54:52.406327513 +0000 UTC m=+452.672925128"
Jul 15 23:54:52.420743 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:52.420693    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-b7pqn" podStartSLOduration=1.462905518 podStartE2EDuration="5.420678445s" totalImagesPullingTime="3.957772927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:52.418282978 +0000 UTC m=+452.684880594" watchObservedRunningTime="2026-07-15 23:54:52.420678445 +0000 UTC m=+452.687276060"
Jul 15 23:54:52.435061 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:52.435016    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr" podStartSLOduration=1.533501797 podStartE2EDuration="6.435000371s" totalImagesPullingTime="4.901498574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:54:52.432940824 +0000 UTC m=+452.699538439" watchObservedRunningTime="2026-07-15 23:54:52.435000371 +0000 UTC m=+452.701597985"
Jul 15 23:54:52.447092 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:52.447067    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8k9w"]
Jul 15 23:54:54.404644 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:54.404592    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-g8k9w" podUID="b54657be-6d7f-4c61-b61d-84e5bd21d2ee" containerName="authorino" containerID="cri-o://f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9" gracePeriod=30
Jul 15 23:54:54.654024 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:54.653998    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g8k9w"
Jul 15 23:54:54.697277 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:54.697195    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sptpp\" (UniqueName: \"kubernetes.io/projected/b54657be-6d7f-4c61-b61d-84e5bd21d2ee-kube-api-access-sptpp\") pod \"b54657be-6d7f-4c61-b61d-84e5bd21d2ee\" (UID: \"b54657be-6d7f-4c61-b61d-84e5bd21d2ee\") "
Jul 15 23:54:54.699172 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:54.699137    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b54657be-6d7f-4c61-b61d-84e5bd21d2ee-kube-api-access-sptpp" (OuterVolumeSpecName: "kube-api-access-sptpp") pod "b54657be-6d7f-4c61-b61d-84e5bd21d2ee" (UID: "b54657be-6d7f-4c61-b61d-84e5bd21d2ee"). InnerVolumeSpecName "kube-api-access-sptpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:54:54.797756 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:54.797719    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sptpp\" (UniqueName: \"kubernetes.io/projected/b54657be-6d7f-4c61-b61d-84e5bd21d2ee-kube-api-access-sptpp\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:54:55.410686 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:55.410653    2576 generic.go:356] "Generic (PLEG): container finished" podID="b54657be-6d7f-4c61-b61d-84e5bd21d2ee" containerID="f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9" exitCode=0
Jul 15 23:54:55.411069 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:55.410696    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g8k9w"
Jul 15 23:54:55.411069 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:55.410746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g8k9w" event={"ID":"b54657be-6d7f-4c61-b61d-84e5bd21d2ee","Type":"ContainerDied","Data":"f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9"}
Jul 15 23:54:55.411069 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:55.410786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g8k9w" event={"ID":"b54657be-6d7f-4c61-b61d-84e5bd21d2ee","Type":"ContainerDied","Data":"2cdc0957610caf6530fe92d4afb414c59b369c9e220570eb45995e57b6923d2f"}
Jul 15 23:54:55.411069 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:55.410803    2576 scope.go:117] "RemoveContainer" containerID="f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9"
Jul 15 23:54:55.419674 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:55.419657    2576 scope.go:117] "RemoveContainer" containerID="f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9"
Jul 15 23:54:55.419936 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:54:55.419917    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9\": container with ID starting with f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9 not found: ID does not exist" containerID="f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9"
Jul 15 23:54:55.420002 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:55.419950    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9"} err="failed to get container status \"f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9\": rpc error: code = NotFound desc = could not find container \"f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9\": container with ID starting with f33a142ef28c6c62f876e4a0446b590ad5ba67a16d68605a431bc61deacb74b9 not found: ID does not exist"
Jul 15 23:54:55.431169 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:55.431139    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8k9w"]
Jul 15 23:54:55.434813 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:55.434792    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-g8k9w"]
Jul 15 23:54:56.187221 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:54:56.187188    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b54657be-6d7f-4c61-b61d-84e5bd21d2ee" path="/var/lib/kubelet/pods/b54657be-6d7f-4c61-b61d-84e5bd21d2ee/volumes"
Jul 15 23:55:00.577788 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:00.577754    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zswrr"]
Jul 15 23:55:00.578197 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:00.577939    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr" podUID="d742776f-18a3-47bd-8658-4bb882e35400" containerName="limitador" containerID="cri-o://2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b" gracePeriod=30
Jul 15 23:55:00.578587 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:00.578565    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:55:01.126092 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.126064    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:55:01.148230 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.148155    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wzvg\" (UniqueName: \"kubernetes.io/projected/d742776f-18a3-47bd-8658-4bb882e35400-kube-api-access-9wzvg\") pod \"d742776f-18a3-47bd-8658-4bb882e35400\" (UID: \"d742776f-18a3-47bd-8658-4bb882e35400\") "
Jul 15 23:55:01.148230 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.148224    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d742776f-18a3-47bd-8658-4bb882e35400-config-file\") pod \"d742776f-18a3-47bd-8658-4bb882e35400\" (UID: \"d742776f-18a3-47bd-8658-4bb882e35400\") "
Jul 15 23:55:01.148680 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.148651    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d742776f-18a3-47bd-8658-4bb882e35400-config-file" (OuterVolumeSpecName: "config-file") pod "d742776f-18a3-47bd-8658-4bb882e35400" (UID: "d742776f-18a3-47bd-8658-4bb882e35400"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:55:01.150317 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.150286    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d742776f-18a3-47bd-8658-4bb882e35400-kube-api-access-9wzvg" (OuterVolumeSpecName: "kube-api-access-9wzvg") pod "d742776f-18a3-47bd-8658-4bb882e35400" (UID: "d742776f-18a3-47bd-8658-4bb882e35400"). InnerVolumeSpecName "kube-api-access-9wzvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:55:01.249555 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.249515    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wzvg\" (UniqueName: \"kubernetes.io/projected/d742776f-18a3-47bd-8658-4bb882e35400-kube-api-access-9wzvg\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:55:01.249555 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.249546    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d742776f-18a3-47bd-8658-4bb882e35400-config-file\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:55:01.442686 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.442567    2576 generic.go:356] "Generic (PLEG): container finished" podID="d742776f-18a3-47bd-8658-4bb882e35400" containerID="2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b" exitCode=0
Jul 15 23:55:01.442686 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.442640    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr"
Jul 15 23:55:01.442686 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.442654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr" event={"ID":"d742776f-18a3-47bd-8658-4bb882e35400","Type":"ContainerDied","Data":"2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b"}
Jul 15 23:55:01.442962 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.442706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zswrr" event={"ID":"d742776f-18a3-47bd-8658-4bb882e35400","Type":"ContainerDied","Data":"d1c2c22616eae7a279afef5fc44722ffde53822f66de1131fe552a87b0e6455a"}
Jul 15 23:55:01.442962 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.442730    2576 scope.go:117] "RemoveContainer" containerID="2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b"
Jul 15 23:55:01.451893 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.451877    2576 scope.go:117] "RemoveContainer" containerID="2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b"
Jul 15 23:55:01.452171 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:55:01.452153    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b\": container with ID starting with 2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b not found: ID does not exist" containerID="2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b"
Jul 15 23:55:01.452220 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.452182    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b"} err="failed to get container status \"2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b\": rpc error: code = NotFound desc = could not find container \"2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b\": container with ID starting with 2b127d2f23a949838cfa79910a89eb238d06e55e89f098887d81b3f6a2692b3b not found: ID does not exist"
Jul 15 23:55:01.462703 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.462675    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zswrr"]
Jul 15 23:55:01.467547 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:01.467525    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zswrr"]
Jul 15 23:55:02.187741 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.187706    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d742776f-18a3-47bd-8658-4bb882e35400" path="/var/lib/kubelet/pods/d742776f-18a3-47bd-8658-4bb882e35400/volumes"
Jul 15 23:55:02.800546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.800509    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"]
Jul 15 23:55:02.801112 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.801093    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d742776f-18a3-47bd-8658-4bb882e35400" containerName="limitador"
Jul 15 23:55:02.801159 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.801117    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d742776f-18a3-47bd-8658-4bb882e35400" containerName="limitador"
Jul 15 23:55:02.801159 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.801137    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b54657be-6d7f-4c61-b61d-84e5bd21d2ee" containerName="authorino"
Jul 15 23:55:02.801159 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.801146    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54657be-6d7f-4c61-b61d-84e5bd21d2ee" containerName="authorino"
Jul 15 23:55:02.801264 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.801253    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d742776f-18a3-47bd-8658-4bb882e35400" containerName="limitador"
Jul 15 23:55:02.801298 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.801271    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b54657be-6d7f-4c61-b61d-84e5bd21d2ee" containerName="authorino"
Jul 15 23:55:02.805784 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.805762    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:02.808389 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.808159    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 23:55:02.808389 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.808160    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 23:55:02.808389 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.808226    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-8b8nk\""
Jul 15 23:55:02.808389 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.808254    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 23:55:02.810420 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.810393    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"]
Jul 15 23:55:02.864016 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.863983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/139bf852-9dd4-452c-aed3-31a5fefb85d4-data\") pod \"postgres-69fb4594cf-4rkfp\" (UID: \"139bf852-9dd4-452c-aed3-31a5fefb85d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:02.864193 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.864070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppdgr\" (UniqueName: \"kubernetes.io/projected/139bf852-9dd4-452c-aed3-31a5fefb85d4-kube-api-access-ppdgr\") pod \"postgres-69fb4594cf-4rkfp\" (UID: \"139bf852-9dd4-452c-aed3-31a5fefb85d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:02.964539 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.964501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/139bf852-9dd4-452c-aed3-31a5fefb85d4-data\") pod \"postgres-69fb4594cf-4rkfp\" (UID: \"139bf852-9dd4-452c-aed3-31a5fefb85d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:02.964783 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.964655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppdgr\" (UniqueName: \"kubernetes.io/projected/139bf852-9dd4-452c-aed3-31a5fefb85d4-kube-api-access-ppdgr\") pod \"postgres-69fb4594cf-4rkfp\" (UID: \"139bf852-9dd4-452c-aed3-31a5fefb85d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:02.964928 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.964905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/139bf852-9dd4-452c-aed3-31a5fefb85d4-data\") pod \"postgres-69fb4594cf-4rkfp\" (UID: \"139bf852-9dd4-452c-aed3-31a5fefb85d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:02.972592 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:02.972562    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppdgr\" (UniqueName: \"kubernetes.io/projected/139bf852-9dd4-452c-aed3-31a5fefb85d4-kube-api-access-ppdgr\") pod \"postgres-69fb4594cf-4rkfp\" (UID: \"139bf852-9dd4-452c-aed3-31a5fefb85d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:03.118365 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:03.118277    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:03.252150 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:03.252124    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"]
Jul 15 23:55:03.254061 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:55:03.254037    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139bf852_9dd4_452c_aed3_31a5fefb85d4.slice/crio-bd82745528556f37c5ff77b02ab5d8150cc7cef81c0a5a2c656af51c8ae0f47f WatchSource:0}: Error finding container bd82745528556f37c5ff77b02ab5d8150cc7cef81c0a5a2c656af51c8ae0f47f: Status 404 returned error can't find the container with id bd82745528556f37c5ff77b02ab5d8150cc7cef81c0a5a2c656af51c8ae0f47f
Jul 15 23:55:03.460155 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:03.460123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp" event={"ID":"139bf852-9dd4-452c-aed3-31a5fefb85d4","Type":"ContainerStarted","Data":"bd82745528556f37c5ff77b02ab5d8150cc7cef81c0a5a2c656af51c8ae0f47f"}
Jul 15 23:55:08.495365 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:08.495327    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp" event={"ID":"139bf852-9dd4-452c-aed3-31a5fefb85d4","Type":"ContainerStarted","Data":"c6ae04179b7f78fe107c8ac016a02c6b3a4ac91d87d13c3faceab70393f15736"}
Jul 15 23:55:08.495796 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:08.495400    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:08.510466 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:08.510418    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp" podStartSLOduration=1.7718177069999999 podStartE2EDuration="6.510401217s" totalImagesPullingTime="4.73858351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:55:08.509199731 +0000 UTC m=+468.775797338" watchObservedRunningTime="2026-07-15 23:55:08.510401217 +0000 UTC m=+468.776998887"
Jul 15 23:55:14.530532 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:14.530500    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4rkfp"
Jul 15 23:55:15.058456 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.058423    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28kp7"]
Jul 15 23:55:15.065288 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.065263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28kp7"
Jul 15 23:55:15.068221 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.068196    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28kp7"]
Jul 15 23:55:15.181949 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.181916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64m6\" (UniqueName: \"kubernetes.io/projected/200ee179-9d1b-4e83-ad85-1ba3a0df522e-kube-api-access-s64m6\") pod \"authorino-5d4b67c446-28kp7\" (UID: \"200ee179-9d1b-4e83-ad85-1ba3a0df522e\") " pod="kuadrant-system/authorino-5d4b67c446-28kp7"
Jul 15 23:55:15.280538 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.280504    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28kp7"]
Jul 15 23:55:15.280800 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:55:15.280780    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-s64m6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-28kp7" podUID="200ee179-9d1b-4e83-ad85-1ba3a0df522e"
Jul 15 23:55:15.282478 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.282456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64m6\" (UniqueName: \"kubernetes.io/projected/200ee179-9d1b-4e83-ad85-1ba3a0df522e-kube-api-access-s64m6\") pod \"authorino-5d4b67c446-28kp7\" (UID: \"200ee179-9d1b-4e83-ad85-1ba3a0df522e\") " pod="kuadrant-system/authorino-5d4b67c446-28kp7"
Jul 15 23:55:15.296501 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.296476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64m6\" (UniqueName: \"kubernetes.io/projected/200ee179-9d1b-4e83-ad85-1ba3a0df522e-kube-api-access-s64m6\") pod \"authorino-5d4b67c446-28kp7\" (UID: \"200ee179-9d1b-4e83-ad85-1ba3a0df522e\") " pod="kuadrant-system/authorino-5d4b67c446-28kp7"
Jul 15 23:55:15.301937 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.301909    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f9f4c79b5-nhc68"]
Jul 15 23:55:15.306499 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.306480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9f4c79b5-nhc68"
Jul 15 23:55:15.311359 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.311300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f9f4c79b5-nhc68"]
Jul 15 23:55:15.365807 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.365765    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f9f4c79b5-nhc68"]
Jul 15 23:55:15.366082 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:55:15.366057    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2kr9t], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6f9f4c79b5-nhc68" podUID="5f0e8a9b-becd-447a-8ac7-515e2aff75be"
Jul 15 23:55:15.384151 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.384119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kr9t\" (UniqueName: \"kubernetes.io/projected/5f0e8a9b-becd-447a-8ac7-515e2aff75be-kube-api-access-2kr9t\") pod \"authorino-6f9f4c79b5-nhc68\" (UID: \"5f0e8a9b-becd-447a-8ac7-515e2aff75be\") " pod="kuadrant-system/authorino-6f9f4c79b5-nhc68"
Jul 15 23:55:15.485115 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.485080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kr9t\" (UniqueName: \"kubernetes.io/projected/5f0e8a9b-becd-447a-8ac7-515e2aff75be-kube-api-access-2kr9t\") pod \"authorino-6f9f4c79b5-nhc68\" (UID: \"5f0e8a9b-becd-447a-8ac7-515e2aff75be\") " pod="kuadrant-system/authorino-6f9f4c79b5-nhc68"
Jul 15 23:55:15.493403 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.493375    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kr9t\" (UniqueName: \"kubernetes.io/projected/5f0e8a9b-becd-447a-8ac7-515e2aff75be-kube-api-access-2kr9t\") pod \"authorino-6f9f4c79b5-nhc68\" (UID: \"5f0e8a9b-becd-447a-8ac7-515e2aff75be\") " pod="kuadrant-system/authorino-6f9f4c79b5-nhc68"
Jul 15 23:55:15.532876 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.532842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9f4c79b5-nhc68"
Jul 15 23:55:15.533239 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.532844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28kp7"
Jul 15 23:55:15.540986 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.540960    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9f4c79b5-nhc68"
Jul 15 23:55:15.543801 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.543782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28kp7"
Jul 15 23:55:15.686917 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.686888    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kr9t\" (UniqueName: \"kubernetes.io/projected/5f0e8a9b-becd-447a-8ac7-515e2aff75be-kube-api-access-2kr9t\") pod \"5f0e8a9b-becd-447a-8ac7-515e2aff75be\" (UID: \"5f0e8a9b-becd-447a-8ac7-515e2aff75be\") "
Jul 15 23:55:15.687086 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.686928    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s64m6\" (UniqueName: \"kubernetes.io/projected/200ee179-9d1b-4e83-ad85-1ba3a0df522e-kube-api-access-s64m6\") pod \"200ee179-9d1b-4e83-ad85-1ba3a0df522e\" (UID: \"200ee179-9d1b-4e83-ad85-1ba3a0df522e\") "
Jul 15 23:55:15.689005 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.688974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0e8a9b-becd-447a-8ac7-515e2aff75be-kube-api-access-2kr9t" (OuterVolumeSpecName: "kube-api-access-2kr9t") pod "5f0e8a9b-becd-447a-8ac7-515e2aff75be" (UID: "5f0e8a9b-becd-447a-8ac7-515e2aff75be"). InnerVolumeSpecName "kube-api-access-2kr9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:55:15.689100 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.689073    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200ee179-9d1b-4e83-ad85-1ba3a0df522e-kube-api-access-s64m6" (OuterVolumeSpecName: "kube-api-access-s64m6") pod "200ee179-9d1b-4e83-ad85-1ba3a0df522e" (UID: "200ee179-9d1b-4e83-ad85-1ba3a0df522e"). InnerVolumeSpecName "kube-api-access-s64m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:55:15.788346 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.788310    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kr9t\" (UniqueName: \"kubernetes.io/projected/5f0e8a9b-becd-447a-8ac7-515e2aff75be-kube-api-access-2kr9t\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:55:15.788346 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:15.788343    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s64m6\" (UniqueName: \"kubernetes.io/projected/200ee179-9d1b-4e83-ad85-1ba3a0df522e-kube-api-access-s64m6\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:55:16.538406 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:16.538328    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28kp7"
Jul 15 23:55:16.538822 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:16.538328    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9f4c79b5-nhc68"
Jul 15 23:55:16.566704 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:16.566673    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f9f4c79b5-nhc68"]
Jul 15 23:55:16.569912 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:16.569886    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f9f4c79b5-nhc68"]
Jul 15 23:55:16.590254 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:16.590224    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28kp7"]
Jul 15 23:55:16.592015 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:16.591992    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28kp7"]
Jul 15 23:55:18.187828 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:18.187796    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="200ee179-9d1b-4e83-ad85-1ba3a0df522e" path="/var/lib/kubelet/pods/200ee179-9d1b-4e83-ad85-1ba3a0df522e/volumes"
Jul 15 23:55:18.188274 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:18.188038    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f0e8a9b-becd-447a-8ac7-515e2aff75be" path="/var/lib/kubelet/pods/5f0e8a9b-becd-447a-8ac7-515e2aff75be/volumes"
Jul 15 23:55:19.708538 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:19.708503    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7pqn"]
Jul 15 23:55:19.709123 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:19.708685    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-b7pqn" podUID="490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e" containerName="authorino" containerID="cri-o://03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331" gracePeriod=30
Jul 15 23:55:19.991885 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:19.991811    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7pqn"
Jul 15 23:55:20.125673 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.125650    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2vsn\" (UniqueName: \"kubernetes.io/projected/490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e-kube-api-access-w2vsn\") pod \"490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e\" (UID: \"490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e\") "
Jul 15 23:55:20.127657 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.127632    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e-kube-api-access-w2vsn" (OuterVolumeSpecName: "kube-api-access-w2vsn") pod "490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e" (UID: "490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e"). InnerVolumeSpecName "kube-api-access-w2vsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:55:20.226449 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.226418    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2vsn\" (UniqueName: \"kubernetes.io/projected/490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e-kube-api-access-w2vsn\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:55:20.565801 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.565769    2576 generic.go:356] "Generic (PLEG): container finished" podID="490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e" containerID="03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331" exitCode=0
Jul 15 23:55:20.565993 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.565808    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7pqn"
Jul 15 23:55:20.565993 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.565856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7pqn" event={"ID":"490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e","Type":"ContainerDied","Data":"03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331"}
Jul 15 23:55:20.565993 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.565899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7pqn" event={"ID":"490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e","Type":"ContainerDied","Data":"2ca76e4c23e5b7100f5e33ce1f239ff031ff718d632cc7687edec7fa80c6486c"}
Jul 15 23:55:20.565993 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.565925    2576 scope.go:117] "RemoveContainer" containerID="03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331"
Jul 15 23:55:20.574230 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.574214    2576 scope.go:117] "RemoveContainer" containerID="03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331"
Jul 15 23:55:20.574494 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:55:20.574473    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331\": container with ID starting with 03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331 not found: ID does not exist" containerID="03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331"
Jul 15 23:55:20.574638 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.574501    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331"} err="failed to get container status \"03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331\": rpc error: code = NotFound desc = could not find container \"03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331\": container with ID starting with 03162de897751fbf00c5b4c713028f0f506e16a580775287325d44c473cab331 not found: ID does not exist"
Jul 15 23:55:20.580436 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.580414    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7pqn"]
Jul 15 23:55:20.583914 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:20.583891    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7pqn"]
Jul 15 23:55:22.186729 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:22.186691    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e" path="/var/lib/kubelet/pods/490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e/volumes"
Jul 15 23:55:24.200880 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.200843    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fcbf47454-zwzfd"]
Jul 15 23:55:24.201369 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.201184    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e" containerName="authorino"
Jul 15 23:55:24.201369 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.201196    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e" containerName="authorino"
Jul 15 23:55:24.201369 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.201266    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="490d6c8b-2d9e-4c6b-8582-7eaf28ac6d1e" containerName="authorino"
Jul 15 23:55:24.395326 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.395288    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fcbf47454-zwzfd"]
Jul 15 23:55:24.395326 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.395332    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67c79c5bd5-x8vsp"]
Jul 15 23:55:24.395516 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.395422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:24.397862 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.397833    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 23:55:24.398014 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.397840    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g997x\""
Jul 15 23:55:24.398014 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.397893    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 23:55:24.417204 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.417175    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67c79c5bd5-x8vsp"]
Jul 15 23:55:24.417317 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.417282    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:24.568685 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.568582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f5ls\" (UniqueName: \"kubernetes.io/projected/2a29b6fb-27e1-4013-bf84-7929c87af931-kube-api-access-6f5ls\") pod \"maas-controller-7fcbf47454-zwzfd\" (UID: \"2a29b6fb-27e1-4013-bf84-7929c87af931\") " pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:24.568838 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.568737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd6g7\" (UniqueName: \"kubernetes.io/projected/6bdf3282-db46-4bba-89ba-ae973283aa47-kube-api-access-jd6g7\") pod \"maas-controller-67c79c5bd5-x8vsp\" (UID: \"6bdf3282-db46-4bba-89ba-ae973283aa47\") " pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:24.568838 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.568780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bdf3282-db46-4bba-89ba-ae973283aa47-webhook-cert\") pod \"maas-controller-67c79c5bd5-x8vsp\" (UID: \"6bdf3282-db46-4bba-89ba-ae973283aa47\") " pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:24.568838 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.568823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a29b6fb-27e1-4013-bf84-7929c87af931-webhook-cert\") pod \"maas-controller-7fcbf47454-zwzfd\" (UID: \"2a29b6fb-27e1-4013-bf84-7929c87af931\") " pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:24.669423 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.669379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bdf3282-db46-4bba-89ba-ae973283aa47-webhook-cert\") pod \"maas-controller-67c79c5bd5-x8vsp\" (UID: \"6bdf3282-db46-4bba-89ba-ae973283aa47\") " pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:24.669423 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.669428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a29b6fb-27e1-4013-bf84-7929c87af931-webhook-cert\") pod \"maas-controller-7fcbf47454-zwzfd\" (UID: \"2a29b6fb-27e1-4013-bf84-7929c87af931\") " pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:24.669732 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.669465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f5ls\" (UniqueName: \"kubernetes.io/projected/2a29b6fb-27e1-4013-bf84-7929c87af931-kube-api-access-6f5ls\") pod \"maas-controller-7fcbf47454-zwzfd\" (UID: \"2a29b6fb-27e1-4013-bf84-7929c87af931\") " pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:24.669732 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:55:24.669527    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 15 23:55:24.669732 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.669560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd6g7\" (UniqueName: \"kubernetes.io/projected/6bdf3282-db46-4bba-89ba-ae973283aa47-kube-api-access-jd6g7\") pod \"maas-controller-67c79c5bd5-x8vsp\" (UID: \"6bdf3282-db46-4bba-89ba-ae973283aa47\") " pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:24.669732 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:55:24.669592    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bdf3282-db46-4bba-89ba-ae973283aa47-webhook-cert podName:6bdf3282-db46-4bba-89ba-ae973283aa47 nodeName:}" failed. No retries permitted until 2026-07-15 23:55:25.169576643 +0000 UTC m=+485.436174236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6bdf3282-db46-4bba-89ba-ae973283aa47-webhook-cert") pod "maas-controller-67c79c5bd5-x8vsp" (UID: "6bdf3282-db46-4bba-89ba-ae973283aa47") : secret "maas-controller-webhook-cert" not found
Jul 15 23:55:24.669732 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:55:24.669591    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 15 23:55:24.669732 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:55:24.669676    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a29b6fb-27e1-4013-bf84-7929c87af931-webhook-cert podName:2a29b6fb-27e1-4013-bf84-7929c87af931 nodeName:}" failed. No retries permitted until 2026-07-15 23:55:25.169661546 +0000 UTC m=+485.436259139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2a29b6fb-27e1-4013-bf84-7929c87af931-webhook-cert") pod "maas-controller-7fcbf47454-zwzfd" (UID: "2a29b6fb-27e1-4013-bf84-7929c87af931") : secret "maas-controller-webhook-cert" not found
Jul 15 23:55:24.679246 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.679222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd6g7\" (UniqueName: \"kubernetes.io/projected/6bdf3282-db46-4bba-89ba-ae973283aa47-kube-api-access-jd6g7\") pod \"maas-controller-67c79c5bd5-x8vsp\" (UID: \"6bdf3282-db46-4bba-89ba-ae973283aa47\") " pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:24.679352 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:24.679226    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f5ls\" (UniqueName: \"kubernetes.io/projected/2a29b6fb-27e1-4013-bf84-7929c87af931-kube-api-access-6f5ls\") pod \"maas-controller-7fcbf47454-zwzfd\" (UID: \"2a29b6fb-27e1-4013-bf84-7929c87af931\") " pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:25.174546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.174512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bdf3282-db46-4bba-89ba-ae973283aa47-webhook-cert\") pod \"maas-controller-67c79c5bd5-x8vsp\" (UID: \"6bdf3282-db46-4bba-89ba-ae973283aa47\") " pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:25.174546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.174548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a29b6fb-27e1-4013-bf84-7929c87af931-webhook-cert\") pod \"maas-controller-7fcbf47454-zwzfd\" (UID: \"2a29b6fb-27e1-4013-bf84-7929c87af931\") " pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:25.176927 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.176904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a29b6fb-27e1-4013-bf84-7929c87af931-webhook-cert\") pod \"maas-controller-7fcbf47454-zwzfd\" (UID: \"2a29b6fb-27e1-4013-bf84-7929c87af931\") " pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:25.177077 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.177057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bdf3282-db46-4bba-89ba-ae973283aa47-webhook-cert\") pod \"maas-controller-67c79c5bd5-x8vsp\" (UID: \"6bdf3282-db46-4bba-89ba-ae973283aa47\") " pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:25.305280 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.305252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:25.327114 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.327083    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:25.450544 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.450510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fcbf47454-zwzfd"]
Jul 15 23:55:25.452207 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:55:25.452181    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a29b6fb_27e1_4013_bf84_7929c87af931.slice/crio-515ac82caacb7d37d1864cb202defab68d7fd41e32ff82582b42c5f502888474 WatchSource:0}: Error finding container 515ac82caacb7d37d1864cb202defab68d7fd41e32ff82582b42c5f502888474: Status 404 returned error can't find the container with id 515ac82caacb7d37d1864cb202defab68d7fd41e32ff82582b42c5f502888474
Jul 15 23:55:25.474440 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.474417    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67c79c5bd5-x8vsp"]
Jul 15 23:55:25.475444 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:55:25.475417    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bdf3282_db46_4bba_89ba_ae973283aa47.slice/crio-5d0ae0d47f854da91cbad213c8d15e3b22550f40fd709c551c46261f77497aef WatchSource:0}: Error finding container 5d0ae0d47f854da91cbad213c8d15e3b22550f40fd709c551c46261f77497aef: Status 404 returned error can't find the container with id 5d0ae0d47f854da91cbad213c8d15e3b22550f40fd709c551c46261f77497aef
Jul 15 23:55:25.592868 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.592834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcbf47454-zwzfd" event={"ID":"2a29b6fb-27e1-4013-bf84-7929c87af931","Type":"ContainerStarted","Data":"515ac82caacb7d37d1864cb202defab68d7fd41e32ff82582b42c5f502888474"}
Jul 15 23:55:25.594006 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:25.593983    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp" event={"ID":"6bdf3282-db46-4bba-89ba-ae973283aa47","Type":"ContainerStarted","Data":"5d0ae0d47f854da91cbad213c8d15e3b22550f40fd709c551c46261f77497aef"}
Jul 15 23:55:28.614745 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:28.614696    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp" event={"ID":"6bdf3282-db46-4bba-89ba-ae973283aa47","Type":"ContainerStarted","Data":"1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11"}
Jul 15 23:55:28.615176 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:28.614778    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:28.616303 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:28.616281    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcbf47454-zwzfd" event={"ID":"2a29b6fb-27e1-4013-bf84-7929c87af931","Type":"ContainerStarted","Data":"45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f"}
Jul 15 23:55:28.616393 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:28.616319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:28.630882 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:28.630838    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp" podStartSLOduration=2.021405428 podStartE2EDuration="4.630824993s" totalImagesPullingTime="2.609419565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:55:28.629331786 +0000 UTC m=+488.895929399" watchObservedRunningTime="2026-07-15 23:55:28.630824993 +0000 UTC m=+488.897422607"
Jul 15 23:55:28.646962 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:28.646913    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fcbf47454-zwzfd" podStartSLOduration=2.025565093 podStartE2EDuration="4.646894595s" totalImagesPullingTime="2.621329502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:55:28.644860569 +0000 UTC m=+488.911458184" watchObservedRunningTime="2026-07-15 23:55:28.646894595 +0000 UTC m=+488.913492210"
Jul 15 23:55:39.624588 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:39.624558    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 15 23:55:39.625057 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:39.624649    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:39.683111 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:39.683064    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fcbf47454-zwzfd"]
Jul 15 23:55:39.683304 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:39.683268    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fcbf47454-zwzfd" podUID="2a29b6fb-27e1-4013-bf84-7929c87af931" containerName="manager" containerID="cri-o://45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f" gracePeriod=30
Jul 15 23:55:39.935687 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:39.935660    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:40.003846 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.003815    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a29b6fb-27e1-4013-bf84-7929c87af931-webhook-cert\") pod \"2a29b6fb-27e1-4013-bf84-7929c87af931\" (UID: \"2a29b6fb-27e1-4013-bf84-7929c87af931\") "
Jul 15 23:55:40.004014 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.003932    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f5ls\" (UniqueName: \"kubernetes.io/projected/2a29b6fb-27e1-4013-bf84-7929c87af931-kube-api-access-6f5ls\") pod \"2a29b6fb-27e1-4013-bf84-7929c87af931\" (UID: \"2a29b6fb-27e1-4013-bf84-7929c87af931\") "
Jul 15 23:55:40.006009 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.005981    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a29b6fb-27e1-4013-bf84-7929c87af931-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2a29b6fb-27e1-4013-bf84-7929c87af931" (UID: "2a29b6fb-27e1-4013-bf84-7929c87af931"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:55:40.006116 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.006031    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a29b6fb-27e1-4013-bf84-7929c87af931-kube-api-access-6f5ls" (OuterVolumeSpecName: "kube-api-access-6f5ls") pod "2a29b6fb-27e1-4013-bf84-7929c87af931" (UID: "2a29b6fb-27e1-4013-bf84-7929c87af931"). InnerVolumeSpecName "kube-api-access-6f5ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:55:40.104700 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.104659    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f5ls\" (UniqueName: \"kubernetes.io/projected/2a29b6fb-27e1-4013-bf84-7929c87af931-kube-api-access-6f5ls\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:55:40.104700 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.104692    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a29b6fb-27e1-4013-bf84-7929c87af931-webhook-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 15 23:55:40.681448 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.681412    2576 generic.go:356] "Generic (PLEG): container finished" podID="2a29b6fb-27e1-4013-bf84-7929c87af931" containerID="45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f" exitCode=0
Jul 15 23:55:40.681908 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.681461    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcbf47454-zwzfd" event={"ID":"2a29b6fb-27e1-4013-bf84-7929c87af931","Type":"ContainerDied","Data":"45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f"}
Jul 15 23:55:40.681908 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.681470    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcbf47454-zwzfd"
Jul 15 23:55:40.681908 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.681497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcbf47454-zwzfd" event={"ID":"2a29b6fb-27e1-4013-bf84-7929c87af931","Type":"ContainerDied","Data":"515ac82caacb7d37d1864cb202defab68d7fd41e32ff82582b42c5f502888474"}
Jul 15 23:55:40.681908 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.681518    2576 scope.go:117] "RemoveContainer" containerID="45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f"
Jul 15 23:55:40.690298 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.690119    2576 scope.go:117] "RemoveContainer" containerID="45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f"
Jul 15 23:55:40.690399 ip-10-0-140-110 kubenswrapper[2576]: E0715 23:55:40.690378    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f\": container with ID starting with 45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f not found: ID does not exist" containerID="45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f"
Jul 15 23:55:40.690442 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.690407    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f"} err="failed to get container status \"45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f\": rpc error: code = NotFound desc = could not find container \"45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f\": container with ID starting with 45d054f00bd65fa3b27c11d9e0d182a439da02c02a5a56c4a68e2d83b7ff175f not found: ID does not exist"
Jul 15 23:55:40.698550 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.698525    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fcbf47454-zwzfd"]
Jul 15 23:55:40.702072 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:40.702051    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fcbf47454-zwzfd"]
Jul 15 23:55:42.188096 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:42.188065    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a29b6fb-27e1-4013-bf84-7929c87af931" path="/var/lib/kubelet/pods/2a29b6fb-27e1-4013-bf84-7929c87af931/volumes"
Jul 15 23:55:59.569570 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.569528    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"]
Jul 15 23:55:59.570158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.570110    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a29b6fb-27e1-4013-bf84-7929c87af931" containerName="manager"
Jul 15 23:55:59.570158 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.570131    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a29b6fb-27e1-4013-bf84-7929c87af931" containerName="manager"
Jul 15 23:55:59.570279 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.570239    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a29b6fb-27e1-4013-bf84-7929c87af931" containerName="manager"
Jul 15 23:55:59.573506 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.573487    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.575762 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.575742    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 23:55:59.575935 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.575918    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hcmct\""
Jul 15 23:55:59.583165 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.583146    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"]
Jul 15 23:55:59.674536 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.674498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7311baa8-d674-4aab-a357-6290cacbe5b7-maas-api-tls\") pod \"maas-api-689b9d8676-6jnqt\" (UID: \"7311baa8-d674-4aab-a357-6290cacbe5b7\") " pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.674715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.674554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5dr6\" (UniqueName: \"kubernetes.io/projected/7311baa8-d674-4aab-a357-6290cacbe5b7-kube-api-access-w5dr6\") pod \"maas-api-689b9d8676-6jnqt\" (UID: \"7311baa8-d674-4aab-a357-6290cacbe5b7\") " pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.674715 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.674631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7311baa8-d674-4aab-a357-6290cacbe5b7-openshift-service-ca\") pod \"maas-api-689b9d8676-6jnqt\" (UID: \"7311baa8-d674-4aab-a357-6290cacbe5b7\") " pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.775852 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.775823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7311baa8-d674-4aab-a357-6290cacbe5b7-maas-api-tls\") pod \"maas-api-689b9d8676-6jnqt\" (UID: \"7311baa8-d674-4aab-a357-6290cacbe5b7\") " pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.776045 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.775882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dr6\" (UniqueName: \"kubernetes.io/projected/7311baa8-d674-4aab-a357-6290cacbe5b7-kube-api-access-w5dr6\") pod \"maas-api-689b9d8676-6jnqt\" (UID: \"7311baa8-d674-4aab-a357-6290cacbe5b7\") " pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.776045 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.775928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7311baa8-d674-4aab-a357-6290cacbe5b7-openshift-service-ca\") pod \"maas-api-689b9d8676-6jnqt\" (UID: \"7311baa8-d674-4aab-a357-6290cacbe5b7\") " pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.776930 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.776903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7311baa8-d674-4aab-a357-6290cacbe5b7-openshift-service-ca\") pod \"maas-api-689b9d8676-6jnqt\" (UID: \"7311baa8-d674-4aab-a357-6290cacbe5b7\") " pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.778766 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.778738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7311baa8-d674-4aab-a357-6290cacbe5b7-maas-api-tls\") pod \"maas-api-689b9d8676-6jnqt\" (UID: \"7311baa8-d674-4aab-a357-6290cacbe5b7\") " pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.791292 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.791269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5dr6\" (UniqueName: \"kubernetes.io/projected/7311baa8-d674-4aab-a357-6290cacbe5b7-kube-api-access-w5dr6\") pod \"maas-api-689b9d8676-6jnqt\" (UID: \"7311baa8-d674-4aab-a357-6290cacbe5b7\") " pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:55:59.886312 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:55:59.886280    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:56:00.041452 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.041421    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"]
Jul 15 23:56:00.042414 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:56:00.042388    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7311baa8_d674_4aab_a357_6290cacbe5b7.slice/crio-34094ebe7004bfca0045f0626fbc6e0842350b78f486f85c0dc4e246aab8e94a WatchSource:0}: Error finding container 34094ebe7004bfca0045f0626fbc6e0842350b78f486f85c0dc4e246aab8e94a: Status 404 returned error can't find the container with id 34094ebe7004bfca0045f0626fbc6e0842350b78f486f85c0dc4e246aab8e94a
Jul 15 23:56:00.059142 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.059108    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"]
Jul 15 23:56:00.063759 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.063737    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:00.066069 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.066049    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 23:56:00.066204 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.066049    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bvbbb\""
Jul 15 23:56:00.072546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.072516    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"]
Jul 15 23:56:00.077440 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.077413    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"]
Jul 15 23:56:00.081007 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.080952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:00.092416 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.092380    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"]
Jul 15 23:56:00.178276 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.178181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2g4v\" (UniqueName: \"kubernetes.io/projected/94db9a76-6a8c-4d36-bf6d-73060af86981-kube-api-access-d2g4v\") pod \"payload-processing-f9b8d9b9b-x2c2v\" (UID: \"94db9a76-6a8c-4d36-bf6d-73060af86981\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:00.178276 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.178230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94db9a76-6a8c-4d36-bf6d-73060af86981-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-x2c2v\" (UID: \"94db9a76-6a8c-4d36-bf6d-73060af86981\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:00.178515 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.178337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8vwq\" (UniqueName: \"kubernetes.io/projected/d7718a10-e241-452b-9b1a-375301e9c29a-kube-api-access-j8vwq\") pod \"payload-pre-processing-74584bb9f8-5mplf\" (UID: \"d7718a10-e241-452b-9b1a-375301e9c29a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:00.178515 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.178407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7718a10-e241-452b-9b1a-375301e9c29a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-5mplf\" (UID: \"d7718a10-e241-452b-9b1a-375301e9c29a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:00.278931 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.278892    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2g4v\" (UniqueName: \"kubernetes.io/projected/94db9a76-6a8c-4d36-bf6d-73060af86981-kube-api-access-d2g4v\") pod \"payload-processing-f9b8d9b9b-x2c2v\" (UID: \"94db9a76-6a8c-4d36-bf6d-73060af86981\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:00.278931 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.278932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94db9a76-6a8c-4d36-bf6d-73060af86981-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-x2c2v\" (UID: \"94db9a76-6a8c-4d36-bf6d-73060af86981\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:00.279123 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.278962    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8vwq\" (UniqueName: \"kubernetes.io/projected/d7718a10-e241-452b-9b1a-375301e9c29a-kube-api-access-j8vwq\") pod \"payload-pre-processing-74584bb9f8-5mplf\" (UID: \"d7718a10-e241-452b-9b1a-375301e9c29a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:00.279123 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.278992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7718a10-e241-452b-9b1a-375301e9c29a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-5mplf\" (UID: \"d7718a10-e241-452b-9b1a-375301e9c29a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:00.279696 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.279676    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94db9a76-6a8c-4d36-bf6d-73060af86981-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-x2c2v\" (UID: \"94db9a76-6a8c-4d36-bf6d-73060af86981\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:00.279742 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.279707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7718a10-e241-452b-9b1a-375301e9c29a-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-5mplf\" (UID: \"d7718a10-e241-452b-9b1a-375301e9c29a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:00.291264 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.291227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8vwq\" (UniqueName: \"kubernetes.io/projected/d7718a10-e241-452b-9b1a-375301e9c29a-kube-api-access-j8vwq\") pod \"payload-pre-processing-74584bb9f8-5mplf\" (UID: \"d7718a10-e241-452b-9b1a-375301e9c29a\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:00.291777 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.291757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2g4v\" (UniqueName: \"kubernetes.io/projected/94db9a76-6a8c-4d36-bf6d-73060af86981-kube-api-access-d2g4v\") pod \"payload-processing-f9b8d9b9b-x2c2v\" (UID: \"94db9a76-6a8c-4d36-bf6d-73060af86981\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:00.375325 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.375294    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:00.394521 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.394494    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:00.528181 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.528145    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"]
Jul 15 23:56:00.531578 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:56:00.531549    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7718a10_e241_452b_9b1a_375301e9c29a.slice/crio-e1faa26c77e4b138f3047029481316aa2529dee550057a078e08d3227e8c91bf WatchSource:0}: Error finding container e1faa26c77e4b138f3047029481316aa2529dee550057a078e08d3227e8c91bf: Status 404 returned error can't find the container with id e1faa26c77e4b138f3047029481316aa2529dee550057a078e08d3227e8c91bf
Jul 15 23:56:00.548387 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.548363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"]
Jul 15 23:56:00.549216 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:56:00.549189    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94db9a76_6a8c_4d36_bf6d_73060af86981.slice/crio-c9eb473c51b773b284ecdae0b84cf2fe17fa3a9bccf9e3a8bbe439e00e323fdd WatchSource:0}: Error finding container c9eb473c51b773b284ecdae0b84cf2fe17fa3a9bccf9e3a8bbe439e00e323fdd: Status 404 returned error can't find the container with id c9eb473c51b773b284ecdae0b84cf2fe17fa3a9bccf9e3a8bbe439e00e323fdd
Jul 15 23:56:00.791166 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.791074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v" event={"ID":"94db9a76-6a8c-4d36-bf6d-73060af86981","Type":"ContainerStarted","Data":"c9eb473c51b773b284ecdae0b84cf2fe17fa3a9bccf9e3a8bbe439e00e323fdd"}
Jul 15 23:56:00.793079 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.793039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt" event={"ID":"7311baa8-d674-4aab-a357-6290cacbe5b7","Type":"ContainerStarted","Data":"34094ebe7004bfca0045f0626fbc6e0842350b78f486f85c0dc4e246aab8e94a"}
Jul 15 23:56:00.794939 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:00.794829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf" event={"ID":"d7718a10-e241-452b-9b1a-375301e9c29a","Type":"ContainerStarted","Data":"e1faa26c77e4b138f3047029481316aa2529dee550057a078e08d3227e8c91bf"}
Jul 15 23:56:02.809068 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:02.809031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt" event={"ID":"7311baa8-d674-4aab-a357-6290cacbe5b7","Type":"ContainerStarted","Data":"fcd84b804379ff1ea31ef771dd8e1ef26dc54460e343e35ea9aaa52ab85fad7f"}
Jul 15 23:56:02.809527 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:02.809145    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:56:02.810565 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:02.810539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf" event={"ID":"d7718a10-e241-452b-9b1a-375301e9c29a","Type":"ContainerStarted","Data":"f2d805d28c76f1766cb147238bc30d82b7ea9b2227d37b3b7f5d2272b287d42e"}
Jul 15 23:56:02.810687 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:02.810634    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:02.811951 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:02.811924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v" event={"ID":"94db9a76-6a8c-4d36-bf6d-73060af86981","Type":"ContainerStarted","Data":"9dd7d12b4829adf39a14105717f8f94878b2b906b381de59660d5604a9287fad"}
Jul 15 23:56:02.812064 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:02.812052    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:02.825903 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:02.825860    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt" podStartSLOduration=1.545413978 podStartE2EDuration="3.82584788s" totalImagesPullingTime="2.280433902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:56:02.823158724 +0000 UTC m=+523.089756339" watchObservedRunningTime="2026-07-15 23:56:02.82584788 +0000 UTC m=+523.092445496"
Jul 15 23:56:02.837969 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:02.837923    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v" podStartSLOduration=1.061776746 podStartE2EDuration="2.837906829s" totalImagesPullingTime="1.776130083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:56:02.837558069 +0000 UTC m=+523.104155686" watchObservedRunningTime="2026-07-15 23:56:02.837906829 +0000 UTC m=+523.104504444"
Jul 15 23:56:07.844374 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:07.844339    2576 generic.go:356] "Generic (PLEG): container finished" podID="6ddcaa21-41ef-41a3-836c-dbda32baa60b" containerID="a27807701846eb439c7fe88e15149427123a7247107e4cc30e06c898d662a550" exitCode=0
Jul 15 23:56:07.844886 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:07.844415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p" event={"ID":"6ddcaa21-41ef-41a3-836c-dbda32baa60b","Type":"ContainerDied","Data":"a27807701846eb439c7fe88e15149427123a7247107e4cc30e06c898d662a550"}
Jul 15 23:56:07.844886 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:07.844813    2576 scope.go:117] "RemoveContainer" containerID="a27807701846eb439c7fe88e15149427123a7247107e4cc30e06c898d662a550"
Jul 15 23:56:07.845880 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:07.845843    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:56:07.845962 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:07.845915    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:56:07.845962 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:07.845947    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 23:56:07.865636 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:07.865574    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf" podStartSLOduration=6.07491336 podStartE2EDuration="7.865556678s" totalImagesPullingTime="1.790643318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:56:02.854309764 +0000 UTC m=+523.120907379" watchObservedRunningTime="2026-07-15 23:56:07.865556678 +0000 UTC m=+528.132154291"
Jul 15 23:56:08.826346 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:08.826317    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-689b9d8676-6jnqt"
Jul 15 23:56:08.856624 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:08.855622    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p" event={"ID":"6ddcaa21-41ef-41a3-836c-dbda32baa60b","Type":"ContainerStarted","Data":"be91eadadd182df74f7abc373f6bc974a11acd862433cd9af9553f2a855167c5"}
Jul 15 23:56:08.905038 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:08.905000    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:56:08.905247 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:08.905224    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mxh2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 15 23:56:08.905327 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:08.905280    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p" podUID="6ddcaa21-41ef-41a3-836c-dbda32baa60b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 15 23:56:09.904593 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:09.904561    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mxh2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 15 23:56:09.904998 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:09.904625    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p" podUID="6ddcaa21-41ef-41a3-836c-dbda32baa60b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 15 23:56:10.905129 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:10.905093    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mxh2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 15 23:56:10.905543 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:10.905145    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p" podUID="6ddcaa21-41ef-41a3-836c-dbda32baa60b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 15 23:56:11.905021 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:11.904925    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mxh2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 15 23:56:11.905021 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:11.904993    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p" podUID="6ddcaa21-41ef-41a3-836c-dbda32baa60b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 15 23:56:12.909022 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:12.908989    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:56:12.909450 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:12.909253    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:56:12.909960 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:12.909943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxh2p"
Jul 15 23:56:13.823497 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:13.823469    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-x2c2v"
Jul 15 23:56:13.823915 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:13.823891    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5mplf"
Jul 15 23:56:24.299210 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.299176    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"]
Jul 15 23:56:24.304545 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.304518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.307398 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.307372    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fsglx\""
Jul 15 23:56:24.307534 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.307377    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 23:56:24.307534 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.307378    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 23:56:24.307716 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.307378    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 23:56:24.311480 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.311430    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"]
Jul 15 23:56:24.402228 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.402196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.402412 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.402239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.402412 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.402267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.402412 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.402339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.402412 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.402384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml7j2\" (UniqueName: \"kubernetes.io/projected/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-kube-api-access-ml7j2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.402412 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.402404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.503130 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.503077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.503130 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.503126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.503395 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.503152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.503395 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.503206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.503395 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.503257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml7j2\" (UniqueName: \"kubernetes.io/projected/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-kube-api-access-ml7j2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.503395 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.503278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.503631 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.503526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.503631 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.503581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.503752 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.503633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.505539 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.505513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.506111 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.506091    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.510062 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.510041    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml7j2\" (UniqueName: \"kubernetes.io/projected/cc948fbd-b3b3-45ce-9fd7-13b9848121fb-kube-api-access-ml7j2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst\" (UID: \"cc948fbd-b3b3-45ce-9fd7-13b9848121fb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.619191 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.619106    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:24.758189 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.758097    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"]
Jul 15 23:56:24.760261 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:56:24.760235    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc948fbd_b3b3_45ce_9fd7_13b9848121fb.slice/crio-48db92e9a301ca7edfaec056d147c7da55f989c8bbc513c16484aa250120403f WatchSource:0}: Error finding container 48db92e9a301ca7edfaec056d147c7da55f989c8bbc513c16484aa250120403f: Status 404 returned error can't find the container with id 48db92e9a301ca7edfaec056d147c7da55f989c8bbc513c16484aa250120403f
Jul 15 23:56:24.961277 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:24.961234    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst" event={"ID":"cc948fbd-b3b3-45ce-9fd7-13b9848121fb","Type":"ContainerStarted","Data":"48db92e9a301ca7edfaec056d147c7da55f989c8bbc513c16484aa250120403f"}
Jul 15 23:56:26.974377 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:26.974344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst" event={"ID":"cc948fbd-b3b3-45ce-9fd7-13b9848121fb","Type":"ContainerStarted","Data":"cf08077ef090e9122149f7be006d06afb0fb5de0043e0231b18b5ca7eec9e2cb"}
Jul 15 23:56:26.991923 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:26.991872    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst" podStartSLOduration=1.8022535610000001 podStartE2EDuration="2.991855935s" totalImagesPullingTime="1.189602374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:56:26.989108936 +0000 UTC m=+547.255706550" watchObservedRunningTime="2026-07-15 23:56:26.991855935 +0000 UTC m=+547.258453548"
Jul 15 23:56:28.700861 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.700825    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"]
Jul 15 23:56:28.704726 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.704702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.706787 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.706766    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 23:56:28.713730 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.713710    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"]
Jul 15 23:56:28.741968 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.741944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b517b1c1-9926-46f8-93fa-51c3e6aa763f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.742093 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.742001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.742093 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.742083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx6wq\" (UniqueName: \"kubernetes.io/projected/b517b1c1-9926-46f8-93fa-51c3e6aa763f-kube-api-access-lx6wq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.742188 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.742142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.742188 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.742174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.742264 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.742210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.843355 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.843316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b517b1c1-9926-46f8-93fa-51c3e6aa763f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.843524 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.843481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.843638 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.843616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx6wq\" (UniqueName: \"kubernetes.io/projected/b517b1c1-9926-46f8-93fa-51c3e6aa763f-kube-api-access-lx6wq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.843785 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.843672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.843785 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.843714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.843896 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.843747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.843958 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.843892    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.844108 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.844069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.844397 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.844365    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.845899 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.845870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b517b1c1-9926-46f8-93fa-51c3e6aa763f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.845995 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.845878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b517b1c1-9926-46f8-93fa-51c3e6aa763f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:28.851140 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:28.851117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx6wq\" (UniqueName: \"kubernetes.io/projected/b517b1c1-9926-46f8-93fa-51c3e6aa763f-kube-api-access-lx6wq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pjbd6\" (UID: \"b517b1c1-9926-46f8-93fa-51c3e6aa763f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:29.014786 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:29.014702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:29.149928 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:29.149900    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"]
Jul 15 23:56:29.151133 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:56:29.151093    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb517b1c1_9926_46f8_93fa_51c3e6aa763f.slice/crio-ad458be2cae6d8868306642b17cd0fcabd4e5468b7a1ab19cda2ec0a7ac86603 WatchSource:0}: Error finding container ad458be2cae6d8868306642b17cd0fcabd4e5468b7a1ab19cda2ec0a7ac86603: Status 404 returned error can't find the container with id ad458be2cae6d8868306642b17cd0fcabd4e5468b7a1ab19cda2ec0a7ac86603
Jul 15 23:56:29.992767 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:29.992728    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6" event={"ID":"b517b1c1-9926-46f8-93fa-51c3e6aa763f","Type":"ContainerStarted","Data":"5c964fe090b91e1a526260dd8795895e1c418698602a5b97ce60b22d762c3c3c"}
Jul 15 23:56:29.993202 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:29.992789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6" event={"ID":"b517b1c1-9926-46f8-93fa-51c3e6aa763f","Type":"ContainerStarted","Data":"ad458be2cae6d8868306642b17cd0fcabd4e5468b7a1ab19cda2ec0a7ac86603"}
Jul 15 23:56:30.010435 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:30.010384    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6" podStartSLOduration=1.82699374 podStartE2EDuration="2.010369155s" totalImagesPullingTime="183.375415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:56:30.007336309 +0000 UTC m=+550.273933922" watchObservedRunningTime="2026-07-15 23:56:30.010369155 +0000 UTC m=+550.276966766"
Jul 15 23:56:34.619348 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:34.619314    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:34.619767 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:34.619379    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:34.632141 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:34.632115    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:35.031708 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:35.031678    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst"
Jul 15 23:56:39.014853 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:39.014815    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:39.015312 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:39.014895    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:39.027334 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:39.027305    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:39.053420 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:39.053394    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pjbd6"
Jul 15 23:56:55.302481 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.302450    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"]
Jul 15 23:56:55.305995 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.305957    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.308259 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.308236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 23:56:55.315289 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.315263    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"]
Jul 15 23:56:55.377040 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.377006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ae3c91-7994-45dd-80b3-157d7346321b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.377211 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.377052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.377211 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.377069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.377211 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.377105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.377211 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.377142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.377355 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.377234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87hhk\" (UniqueName: \"kubernetes.io/projected/30ae3c91-7994-45dd-80b3-157d7346321b-kube-api-access-87hhk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.478281 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.478241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.478447 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.478295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87hhk\" (UniqueName: \"kubernetes.io/projected/30ae3c91-7994-45dd-80b3-157d7346321b-kube-api-access-87hhk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.478447 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.478372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ae3c91-7994-45dd-80b3-157d7346321b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.478447 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.478418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.478447 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.478439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.478776 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.478464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.478840 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.478826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.478894 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.478850    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.479000 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.478979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.480642 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.480621    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30ae3c91-7994-45dd-80b3-157d7346321b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.480989 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.480964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ae3c91-7994-45dd-80b3-157d7346321b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.485634 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.485611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87hhk\" (UniqueName: \"kubernetes.io/projected/30ae3c91-7994-45dd-80b3-157d7346321b-kube-api-access-87hhk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pgcwb\" (UID: \"30ae3c91-7994-45dd-80b3-157d7346321b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.618687 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.618563    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:56:55.754832 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:55.754804    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"]
Jul 15 23:56:55.756495 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:56:55.756469    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ae3c91_7994_45dd_80b3_157d7346321b.slice/crio-7b93e984e41156f7d30fc0ad6775e6d2a67ec9f39df11bbc4bb8fafcb183a028 WatchSource:0}: Error finding container 7b93e984e41156f7d30fc0ad6775e6d2a67ec9f39df11bbc4bb8fafcb183a028: Status 404 returned error can't find the container with id 7b93e984e41156f7d30fc0ad6775e6d2a67ec9f39df11bbc4bb8fafcb183a028
Jul 15 23:56:56.134385 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:56.134347    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb" event={"ID":"30ae3c91-7994-45dd-80b3-157d7346321b","Type":"ContainerStarted","Data":"63f28663b450f57878be65d7a841004f63fde4fa562aba5eb1eedf0bc9b4f7c1"}
Jul 15 23:56:56.134592 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:56.134403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb" event={"ID":"30ae3c91-7994-45dd-80b3-157d7346321b","Type":"ContainerStarted","Data":"7b93e984e41156f7d30fc0ad6775e6d2a67ec9f39df11bbc4bb8fafcb183a028"}
Jul 15 23:56:56.150944 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:56:56.150896    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb" podStartSLOduration=0.9617292 podStartE2EDuration="1.150880127s" totalImagesPullingTime="189.150927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:56:56.149106762 +0000 UTC m=+576.415704375" watchObservedRunningTime="2026-07-15 23:56:56.150880127 +0000 UTC m=+576.417477740"
Jul 15 23:57:05.619496 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:05.619458    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:57:05.619936 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:05.619538    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:57:05.632057 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:05.632035    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:57:06.201556 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:06.201525    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pgcwb"
Jul 15 23:57:20.073661 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:20.073635    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 15 23:57:20.075476 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:20.075449    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 15 23:57:30.207584 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.207545    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"]
Jul 15 23:57:30.211546 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.211523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.213716 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.213695    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 23:57:30.219105 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.219088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"]
Jul 15 23:57:30.293286 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.293236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.293483 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.293291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.293483 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.293422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnqc5\" (UniqueName: \"kubernetes.io/projected/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-kube-api-access-hnqc5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.293667 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.293522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.293667 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.293552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.293667 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.293593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.394774 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.394741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.394979 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.394780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.394979 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.394813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.394979 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.394895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.394979 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.394930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.394979 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.394962    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnqc5\" (UniqueName: \"kubernetes.io/projected/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-kube-api-access-hnqc5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.395268 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.395227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.395342 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.395291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.395686 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.395661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.397357 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.397334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.397472 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.397450    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.401847 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.401825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnqc5\" (UniqueName: \"kubernetes.io/projected/ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc-kube-api-access-hnqc5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jjfkc\" (UID: \"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.522291 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.522197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:30.658851 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.658823    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"]
Jul 15 23:57:30.660243 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:57:30.660217    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd60ae6_f9bd_4f0d_b38e_667493f8c3fc.slice/crio-099f818c407331ae60a033277b58eccf3ecf162477b055251dc21499e1e74b3f WatchSource:0}: Error finding container 099f818c407331ae60a033277b58eccf3ecf162477b055251dc21499e1e74b3f: Status 404 returned error can't find the container with id 099f818c407331ae60a033277b58eccf3ecf162477b055251dc21499e1e74b3f
Jul 15 23:57:30.661672 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:30.661654    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:57:31.334808 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:31.334770    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc" event={"ID":"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc","Type":"ContainerStarted","Data":"35a09892ae10a3dcc952e307215f2c5d9f57274d635a7900568415559f791d92"}
Jul 15 23:57:31.335212 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:31.334860    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc" event={"ID":"ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc","Type":"ContainerStarted","Data":"099f818c407331ae60a033277b58eccf3ecf162477b055251dc21499e1e74b3f"}
Jul 15 23:57:31.350391 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:31.350330    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc" podStartSLOduration=1.187194651 podStartE2EDuration="1.350291712s" totalImagesPullingTime="163.097061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:57:31.349973979 +0000 UTC m=+611.616571606" watchObservedRunningTime="2026-07-15 23:57:31.350291712 +0000 UTC m=+611.616889329"
Jul 15 23:57:40.522951 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:40.522912    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:40.523412 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:40.522967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:40.535842 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:40.535814    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:57:41.403643 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:57:41.403615    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jjfkc"
Jul 15 23:59:03.916249 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:03.916210    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58f9d87bcb-f5xvh"]
Jul 15 23:59:03.920028 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:03.920005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f9d87bcb-f5xvh"
Jul 15 23:59:03.922778 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:03.922760    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-59bdj\""
Jul 15 23:59:03.922892 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:03.922760    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 23:59:03.929281 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:03.929260    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f9d87bcb-f5xvh"]
Jul 15 23:59:04.070571 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.070537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t4fb\" (UniqueName: \"kubernetes.io/projected/adcdd6d6-2cd2-4551-b766-64c1ecd93fb1-kube-api-access-5t4fb\") pod \"authorino-58f9d87bcb-f5xvh\" (UID: \"adcdd6d6-2cd2-4551-b766-64c1ecd93fb1\") " pod="kuadrant-system/authorino-58f9d87bcb-f5xvh"
Jul 15 23:59:04.070778 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.070586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/adcdd6d6-2cd2-4551-b766-64c1ecd93fb1-tls-cert\") pod \"authorino-58f9d87bcb-f5xvh\" (UID: \"adcdd6d6-2cd2-4551-b766-64c1ecd93fb1\") " pod="kuadrant-system/authorino-58f9d87bcb-f5xvh"
Jul 15 23:59:04.171929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.171844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t4fb\" (UniqueName: \"kubernetes.io/projected/adcdd6d6-2cd2-4551-b766-64c1ecd93fb1-kube-api-access-5t4fb\") pod \"authorino-58f9d87bcb-f5xvh\" (UID: \"adcdd6d6-2cd2-4551-b766-64c1ecd93fb1\") " pod="kuadrant-system/authorino-58f9d87bcb-f5xvh"
Jul 15 23:59:04.171929 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.171896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/adcdd6d6-2cd2-4551-b766-64c1ecd93fb1-tls-cert\") pod \"authorino-58f9d87bcb-f5xvh\" (UID: \"adcdd6d6-2cd2-4551-b766-64c1ecd93fb1\") " pod="kuadrant-system/authorino-58f9d87bcb-f5xvh"
Jul 15 23:59:04.174322 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.174302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/adcdd6d6-2cd2-4551-b766-64c1ecd93fb1-tls-cert\") pod \"authorino-58f9d87bcb-f5xvh\" (UID: \"adcdd6d6-2cd2-4551-b766-64c1ecd93fb1\") " pod="kuadrant-system/authorino-58f9d87bcb-f5xvh"
Jul 15 23:59:04.182182 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.182158    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t4fb\" (UniqueName: \"kubernetes.io/projected/adcdd6d6-2cd2-4551-b766-64c1ecd93fb1-kube-api-access-5t4fb\") pod \"authorino-58f9d87bcb-f5xvh\" (UID: \"adcdd6d6-2cd2-4551-b766-64c1ecd93fb1\") " pod="kuadrant-system/authorino-58f9d87bcb-f5xvh"
Jul 15 23:59:04.230080 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.230052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f9d87bcb-f5xvh"
Jul 15 23:59:04.368112 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.368084    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f9d87bcb-f5xvh"]
Jul 15 23:59:04.370683 ip-10-0-140-110 kubenswrapper[2576]: W0715 23:59:04.370655    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadcdd6d6_2cd2_4551_b766_64c1ecd93fb1.slice/crio-b2cb26ec7b12e8a27bfdaab186ced9ab7e98f14288167428c998d7ac2b284b1e WatchSource:0}: Error finding container b2cb26ec7b12e8a27bfdaab186ced9ab7e98f14288167428c998d7ac2b284b1e: Status 404 returned error can't find the container with id b2cb26ec7b12e8a27bfdaab186ced9ab7e98f14288167428c998d7ac2b284b1e
Jul 15 23:59:04.861860 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.861823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f9d87bcb-f5xvh" event={"ID":"adcdd6d6-2cd2-4551-b766-64c1ecd93fb1","Type":"ContainerStarted","Data":"3a9e3c4b1973c566927fb6afb487f275bd1090df55af3833387141618f6739e2"}
Jul 15 23:59:04.862010 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.861872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f9d87bcb-f5xvh" event={"ID":"adcdd6d6-2cd2-4551-b766-64c1ecd93fb1","Type":"ContainerStarted","Data":"b2cb26ec7b12e8a27bfdaab186ced9ab7e98f14288167428c998d7ac2b284b1e"}
Jul 15 23:59:04.876283 ip-10-0-140-110 kubenswrapper[2576]: I0715 23:59:04.876237    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58f9d87bcb-f5xvh" podStartSLOduration=1.47316129 podStartE2EDuration="1.876219272s" totalImagesPullingTime="403.057982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:59:04.874390535 +0000 UTC m=+705.140988151" watchObservedRunningTime="2026-07-15 23:59:04.876219272 +0000 UTC m=+705.142816921"
Jul 16 00:00:16.622526 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:16.622484    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67c79c5bd5-x8vsp"]
Jul 16 00:00:16.623077 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:16.622687    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp" podUID="6bdf3282-db46-4bba-89ba-ae973283aa47" containerName="manager" containerID="cri-o://1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11" gracePeriod=30
Jul 16 00:00:16.879679 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:16.879595    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 16 00:00:16.960807 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:16.960775    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd6g7\" (UniqueName: \"kubernetes.io/projected/6bdf3282-db46-4bba-89ba-ae973283aa47-kube-api-access-jd6g7\") pod \"6bdf3282-db46-4bba-89ba-ae973283aa47\" (UID: \"6bdf3282-db46-4bba-89ba-ae973283aa47\") "
Jul 16 00:00:16.960972 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:16.960818    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bdf3282-db46-4bba-89ba-ae973283aa47-webhook-cert\") pod \"6bdf3282-db46-4bba-89ba-ae973283aa47\" (UID: \"6bdf3282-db46-4bba-89ba-ae973283aa47\") "
Jul 16 00:00:16.962864 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:16.962834    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bdf3282-db46-4bba-89ba-ae973283aa47-kube-api-access-jd6g7" (OuterVolumeSpecName: "kube-api-access-jd6g7") pod "6bdf3282-db46-4bba-89ba-ae973283aa47" (UID: "6bdf3282-db46-4bba-89ba-ae973283aa47"). InnerVolumeSpecName "kube-api-access-jd6g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:00:16.962993 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:16.962909    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bdf3282-db46-4bba-89ba-ae973283aa47-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6bdf3282-db46-4bba-89ba-ae973283aa47" (UID: "6bdf3282-db46-4bba-89ba-ae973283aa47"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:00:17.062362 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.062323    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd6g7\" (UniqueName: \"kubernetes.io/projected/6bdf3282-db46-4bba-89ba-ae973283aa47-kube-api-access-jd6g7\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:00:17.062362 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.062354    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bdf3282-db46-4bba-89ba-ae973283aa47-webhook-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:00:17.280398 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.280364    2576 generic.go:356] "Generic (PLEG): container finished" podID="6bdf3282-db46-4bba-89ba-ae973283aa47" containerID="1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11" exitCode=0
Jul 16 00:00:17.280594 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.280421    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp"
Jul 16 00:00:17.280594 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.280421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp" event={"ID":"6bdf3282-db46-4bba-89ba-ae973283aa47","Type":"ContainerDied","Data":"1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11"}
Jul 16 00:00:17.280594 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.280488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c79c5bd5-x8vsp" event={"ID":"6bdf3282-db46-4bba-89ba-ae973283aa47","Type":"ContainerDied","Data":"5d0ae0d47f854da91cbad213c8d15e3b22550f40fd709c551c46261f77497aef"}
Jul 16 00:00:17.280594 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.280519    2576 scope.go:117] "RemoveContainer" containerID="1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11"
Jul 16 00:00:17.290005 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.289983    2576 scope.go:117] "RemoveContainer" containerID="1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11"
Jul 16 00:00:17.290270 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:00:17.290248    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11\": container with ID starting with 1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11 not found: ID does not exist" containerID="1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11"
Jul 16 00:00:17.290317 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.290279    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11"} err="failed to get container status \"1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11\": rpc error: code = NotFound desc = could not find container \"1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11\": container with ID starting with 1480cab03acdb7df89d1bb029ed88fdc99c873b991bbdc7fc4d6c6c975f86f11 not found: ID does not exist"
Jul 16 00:00:17.300921 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.300897    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67c79c5bd5-x8vsp"]
Jul 16 00:00:17.304316 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:17.304295    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67c79c5bd5-x8vsp"]
Jul 16 00:00:18.023047 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.022998    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67c79c5bd5-6vptz"]
Jul 16 00:00:18.023669 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.023650    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bdf3282-db46-4bba-89ba-ae973283aa47" containerName="manager"
Jul 16 00:00:18.023732 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.023671    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bdf3282-db46-4bba-89ba-ae973283aa47" containerName="manager"
Jul 16 00:00:18.023777 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.023768    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bdf3282-db46-4bba-89ba-ae973283aa47" containerName="manager"
Jul 16 00:00:18.028137 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.028121    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:00:18.030786 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.030764    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 00:00:18.030786 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.030778    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g997x\""
Jul 16 00:00:18.030983 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.030815    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 00:00:18.034775 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.034751    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67c79c5bd5-6vptz"]
Jul 16 00:00:18.069823 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.069794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c8hq\" (UniqueName: \"kubernetes.io/projected/1422ba92-d912-4dbe-ae7b-05eb706d3043-kube-api-access-8c8hq\") pod \"maas-controller-67c79c5bd5-6vptz\" (UID: \"1422ba92-d912-4dbe-ae7b-05eb706d3043\") " pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:00:18.069990 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.069839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1422ba92-d912-4dbe-ae7b-05eb706d3043-webhook-cert\") pod \"maas-controller-67c79c5bd5-6vptz\" (UID: \"1422ba92-d912-4dbe-ae7b-05eb706d3043\") " pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:00:18.171163 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.171129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c8hq\" (UniqueName: \"kubernetes.io/projected/1422ba92-d912-4dbe-ae7b-05eb706d3043-kube-api-access-8c8hq\") pod \"maas-controller-67c79c5bd5-6vptz\" (UID: \"1422ba92-d912-4dbe-ae7b-05eb706d3043\") " pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:00:18.171333 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.171178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1422ba92-d912-4dbe-ae7b-05eb706d3043-webhook-cert\") pod \"maas-controller-67c79c5bd5-6vptz\" (UID: \"1422ba92-d912-4dbe-ae7b-05eb706d3043\") " pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:00:18.173542 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.173511    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1422ba92-d912-4dbe-ae7b-05eb706d3043-webhook-cert\") pod \"maas-controller-67c79c5bd5-6vptz\" (UID: \"1422ba92-d912-4dbe-ae7b-05eb706d3043\") " pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:00:18.178441 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.178418    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c8hq\" (UniqueName: \"kubernetes.io/projected/1422ba92-d912-4dbe-ae7b-05eb706d3043-kube-api-access-8c8hq\") pod \"maas-controller-67c79c5bd5-6vptz\" (UID: \"1422ba92-d912-4dbe-ae7b-05eb706d3043\") " pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:00:18.189316 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.189281    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bdf3282-db46-4bba-89ba-ae973283aa47" path="/var/lib/kubelet/pods/6bdf3282-db46-4bba-89ba-ae973283aa47/volumes"
Jul 16 00:00:18.340179 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.340100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:00:18.484558 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:18.484536    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67c79c5bd5-6vptz"]
Jul 16 00:00:18.486478 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:00:18.486452    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1422ba92_d912_4dbe_ae7b_05eb706d3043.slice/crio-26a17eeed89206e9c6c6e1f642831c5027a72cc6c091e4548fcf9a1f8a7045cc WatchSource:0}: Error finding container 26a17eeed89206e9c6c6e1f642831c5027a72cc6c091e4548fcf9a1f8a7045cc: Status 404 returned error can't find the container with id 26a17eeed89206e9c6c6e1f642831c5027a72cc6c091e4548fcf9a1f8a7045cc
Jul 16 00:00:19.293269 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:19.293238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c79c5bd5-6vptz" event={"ID":"1422ba92-d912-4dbe-ae7b-05eb706d3043","Type":"ContainerStarted","Data":"26a17eeed89206e9c6c6e1f642831c5027a72cc6c091e4548fcf9a1f8a7045cc"}
Jul 16 00:00:20.299683 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:20.299647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c79c5bd5-6vptz" event={"ID":"1422ba92-d912-4dbe-ae7b-05eb706d3043","Type":"ContainerStarted","Data":"e9015b43f77cd1d1f6f7cfd1aeb8ffd087a982d94c5537cbe45acde6c02cba52"}
Jul 16 00:00:20.300093 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:20.299728    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:00:20.316433 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:20.316384    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67c79c5bd5-6vptz" podStartSLOduration=1.5564605519999999 podStartE2EDuration="2.316370562s" totalImagesPullingTime="759.91001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:00:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:00:20.314932141 +0000 UTC m=+780.581529755" watchObservedRunningTime="2026-07-16 00:00:20.316370562 +0000 UTC m=+780.582968175"
Jul 16 00:00:31.307948 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:00:31.307916    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67c79c5bd5-6vptz"
Jul 16 00:02:20.110273 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:02:20.110191    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:02:20.113612 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:02:20.113574    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:05:09.206956 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:09.206920    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"]
Jul 16 00:05:09.207520 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:09.207183    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9" podUID="ae277b41-54e2-4d56-8ec4-ef0fad11131b" containerName="manager" containerID="cri-o://4dcc487d5fa95a14031fdd2e9d2f9d93fe7ca28e80d6a303fa1e490ef93ef427" gracePeriod=10
Jul 16 00:05:12.962973 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:12.962937    2576 generic.go:356] "Generic (PLEG): container finished" podID="ae277b41-54e2-4d56-8ec4-ef0fad11131b" containerID="4dcc487d5fa95a14031fdd2e9d2f9d93fe7ca28e80d6a303fa1e490ef93ef427" exitCode=0
Jul 16 00:05:12.963321 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:12.963002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9" event={"ID":"ae277b41-54e2-4d56-8ec4-ef0fad11131b","Type":"ContainerDied","Data":"4dcc487d5fa95a14031fdd2e9d2f9d93fe7ca28e80d6a303fa1e490ef93ef427"}
Jul 16 00:05:12.963321 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:12.963056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9" event={"ID":"ae277b41-54e2-4d56-8ec4-ef0fad11131b","Type":"ContainerDied","Data":"c0d642f32ebbae882e5f627fc6bc9b98adb9ecdc82ac84b4d092c15b60217ff9"}
Jul 16 00:05:12.963321 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:12.963075    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0d642f32ebbae882e5f627fc6bc9b98adb9ecdc82ac84b4d092c15b60217ff9"
Jul 16 00:05:12.971148 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:12.971126    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 16 00:05:13.011340 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:13.011243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4554\" (UniqueName: \"kubernetes.io/projected/ae277b41-54e2-4d56-8ec4-ef0fad11131b-kube-api-access-c4554\") pod \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\" (UID: \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\") "
Jul 16 00:05:13.011340 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:13.011307    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae277b41-54e2-4d56-8ec4-ef0fad11131b-extensions-socket-volume\") pod \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\" (UID: \"ae277b41-54e2-4d56-8ec4-ef0fad11131b\") "
Jul 16 00:05:13.011745 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:13.011714    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae277b41-54e2-4d56-8ec4-ef0fad11131b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ae277b41-54e2-4d56-8ec4-ef0fad11131b" (UID: "ae277b41-54e2-4d56-8ec4-ef0fad11131b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:05:13.013478 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:13.013448    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae277b41-54e2-4d56-8ec4-ef0fad11131b-kube-api-access-c4554" (OuterVolumeSpecName: "kube-api-access-c4554") pod "ae277b41-54e2-4d56-8ec4-ef0fad11131b" (UID: "ae277b41-54e2-4d56-8ec4-ef0fad11131b"). InnerVolumeSpecName "kube-api-access-c4554". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:05:13.112246 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:13.112201    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4554\" (UniqueName: \"kubernetes.io/projected/ae277b41-54e2-4d56-8ec4-ef0fad11131b-kube-api-access-c4554\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:05:13.112246 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:13.112234    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae277b41-54e2-4d56-8ec4-ef0fad11131b-extensions-socket-volume\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:05:13.968703 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:13.968672    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"
Jul 16 00:05:13.993147 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:13.993113    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"]
Jul 16 00:05:13.996846 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:13.996823    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8qq9"]
Jul 16 00:05:14.187258 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:14.187221    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae277b41-54e2-4d56-8ec4-ef0fad11131b" path="/var/lib/kubelet/pods/ae277b41-54e2-4d56-8ec4-ef0fad11131b/volumes"
Jul 16 00:05:20.187298 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:05:20.187271    2576 scope.go:117] "RemoveContainer" containerID="4dcc487d5fa95a14031fdd2e9d2f9d93fe7ca28e80d6a303fa1e490ef93ef427"
Jul 16 00:06:10.298031 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.297994    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"]
Jul 16 00:06:10.298495 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.298406    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae277b41-54e2-4d56-8ec4-ef0fad11131b" containerName="manager"
Jul 16 00:06:10.298495 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.298416    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae277b41-54e2-4d56-8ec4-ef0fad11131b" containerName="manager"
Jul 16 00:06:10.298495 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.298479    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae277b41-54e2-4d56-8ec4-ef0fad11131b" containerName="manager"
Jul 16 00:06:10.301735 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.301719    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:06:10.303792 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.303772    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fqwtz\""
Jul 16 00:06:10.311672 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.311651    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"]
Jul 16 00:06:10.439448 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.439416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48jkf\" (UniqueName: \"kubernetes.io/projected/bf91712e-1bd5-4a71-9434-db0256cabe32-kube-api-access-48jkf\") pod \"kuadrant-operator-controller-manager-86878c769f-w4mwh\" (UID: \"bf91712e-1bd5-4a71-9434-db0256cabe32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:06:10.439664 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.439478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf91712e-1bd5-4a71-9434-db0256cabe32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w4mwh\" (UID: \"bf91712e-1bd5-4a71-9434-db0256cabe32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:06:10.541798 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.541760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf91712e-1bd5-4a71-9434-db0256cabe32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w4mwh\" (UID: \"bf91712e-1bd5-4a71-9434-db0256cabe32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:06:10.541971 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.541903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48jkf\" (UniqueName: \"kubernetes.io/projected/bf91712e-1bd5-4a71-9434-db0256cabe32-kube-api-access-48jkf\") pod \"kuadrant-operator-controller-manager-86878c769f-w4mwh\" (UID: \"bf91712e-1bd5-4a71-9434-db0256cabe32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:06:10.542144 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.542121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf91712e-1bd5-4a71-9434-db0256cabe32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w4mwh\" (UID: \"bf91712e-1bd5-4a71-9434-db0256cabe32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:06:10.549573 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.549516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48jkf\" (UniqueName: \"kubernetes.io/projected/bf91712e-1bd5-4a71-9434-db0256cabe32-kube-api-access-48jkf\") pod \"kuadrant-operator-controller-manager-86878c769f-w4mwh\" (UID: \"bf91712e-1bd5-4a71-9434-db0256cabe32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:06:10.612552 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.612511    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:06:10.751514 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:10.751492    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"]
Jul 16 00:06:10.753378 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:06:10.753350    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf91712e_1bd5_4a71_9434_db0256cabe32.slice/crio-c44c80d14687f9bbe56565625d5fd148b11c95115ee44391cbf7ef9d679caafc WatchSource:0}: Error finding container c44c80d14687f9bbe56565625d5fd148b11c95115ee44391cbf7ef9d679caafc: Status 404 returned error can't find the container with id c44c80d14687f9bbe56565625d5fd148b11c95115ee44391cbf7ef9d679caafc
Jul 16 00:06:11.286797 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:11.286756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh" event={"ID":"bf91712e-1bd5-4a71-9434-db0256cabe32","Type":"ContainerStarted","Data":"31e7d9ce89cde0befabc448f14900a86065235b8e20b4f6dac580257293d12a5"}
Jul 16 00:06:11.286981 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:11.286815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh" event={"ID":"bf91712e-1bd5-4a71-9434-db0256cabe32","Type":"ContainerStarted","Data":"c44c80d14687f9bbe56565625d5fd148b11c95115ee44391cbf7ef9d679caafc"}
Jul 16 00:06:11.286981 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:11.286836    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:06:11.304970 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:11.304896    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh" podStartSLOduration=1.3048795499999999 podStartE2EDuration="1.30487955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:06:11.302916741 +0000 UTC m=+1131.569514354" watchObservedRunningTime="2026-07-16 00:06:11.30487955 +0000 UTC m=+1131.571477164"
Jul 16 00:06:22.295055 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:06:22.295020    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w4mwh"
Jul 16 00:07:20.149204 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:07:20.149172    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:07:20.154038 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:07:20.154014    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:12:20.189682 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:12:20.189655    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:12:20.196096 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:12:20.196068    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:13:06.593103 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.593031    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"]
Jul 16 00:13:06.597102 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.597075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.599674 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.599638    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a5fc7f57-openshift-default-dockercfg-77j4h\""
Jul 16 00:13:06.612477 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.612447    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"]
Jul 16 00:13:06.662824 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.662785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-podinfo\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.663028 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.662831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-token\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.663028 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.662923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-certs\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.663028 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.662982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/800d4fa5-17b7-4c73-982d-04c74ded378c-istiod-ca-cert\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.663261 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.663065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-credential-socket\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.663261 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.663138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-data\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.663261 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.663168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-envoy\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.663261 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.663192    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzgwq\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-kube-api-access-fzgwq\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.663261 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.663234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-socket\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.764367 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-podinfo\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.764367 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-token\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.764665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-certs\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.764665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/800d4fa5-17b7-4c73-982d-04c74ded378c-istiod-ca-cert\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.764665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-credential-socket\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.764665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-data\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.764665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-envoy\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.764665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzgwq\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-kube-api-access-fzgwq\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.764665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-socket\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.765031 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.764963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-credential-socket\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.765105 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.765037    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-certs\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.765186 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.765162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-data\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.765251 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.765236    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-socket\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.765309 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.765287    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/800d4fa5-17b7-4c73-982d-04c74ded378c-istiod-ca-cert\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.767014 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.766991    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-envoy\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.767335 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.767315    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-podinfo\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.772307 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.772279    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-token\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.772419 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.772400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzgwq\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-kube-api-access-fzgwq\") pod \"e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") " pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:06.909709 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:06.909674    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:07.050889 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:07.050863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"]
Jul 16 00:13:07.052666 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:13:07.052635    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800d4fa5_17b7_4c73_982d_04c74ded378c.slice/crio-117e5235ed00ae2b5007c9e0cee5f37628a91d1f739226cb7f7ab7fac03f9297 WatchSource:0}: Error finding container 117e5235ed00ae2b5007c9e0cee5f37628a91d1f739226cb7f7ab7fac03f9297: Status 404 returned error can't find the container with id 117e5235ed00ae2b5007c9e0cee5f37628a91d1f739226cb7f7ab7fac03f9297
Jul 16 00:13:07.054797 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:07.054766    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:13:07.054875 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:07.054830    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:13:07.054875 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:07.054860    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:13:07.675494 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:07.675458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2" event={"ID":"800d4fa5-17b7-4c73-982d-04c74ded378c","Type":"ContainerStarted","Data":"00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6"}
Jul 16 00:13:07.675961 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:07.675513    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2" event={"ID":"800d4fa5-17b7-4c73-982d-04c74ded378c","Type":"ContainerStarted","Data":"117e5235ed00ae2b5007c9e0cee5f37628a91d1f739226cb7f7ab7fac03f9297"}
Jul 16 00:13:07.700373 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:07.700325    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2" podStartSLOduration=1.700310979 podStartE2EDuration="1.700310979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:07.697464986 +0000 UTC m=+1547.964062600" watchObservedRunningTime="2026-07-16 00:13:07.700310979 +0000 UTC m=+1547.966908661"
Jul 16 00:13:07.909960 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:07.909932    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:08.916022 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:08.915989    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:09.687669 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:09.687638    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:09.688703 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:09.688682    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:12.241226 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:12.241193    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"]
Jul 16 00:13:12.704518 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:12.704473    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2" podUID="800d4fa5-17b7-4c73-982d-04c74ded378c" containerName="istio-proxy" containerID="cri-o://00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6" gracePeriod=30
Jul 16 00:13:19.064844 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.064817    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:19.183171 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183131    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-credential-socket\") pod \"800d4fa5-17b7-4c73-982d-04c74ded378c\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") "
Jul 16 00:13:19.183355 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183188    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-podinfo\") pod \"800d4fa5-17b7-4c73-982d-04c74ded378c\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") "
Jul 16 00:13:19.183355 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183223    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-envoy\") pod \"800d4fa5-17b7-4c73-982d-04c74ded378c\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") "
Jul 16 00:13:19.183355 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183250    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/800d4fa5-17b7-4c73-982d-04c74ded378c-istiod-ca-cert\") pod \"800d4fa5-17b7-4c73-982d-04c74ded378c\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") "
Jul 16 00:13:19.183355 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183274    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-data\") pod \"800d4fa5-17b7-4c73-982d-04c74ded378c\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") "
Jul 16 00:13:19.183355 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183322    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzgwq\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-kube-api-access-fzgwq\") pod \"800d4fa5-17b7-4c73-982d-04c74ded378c\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") "
Jul 16 00:13:19.183355 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183347    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-socket\") pod \"800d4fa5-17b7-4c73-982d-04c74ded378c\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") "
Jul 16 00:13:19.183678 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183388    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-token\") pod \"800d4fa5-17b7-4c73-982d-04c74ded378c\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") "
Jul 16 00:13:19.183678 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183405    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "800d4fa5-17b7-4c73-982d-04c74ded378c" (UID: "800d4fa5-17b7-4c73-982d-04c74ded378c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:13:19.183678 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183640    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "800d4fa5-17b7-4c73-982d-04c74ded378c" (UID: "800d4fa5-17b7-4c73-982d-04c74ded378c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:13:19.183829 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183712    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-certs\") pod \"800d4fa5-17b7-4c73-982d-04c74ded378c\" (UID: \"800d4fa5-17b7-4c73-982d-04c74ded378c\") "
Jul 16 00:13:19.183829 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183727    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800d4fa5-17b7-4c73-982d-04c74ded378c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "800d4fa5-17b7-4c73-982d-04c74ded378c" (UID: "800d4fa5-17b7-4c73-982d-04c74ded378c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:13:19.183978 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.183957    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "800d4fa5-17b7-4c73-982d-04c74ded378c" (UID: "800d4fa5-17b7-4c73-982d-04c74ded378c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:13:19.184309 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.184276    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-data" (OuterVolumeSpecName: "istio-data") pod "800d4fa5-17b7-4c73-982d-04c74ded378c" (UID: "800d4fa5-17b7-4c73-982d-04c74ded378c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:13:19.184372 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.184310    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-credential-socket\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:13:19.184372 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.184333    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/800d4fa5-17b7-4c73-982d-04c74ded378c-istiod-ca-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:13:19.184372 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.184350    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-socket\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:13:19.184372 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.184364    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-workload-certs\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:13:19.185510 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.185485    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "800d4fa5-17b7-4c73-982d-04c74ded378c" (UID: "800d4fa5-17b7-4c73-982d-04c74ded378c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 00:13:19.185651 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.185526    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "800d4fa5-17b7-4c73-982d-04c74ded378c" (UID: "800d4fa5-17b7-4c73-982d-04c74ded378c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:13:19.185900 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.185880    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-kube-api-access-fzgwq" (OuterVolumeSpecName: "kube-api-access-fzgwq") pod "800d4fa5-17b7-4c73-982d-04c74ded378c" (UID: "800d4fa5-17b7-4c73-982d-04c74ded378c"). InnerVolumeSpecName "kube-api-access-fzgwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:13:19.185900 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.185891    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-token" (OuterVolumeSpecName: "istio-token") pod "800d4fa5-17b7-4c73-982d-04c74ded378c" (UID: "800d4fa5-17b7-4c73-982d-04c74ded378c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:13:19.285949 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.285911    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzgwq\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-kube-api-access-fzgwq\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:13:19.285949 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.285942    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-token\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:13:19.285949 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.285955    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-podinfo\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:13:19.286182 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.285966    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-envoy\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:13:19.286182 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.285978    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/800d4fa5-17b7-4c73-982d-04c74ded378c-istio-data\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:13:19.745586 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.745545    2576 generic.go:356] "Generic (PLEG): container finished" podID="800d4fa5-17b7-4c73-982d-04c74ded378c" containerID="00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6" exitCode=0
Jul 16 00:13:19.745586 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.745589    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"
Jul 16 00:13:19.745881 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.745631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2" event={"ID":"800d4fa5-17b7-4c73-982d-04c74ded378c","Type":"ContainerDied","Data":"00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6"}
Jul 16 00:13:19.745881 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.745693    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2" event={"ID":"800d4fa5-17b7-4c73-982d-04c74ded378c","Type":"ContainerDied","Data":"117e5235ed00ae2b5007c9e0cee5f37628a91d1f739226cb7f7ab7fac03f9297"}
Jul 16 00:13:19.745881 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.745719    2576 scope.go:117] "RemoveContainer" containerID="00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6"
Jul 16 00:13:19.758677 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.758655    2576 scope.go:117] "RemoveContainer" containerID="00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6"
Jul 16 00:13:19.758985 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:13:19.758967    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6\": container with ID starting with 00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6 not found: ID does not exist" containerID="00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6"
Jul 16 00:13:19.759061 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.758993    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6"} err="failed to get container status \"00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6\": rpc error: code = NotFound desc = could not find container \"00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6\": container with ID starting with 00380ebbf76e9b8aee76eec78fe484aca5bbd2347cb221d387c1e79a403af7a6 not found: ID does not exist"
Jul 16 00:13:19.776115 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.776089    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"]
Jul 16 00:13:19.782818 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:19.782796    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a5fc7f57-openshift-default-6b84985979-mbvh2"]
Jul 16 00:13:20.187524 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:13:20.187491    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="800d4fa5-17b7-4c73-982d-04c74ded378c" path="/var/lib/kubelet/pods/800d4fa5-17b7-4c73-982d-04c74ded378c/volumes"
Jul 16 00:16:36.201650 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.201616    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"]
Jul 16 00:16:36.202255 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.202233    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="800d4fa5-17b7-4c73-982d-04c74ded378c" containerName="istio-proxy"
Jul 16 00:16:36.202336 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.202260    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="800d4fa5-17b7-4c73-982d-04c74ded378c" containerName="istio-proxy"
Jul 16 00:16:36.202392 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.202384    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="800d4fa5-17b7-4c73-982d-04c74ded378c" containerName="istio-proxy"
Jul 16 00:16:36.205641 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.205590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.207777 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.207757    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4dc784-openshift-default-dockercfg-jl6lr\""
Jul 16 00:16:36.216054 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.216032    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"]
Jul 16 00:16:36.328931 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.328897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-certs\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.329184 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.328954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-data\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.329184 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.329021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ce24a3a-2c39-4454-9b99-933ebeab393c-istiod-ca-cert\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.329184 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.329080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z72np\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-kube-api-access-z72np\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.329184 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.329166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-podinfo\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.329414 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.329255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-envoy\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.329414 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.329289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-socket\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.329414 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.329330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-credential-socket\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.329414 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.329366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-token\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430025 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.429985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-data\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430025 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ce24a3a-2c39-4454-9b99-933ebeab393c-istiod-ca-cert\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430299 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z72np\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-kube-api-access-z72np\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430299 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-podinfo\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430299 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-envoy\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430299 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-socket\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430299 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-credential-socket\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430299 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-token\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430648 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-certs\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430648 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430465    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-data\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430782 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430699    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-credential-socket\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430836 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430780    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-socket\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430895 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430830    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ce24a3a-2c39-4454-9b99-933ebeab393c-istiod-ca-cert\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.430895 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.430880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-certs\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.432452 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.432432    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-envoy\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.432691 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.432675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-podinfo\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.437797 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.437770    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z72np\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-kube-api-access-z72np\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.438117 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.438099    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-token\") pod \"e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") " pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.517407 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.517311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:36.667228 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.667183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"]
Jul 16 00:16:36.673007 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:16:36.672981    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce24a3a_2c39_4454_9b99_933ebeab393c.slice/crio-0b8461778a5a52e93191a14d80c15d4c2d5f1f8ad3ec1b900129a3789b5219ae WatchSource:0}: Error finding container 0b8461778a5a52e93191a14d80c15d4c2d5f1f8ad3ec1b900129a3789b5219ae: Status 404 returned error can't find the container with id 0b8461778a5a52e93191a14d80c15d4c2d5f1f8ad3ec1b900129a3789b5219ae
Jul 16 00:16:36.675071 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.675038    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:16:36.675172 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.675101    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:16:36.675172 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.675128    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:16:36.866293 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.866186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" event={"ID":"1ce24a3a-2c39-4454-9b99-933ebeab393c","Type":"ContainerStarted","Data":"b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24"}
Jul 16 00:16:36.866293 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.866245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" event={"ID":"1ce24a3a-2c39-4454-9b99-933ebeab393c","Type":"ContainerStarted","Data":"0b8461778a5a52e93191a14d80c15d4c2d5f1f8ad3ec1b900129a3789b5219ae"}
Jul 16 00:16:36.883544 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:36.883475    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" podStartSLOduration=0.883452969 podStartE2EDuration="883.452969ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:16:36.882846186 +0000 UTC m=+1757.149443799" watchObservedRunningTime="2026-07-16 00:16:36.883452969 +0000 UTC m=+1757.150050577"
Jul 16 00:16:37.517969 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:37.517934    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:37.522974 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:37.522950    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:37.873068 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:37.872972    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:37.874033 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:37.874008    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:53.914809 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:53.914762    2576 patch_prober.go:28] interesting pod/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 00:16:53.915266 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:53.914833    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 00:16:55.983469 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:55.983433    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerID="b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24" exitCode=0
Jul 16 00:16:55.983913 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:55.983504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" event={"ID":"1ce24a3a-2c39-4454-9b99-933ebeab393c","Type":"ContainerDied","Data":"b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24"}
Jul 16 00:16:55.983961 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:55.983949    2576 scope.go:117] "RemoveContainer" containerID="b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24"
Jul 16 00:16:55.984968 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:55.984940    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:16:55.985072 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:55.985025    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:16:55.985145 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:55.985073    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:16:56.990782 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:56.990748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" event={"ID":"1ce24a3a-2c39-4454-9b99-933ebeab393c","Type":"ContainerStarted","Data":"4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b"}
Jul 16 00:16:57.517918 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:57.517879    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:16:57.518206 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:57.518180    2576 patch_prober.go:28] interesting pod/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 00:16:57.518325 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:57.518240    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 00:16:58.518727 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:58.518680    2576 patch_prober.go:28] interesting pod/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 00:16:58.519146 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:58.518754    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 00:16:59.518135 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:59.518097    2576 patch_prober.go:28] interesting pod/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 00:16:59.518309 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:16:59.518167    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 00:17:00.518765 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:00.518727    2576 patch_prober.go:28] interesting pod/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 00:17:00.519174 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:00.518783    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 00:17:01.521705 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:01.521665    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:17:01.522114 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:01.522081    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:17:01.522844 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:01.522825    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:17:02.203216 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.203180    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"]
Jul 16 00:17:02.207166 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.207145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.210260 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.210229    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-30d4db\"/\"test-model-30d4db-kserve-self-signed-certs\""
Jul 16 00:17:02.210260 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.210250    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-30d4db\"/\"openshift-service-ca.crt\""
Jul 16 00:17:02.210260 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.210257    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-30d4db\"/\"default-dockercfg-2mmj4\""
Jul 16 00:17:02.210459 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.210232    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-30d4db\"/\"kube-root-ca.crt\""
Jul 16 00:17:02.215708 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.215687    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"]
Jul 16 00:17:02.291429 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.291394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-dshm\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.291690 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.291446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-home\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.291690 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.291474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tls-certs\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.291690 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.291510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s299f\" (UniqueName: \"kubernetes.io/projected/2f7a34a8-b97f-4732-a9d5-e4c743c45637-kube-api-access-s299f\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.291690 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.291536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tmp-dir\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.291690 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.291577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-model-cache\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.392799 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.392759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-dshm\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.393008 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.392822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-home\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.393008 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.392848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tls-certs\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.393008 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.392882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s299f\" (UniqueName: \"kubernetes.io/projected/2f7a34a8-b97f-4732-a9d5-e4c743c45637-kube-api-access-s299f\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.393008 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.392909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tmp-dir\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.393008 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.392956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-model-cache\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.393327 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.393306    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-home\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.393389 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.393309    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-model-cache\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.393389 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.393372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tmp-dir\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.395093 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.395068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-dshm\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.395352 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.395335    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tls-certs\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.400226 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.400204    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s299f\" (UniqueName: \"kubernetes.io/projected/2f7a34a8-b97f-4732-a9d5-e4c743c45637-kube-api-access-s299f\") pod \"test-model-30d4db-kserve-5fc58668cf-npqfz\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") " pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.517894 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.517787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:02.659868 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:02.659829    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"]
Jul 16 00:17:02.662349 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:17:02.662324    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f7a34a8_b97f_4732_a9d5_e4c743c45637.slice/crio-34972e23d6761f4555401df39ce7fdfb077e1e6ae227042ec7cdcbfce4c6d119 WatchSource:0}: Error finding container 34972e23d6761f4555401df39ce7fdfb077e1e6ae227042ec7cdcbfce4c6d119: Status 404 returned error can't find the container with id 34972e23d6761f4555401df39ce7fdfb077e1e6ae227042ec7cdcbfce4c6d119
Jul 16 00:17:03.027829 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:03.027794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz" event={"ID":"2f7a34a8-b97f-4732-a9d5-e4c743c45637","Type":"ContainerStarted","Data":"e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347"}
Jul 16 00:17:03.027829 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:03.027843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz" event={"ID":"2f7a34a8-b97f-4732-a9d5-e4c743c45637","Type":"ContainerStarted","Data":"34972e23d6761f4555401df39ce7fdfb077e1e6ae227042ec7cdcbfce4c6d119"}
Jul 16 00:17:03.045034 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:03.044972    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz" podStartSLOduration=1.044948447 podStartE2EDuration="1.044948447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:03.042857581 +0000 UTC m=+1783.309455194" watchObservedRunningTime="2026-07-16 00:17:03.044948447 +0000 UTC m=+1783.311546061"
Jul 16 00:17:12.518733 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:12.518511    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:12.518733 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:12.518587    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:12.532227 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:12.532202    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:13.101793 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:13.101766    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:17:20.231225 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:20.231199    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:17:20.236813 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:20.236790    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:17:52.128670 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:17:52.128631    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"]
Jul 16 00:18:07.152715 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.152660    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz" podUID="2f7a34a8-b97f-4732-a9d5-e4c743c45637" containerName="main" containerID="cri-o://e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347" gracePeriod=45
Jul 16 00:18:07.413470 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.413403    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:18:07.415766 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.415739    2576 generic.go:356] "Generic (PLEG): container finished" podID="2f7a34a8-b97f-4732-a9d5-e4c743c45637" containerID="e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347" exitCode=0
Jul 16 00:18:07.415892 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.415776    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"
Jul 16 00:18:07.415892 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.415800    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz" event={"ID":"2f7a34a8-b97f-4732-a9d5-e4c743c45637","Type":"ContainerDied","Data":"e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347"}
Jul 16 00:18:07.415892 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.415839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz" event={"ID":"2f7a34a8-b97f-4732-a9d5-e4c743c45637","Type":"ContainerDied","Data":"34972e23d6761f4555401df39ce7fdfb077e1e6ae227042ec7cdcbfce4c6d119"}
Jul 16 00:18:07.415892 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.415857    2576 scope.go:117] "RemoveContainer" containerID="e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347"
Jul 16 00:18:07.424489 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.424472    2576 scope.go:117] "RemoveContainer" containerID="e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347"
Jul 16 00:18:07.424792 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:18:07.424772    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347\": container with ID starting with e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347 not found: ID does not exist" containerID="e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347"
Jul 16 00:18:07.424852 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.424800    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347"} err="failed to get container status \"e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347\": rpc error: code = NotFound desc = could not find container \"e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347\": container with ID starting with e888cf1d9e06efbe76dda24bd6a03bf3b9b844b352e10b00510f7bfc2acbd347 not found: ID does not exist"
Jul 16 00:18:07.542559 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.542522    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-home\") pod \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") "
Jul 16 00:18:07.542778 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.542670    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-model-cache\") pod \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") "
Jul 16 00:18:07.542778 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.542720    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s299f\" (UniqueName: \"kubernetes.io/projected/2f7a34a8-b97f-4732-a9d5-e4c743c45637-kube-api-access-s299f\") pod \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") "
Jul 16 00:18:07.542899 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.542796    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tmp-dir\") pod \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") "
Jul 16 00:18:07.542899 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.542847    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-dshm\") pod \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") "
Jul 16 00:18:07.542899 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.542879    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-home" (OuterVolumeSpecName: "home") pod "2f7a34a8-b97f-4732-a9d5-e4c743c45637" (UID: "2f7a34a8-b97f-4732-a9d5-e4c743c45637"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:07.543057 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.542901    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tls-certs\") pod \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\" (UID: \"2f7a34a8-b97f-4732-a9d5-e4c743c45637\") "
Jul 16 00:18:07.543057 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.542928    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f7a34a8-b97f-4732-a9d5-e4c743c45637" (UID: "2f7a34a8-b97f-4732-a9d5-e4c743c45637"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:07.543168 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.543086    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f7a34a8-b97f-4732-a9d5-e4c743c45637" (UID: "2f7a34a8-b97f-4732-a9d5-e4c743c45637"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:07.543224 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.543210    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tmp-dir\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:07.543270 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.543230    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-home\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:07.543270 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.543245    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-model-cache\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:07.545150 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.545124    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f7a34a8-b97f-4732-a9d5-e4c743c45637" (UID: "2f7a34a8-b97f-4732-a9d5-e4c743c45637"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:07.545500 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.545464    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f7a34a8-b97f-4732-a9d5-e4c743c45637-kube-api-access-s299f" (OuterVolumeSpecName: "kube-api-access-s299f") pod "2f7a34a8-b97f-4732-a9d5-e4c743c45637" (UID: "2f7a34a8-b97f-4732-a9d5-e4c743c45637"). InnerVolumeSpecName "kube-api-access-s299f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:18:07.545500 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.545477    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-dshm" (OuterVolumeSpecName: "dshm") pod "2f7a34a8-b97f-4732-a9d5-e4c743c45637" (UID: "2f7a34a8-b97f-4732-a9d5-e4c743c45637"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:07.643904 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.643859    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7a34a8-b97f-4732-a9d5-e4c743c45637-tls-certs\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:07.643904 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.643903    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s299f\" (UniqueName: \"kubernetes.io/projected/2f7a34a8-b97f-4732-a9d5-e4c743c45637-kube-api-access-s299f\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:07.644114 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.643918    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7a34a8-b97f-4732-a9d5-e4c743c45637-dshm\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:07.737923 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.737893    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"]
Jul 16 00:18:07.742153 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:07.742125    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-30d4db/test-model-30d4db-kserve-5fc58668cf-npqfz"]
Jul 16 00:18:08.188107 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:08.188073    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f7a34a8-b97f-4732-a9d5-e4c743c45637" path="/var/lib/kubelet/pods/2f7a34a8-b97f-4732-a9d5-e4c743c45637/volumes"
Jul 16 00:18:43.654571 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:43.654481    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"]
Jul 16 00:18:43.655142 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:43.654761    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy" containerID="cri-o://4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b" gracePeriod=30
Jul 16 00:18:46.524327 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:46.524288    2576 patch_prober.go:28] interesting pod/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 00:18:46.524749 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:46.524365    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 00:18:48.917329 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:48.917265    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:18:49.027495 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027464    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-data\") pod \"1ce24a3a-2c39-4454-9b99-933ebeab393c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") "
Jul 16 00:18:49.027672 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027510    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ce24a3a-2c39-4454-9b99-933ebeab393c-istiod-ca-cert\") pod \"1ce24a3a-2c39-4454-9b99-933ebeab393c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") "
Jul 16 00:18:49.027672 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027547    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z72np\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-kube-api-access-z72np\") pod \"1ce24a3a-2c39-4454-9b99-933ebeab393c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") "
Jul 16 00:18:49.027672 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027581    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-socket\") pod \"1ce24a3a-2c39-4454-9b99-933ebeab393c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") "
Jul 16 00:18:49.027672 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027653    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-token\") pod \"1ce24a3a-2c39-4454-9b99-933ebeab393c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") "
Jul 16 00:18:49.027919 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027684    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-envoy\") pod \"1ce24a3a-2c39-4454-9b99-933ebeab393c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") "
Jul 16 00:18:49.027919 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027728    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-certs\") pod \"1ce24a3a-2c39-4454-9b99-933ebeab393c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") "
Jul 16 00:18:49.027919 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027754    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-podinfo\") pod \"1ce24a3a-2c39-4454-9b99-933ebeab393c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") "
Jul 16 00:18:49.027919 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027796    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-credential-socket\") pod \"1ce24a3a-2c39-4454-9b99-933ebeab393c\" (UID: \"1ce24a3a-2c39-4454-9b99-933ebeab393c\") "
Jul 16 00:18:49.028122 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.027922    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ce24a3a-2c39-4454-9b99-933ebeab393c" (UID: "1ce24a3a-2c39-4454-9b99-933ebeab393c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:49.028122 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.028002    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ce24a3a-2c39-4454-9b99-933ebeab393c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ce24a3a-2c39-4454-9b99-933ebeab393c" (UID: "1ce24a3a-2c39-4454-9b99-933ebeab393c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:18:49.028229 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.028147    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ce24a3a-2c39-4454-9b99-933ebeab393c" (UID: "1ce24a3a-2c39-4454-9b99-933ebeab393c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:49.028290 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.028262    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ce24a3a-2c39-4454-9b99-933ebeab393c" (UID: "1ce24a3a-2c39-4454-9b99-933ebeab393c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:49.028349 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.028283    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ce24a3a-2c39-4454-9b99-933ebeab393c-istiod-ca-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:49.028349 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.028303    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-socket\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:49.028349 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.028316    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-credential-socket\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:49.028534 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.028513    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ce24a3a-2c39-4454-9b99-933ebeab393c" (UID: "1ce24a3a-2c39-4454-9b99-933ebeab393c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:49.030419 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.030398    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ce24a3a-2c39-4454-9b99-933ebeab393c" (UID: "1ce24a3a-2c39-4454-9b99-933ebeab393c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 00:18:49.030515 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.030428    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ce24a3a-2c39-4454-9b99-933ebeab393c" (UID: "1ce24a3a-2c39-4454-9b99-933ebeab393c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:18:49.030515 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.030508    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-kube-api-access-z72np" (OuterVolumeSpecName: "kube-api-access-z72np") pod "1ce24a3a-2c39-4454-9b99-933ebeab393c" (UID: "1ce24a3a-2c39-4454-9b99-933ebeab393c"). InnerVolumeSpecName "kube-api-access-z72np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:18:49.030630 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.030525    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ce24a3a-2c39-4454-9b99-933ebeab393c" (UID: "1ce24a3a-2c39-4454-9b99-933ebeab393c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:49.129678 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.129643    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-data\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:49.129678 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.129671    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z72np\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-kube-api-access-z72np\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:49.129678 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.129683    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-token\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:49.129915 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.129691    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-envoy\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:49.129915 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.129701    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ce24a3a-2c39-4454-9b99-933ebeab393c-workload-certs\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:49.129915 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.129708    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ce24a3a-2c39-4454-9b99-933ebeab393c-istio-podinfo\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:18:49.684362 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.684319    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerID="4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b" exitCode=0
Jul 16 00:18:49.684565 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.684387    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"
Jul 16 00:18:49.684565 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.684410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" event={"ID":"1ce24a3a-2c39-4454-9b99-933ebeab393c","Type":"ContainerDied","Data":"4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b"}
Jul 16 00:18:49.684565 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.684501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c" event={"ID":"1ce24a3a-2c39-4454-9b99-933ebeab393c","Type":"ContainerDied","Data":"0b8461778a5a52e93191a14d80c15d4c2d5f1f8ad3ec1b900129a3789b5219ae"}
Jul 16 00:18:49.684565 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.684531    2576 scope.go:117] "RemoveContainer" containerID="4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b"
Jul 16 00:18:49.694313 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.694293    2576 scope.go:117] "RemoveContainer" containerID="b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24"
Jul 16 00:18:49.702872 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.702852    2576 scope.go:117] "RemoveContainer" containerID="4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b"
Jul 16 00:18:49.703130 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:18:49.703106    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b\": container with ID starting with 4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b not found: ID does not exist" containerID="4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b"
Jul 16 00:18:49.703178 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.703137    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b"} err="failed to get container status \"4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b\": rpc error: code = NotFound desc = could not find container \"4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b\": container with ID starting with 4b14451ead5d1208c496f44d98be73a29800c85220aea67b2cad6cc45a94ad4b not found: ID does not exist"
Jul 16 00:18:49.703178 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.703159    2576 scope.go:117] "RemoveContainer" containerID="b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24"
Jul 16 00:18:49.703383 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:18:49.703367    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24\": container with ID starting with b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24 not found: ID does not exist" containerID="b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24"
Jul 16 00:18:49.703420 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.703390    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24"} err="failed to get container status \"b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24\": rpc error: code = NotFound desc = could not find container \"b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24\": container with ID starting with b1e7d7e188a4ea83352262e052a2f4acd1bbd24c1d585301df4491f288bbab24 not found: ID does not exist"
Jul 16 00:18:49.713120 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.713082    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"]
Jul 16 00:18:49.726097 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:49.726069    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4dc784-openshift-default-57cccc5f9f-jq44c"]
Jul 16 00:18:50.187183 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:50.187152    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" path="/var/lib/kubelet/pods/1ce24a3a-2c39-4454-9b99-933ebeab393c/volumes"
Jul 16 00:18:53.080851 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.080817    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"]
Jul 16 00:18:53.081253 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.081239    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy"
Jul 16 00:18:53.081253 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.081253    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy"
Jul 16 00:18:53.081333 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.081271    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f7a34a8-b97f-4732-a9d5-e4c743c45637" containerName="main"
Jul 16 00:18:53.081333 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.081277    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f7a34a8-b97f-4732-a9d5-e4c743c45637" containerName="main"
Jul 16 00:18:53.081396 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.081339    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy"
Jul 16 00:18:53.081396 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.081346    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f7a34a8-b97f-4732-a9d5-e4c743c45637" containerName="main"
Jul 16 00:18:53.081396 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.081355    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy"
Jul 16 00:18:53.084444 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.084427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.092826 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.092805    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-452237-openshift-default-dockercfg-mgs7z\""
Jul 16 00:18:53.106469 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.106440    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"]
Jul 16 00:18:53.167040 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.167004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-certs\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.167040 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.167044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-envoy\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.167291 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.167063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-data\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.167291 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.167121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-socket\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.167291 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.167167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgk9\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-kube-api-access-fkgk9\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.167291 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.167227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-istio-token\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.167291 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.167255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-credential-socket\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.167291 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.167292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a491e5d-2095-45dd-bd99-56ef47318102-istio-podinfo\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.167484 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.167325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a491e5d-2095-45dd-bd99-56ef47318102-istiod-ca-cert\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268234 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-certs\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268420 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-envoy\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268420 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-data\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268420 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-socket\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268420 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgk9\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-kube-api-access-fkgk9\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268420 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-istio-token\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268420 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-credential-socket\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268840 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a491e5d-2095-45dd-bd99-56ef47318102-istio-podinfo\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268840 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a491e5d-2095-45dd-bd99-56ef47318102-istiod-ca-cert\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268840 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-certs\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268840 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-data\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.268840 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-socket\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.269118 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.268989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-credential-socket\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.269396 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.269374    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a491e5d-2095-45dd-bd99-56ef47318102-istiod-ca-cert\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.270553 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.270531    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-envoy\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.270971 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.270954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a491e5d-2095-45dd-bd99-56ef47318102-istio-podinfo\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.276734 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.276709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-istio-token\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.276893 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.276875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgk9\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-kube-api-access-fkgk9\") pod \"e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") " pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.395354 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.395322    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:53.548776 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.548746    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"]
Jul 16 00:18:53.549650 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:18:53.549621    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a491e5d_2095_45dd_bd99_56ef47318102.slice/crio-a0d82886c8c5718773deef09cdca9974e4818218f8374d3e3155803a99d560c1 WatchSource:0}: Error finding container a0d82886c8c5718773deef09cdca9974e4818218f8374d3e3155803a99d560c1: Status 404 returned error can't find the container with id a0d82886c8c5718773deef09cdca9974e4818218f8374d3e3155803a99d560c1
Jul 16 00:18:53.551853 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.551814    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:18:53.551948 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.551930    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:18:53.551992 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.551980    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:18:53.710551 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.710462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" event={"ID":"3a491e5d-2095-45dd-bd99-56ef47318102","Type":"ContainerStarted","Data":"58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e"}
Jul 16 00:18:53.710551 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.710525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" event={"ID":"3a491e5d-2095-45dd-bd99-56ef47318102","Type":"ContainerStarted","Data":"a0d82886c8c5718773deef09cdca9974e4818218f8374d3e3155803a99d560c1"}
Jul 16 00:18:53.735120 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:53.735071    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" podStartSLOduration=0.735049875 podStartE2EDuration="735.049875ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:18:53.734260078 +0000 UTC m=+1894.000857691" watchObservedRunningTime="2026-07-16 00:18:53.735049875 +0000 UTC m=+1894.001647491"
Jul 16 00:18:54.396322 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:54.396279    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:54.401570 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:54.401546    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:54.715848 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:54.715754    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:18:54.716811 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:18:54.716791    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:19:08.804482 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:08.804448    2576 generic.go:356] "Generic (PLEG): container finished" podID="3a491e5d-2095-45dd-bd99-56ef47318102" containerID="58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e" exitCode=0
Jul 16 00:19:08.804482 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:08.804488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" event={"ID":"3a491e5d-2095-45dd-bd99-56ef47318102","Type":"ContainerDied","Data":"58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e"}
Jul 16 00:19:08.804971 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:08.804870    2576 scope.go:117] "RemoveContainer" containerID="58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e"
Jul 16 00:19:08.805984 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:08.805942    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:19:08.806102 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:08.806026    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:19:08.806102 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:08.806075    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:19:09.716678 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:09.716642    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:19:09.812090 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:09.812057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" event={"ID":"3a491e5d-2095-45dd-bd99-56ef47318102","Type":"ContainerStarted","Data":"e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c"}
Jul 16 00:19:10.396053 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:10.396015    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:19:10.397264 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:10.397234    2576 patch_prober.go:28] interesting pod/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 16 00:19:10.397372 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:10.397286    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 16 00:19:11.396447 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:11.396407    2576 patch_prober.go:28] interesting pod/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 16 00:19:11.396870 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:11.396467    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 16 00:19:12.395793 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:12.395757    2576 patch_prober.go:28] interesting pod/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 16 00:19:12.395978 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:12.395813    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 16 00:19:13.396063 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:13.396016    2576 patch_prober.go:28] interesting pod/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 16 00:19:13.396501 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:13.396091    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 16 00:19:14.400004 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:14.399975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:19:14.400411 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:14.400226    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:19:14.401087 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:14.401072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:19:33.876307 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:33.876271    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"]
Jul 16 00:19:33.876913 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:33.876580    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy" containerID="cri-o://e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c" gracePeriod=30
Jul 16 00:19:39.139218 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.139162    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:19:39.242919 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.242883    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-data\") pod \"3a491e5d-2095-45dd-bd99-56ef47318102\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") "
Jul 16 00:19:39.242919 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.242925    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkgk9\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-kube-api-access-fkgk9\") pod \"3a491e5d-2095-45dd-bd99-56ef47318102\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") "
Jul 16 00:19:39.243171 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.242952    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-istio-token\") pod \"3a491e5d-2095-45dd-bd99-56ef47318102\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") "
Jul 16 00:19:39.243171 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.242996    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a491e5d-2095-45dd-bd99-56ef47318102-istiod-ca-cert\") pod \"3a491e5d-2095-45dd-bd99-56ef47318102\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") "
Jul 16 00:19:39.243171 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243029    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a491e5d-2095-45dd-bd99-56ef47318102-istio-podinfo\") pod \"3a491e5d-2095-45dd-bd99-56ef47318102\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") "
Jul 16 00:19:39.243171 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243063    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-credential-socket\") pod \"3a491e5d-2095-45dd-bd99-56ef47318102\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") "
Jul 16 00:19:39.243171 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243134    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-socket\") pod \"3a491e5d-2095-45dd-bd99-56ef47318102\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") "
Jul 16 00:19:39.243434 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243179    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-envoy\") pod \"3a491e5d-2095-45dd-bd99-56ef47318102\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") "
Jul 16 00:19:39.243434 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243207    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-certs\") pod \"3a491e5d-2095-45dd-bd99-56ef47318102\" (UID: \"3a491e5d-2095-45dd-bd99-56ef47318102\") "
Jul 16 00:19:39.243546 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243457    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a491e5d-2095-45dd-bd99-56ef47318102-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a491e5d-2095-45dd-bd99-56ef47318102" (UID: "3a491e5d-2095-45dd-bd99-56ef47318102"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:19:39.243624 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243534    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a491e5d-2095-45dd-bd99-56ef47318102" (UID: "3a491e5d-2095-45dd-bd99-56ef47318102"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:19:39.244132 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243690    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a491e5d-2095-45dd-bd99-56ef47318102-istiod-ca-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:19:39.244132 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243716    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-credential-socket\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:19:39.244132 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.243968    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a491e5d-2095-45dd-bd99-56ef47318102" (UID: "3a491e5d-2095-45dd-bd99-56ef47318102"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:19:39.244132 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.244046    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a491e5d-2095-45dd-bd99-56ef47318102" (UID: "3a491e5d-2095-45dd-bd99-56ef47318102"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:19:39.244132 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.244108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a491e5d-2095-45dd-bd99-56ef47318102" (UID: "3a491e5d-2095-45dd-bd99-56ef47318102"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:19:39.245661 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.245632    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-kube-api-access-fkgk9" (OuterVolumeSpecName: "kube-api-access-fkgk9") pod "3a491e5d-2095-45dd-bd99-56ef47318102" (UID: "3a491e5d-2095-45dd-bd99-56ef47318102"). InnerVolumeSpecName "kube-api-access-fkgk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:19:39.245783 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.245758    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a491e5d-2095-45dd-bd99-56ef47318102" (UID: "3a491e5d-2095-45dd-bd99-56ef47318102"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:19:39.245853 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.245829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a491e5d-2095-45dd-bd99-56ef47318102" (UID: "3a491e5d-2095-45dd-bd99-56ef47318102"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:19:39.246390 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.246365    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a491e5d-2095-45dd-bd99-56ef47318102-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a491e5d-2095-45dd-bd99-56ef47318102" (UID: "3a491e5d-2095-45dd-bd99-56ef47318102"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 00:19:39.344414 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.344376    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkgk9\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-kube-api-access-fkgk9\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:19:39.344414 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.344409    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a491e5d-2095-45dd-bd99-56ef47318102-istio-token\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:19:39.344414 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.344419    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a491e5d-2095-45dd-bd99-56ef47318102-istio-podinfo\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:19:39.344675 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.344427    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-socket\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:19:39.344675 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.344437    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-envoy\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:19:39.344675 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.344444    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-workload-certs\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:19:39.344675 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.344463    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a491e5d-2095-45dd-bd99-56ef47318102-istio-data\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:19:39.991856 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.991820    2576 generic.go:356] "Generic (PLEG): container finished" podID="3a491e5d-2095-45dd-bd99-56ef47318102" containerID="e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c" exitCode=0
Jul 16 00:19:39.992038 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.991880    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"
Jul 16 00:19:39.992038 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.991905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" event={"ID":"3a491e5d-2095-45dd-bd99-56ef47318102","Type":"ContainerDied","Data":"e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c"}
Jul 16 00:19:39.992038 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.991981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46" event={"ID":"3a491e5d-2095-45dd-bd99-56ef47318102","Type":"ContainerDied","Data":"a0d82886c8c5718773deef09cdca9974e4818218f8374d3e3155803a99d560c1"}
Jul 16 00:19:39.992038 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:39.992004    2576 scope.go:117] "RemoveContainer" containerID="e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c"
Jul 16 00:19:40.001799 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:40.001626    2576 scope.go:117] "RemoveContainer" containerID="58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e"
Jul 16 00:19:40.010143 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:40.010127    2576 scope.go:117] "RemoveContainer" containerID="e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c"
Jul 16 00:19:40.010373 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:19:40.010355    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c\": container with ID starting with e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c not found: ID does not exist" containerID="e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c"
Jul 16 00:19:40.010448 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:40.010386    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c"} err="failed to get container status \"e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c\": rpc error: code = NotFound desc = could not find container \"e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c\": container with ID starting with e1af76814ee700c025ce8331133bae21856865930b7e4f6da10531e84cd8aa6c not found: ID does not exist"
Jul 16 00:19:40.010448 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:40.010409    2576 scope.go:117] "RemoveContainer" containerID="58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e"
Jul 16 00:19:40.010707 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:19:40.010690    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e\": container with ID starting with 58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e not found: ID does not exist" containerID="58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e"
Jul 16 00:19:40.010757 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:40.010714    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e"} err="failed to get container status \"58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e\": rpc error: code = NotFound desc = could not find container \"58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e\": container with ID starting with 58fafd362cf6678d1304cbaf092c4df47fb8b23decde8e53580b053a5965988e not found: ID does not exist"
Jul 16 00:19:40.014524 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:40.014505    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"]
Jul 16 00:19:40.017519 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:40.017500    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-452237-openshift-default-58d48c6bcf-z4g46"]
Jul 16 00:19:40.188136 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:40.188105    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" path="/var/lib/kubelet/pods/3a491e5d-2095-45dd-bd99-56ef47318102/volumes"
Jul 16 00:19:43.134358 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.134305    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"]
Jul 16 00:19:43.135433 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.135406    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy"
Jul 16 00:19:43.135433 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.135435    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy"
Jul 16 00:19:43.135620 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.135451    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy"
Jul 16 00:19:43.135620 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.135459    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce24a3a-2c39-4454-9b99-933ebeab393c" containerName="istio-proxy"
Jul 16 00:19:43.135620 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.135473    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy"
Jul 16 00:19:43.135620 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.135481    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy"
Jul 16 00:19:43.135620 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.135581    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy"
Jul 16 00:19:43.135620 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.135593    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a491e5d-2095-45dd-bd99-56ef47318102" containerName="istio-proxy"
Jul 16 00:19:43.140203 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.140184    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.143020 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.143000    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c688a9-openshift-default-dockercfg-8png2\""
Jul 16 00:19:43.151816 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.151794    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"]
Jul 16 00:19:43.179056 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.179033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-podinfo\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.179178 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.179074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istiod-ca-cert\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.179178 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.179106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr4ls\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-kube-api-access-jr4ls\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.179178 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.179154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-socket\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.179287 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.179180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-token\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.179287 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.179223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-credential-socket\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.179354 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.179291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-envoy\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.179354 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.179314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-data\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.179354 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.179341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-certs\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280166 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istiod-ca-cert\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280352 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr4ls\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-kube-api-access-jr4ls\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280352 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-socket\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280352 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-token\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280352 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-credential-socket\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280566 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-envoy\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280566 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-data\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280700 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-certs\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280700 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-socket\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.280814 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-podinfo\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.281048 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istiod-ca-cert\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.281048 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.280988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-data\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.281048 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.281038    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-certs\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.281299 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.281233    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-credential-socket\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.282714 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.282694    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-envoy\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.283124 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.283104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-podinfo\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.287904 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.287885    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-token\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.288338 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.288317    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr4ls\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-kube-api-access-jr4ls\") pod \"e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") " pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.453173 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.453137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:43.593926 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.593897    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"]
Jul 16 00:19:43.595009 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:19:43.594984    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa4818e_31b0_46a5_9854_fa4b99a53cba.slice/crio-e5dadcb041e92b126b936bf7a79b72760edb0b660bd0d9921451214e258124d5 WatchSource:0}: Error finding container e5dadcb041e92b126b936bf7a79b72760edb0b660bd0d9921451214e258124d5: Status 404 returned error can't find the container with id e5dadcb041e92b126b936bf7a79b72760edb0b660bd0d9921451214e258124d5
Jul 16 00:19:43.597218 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.597187    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:19:43.597308 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.597267    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:19:43.597371 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:43.597310    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:19:44.017914 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:44.017877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" event={"ID":"dfa4818e-31b0-46a5-9854-fa4b99a53cba","Type":"ContainerStarted","Data":"e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460"}
Jul 16 00:19:44.018102 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:44.017936    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" event={"ID":"dfa4818e-31b0-46a5-9854-fa4b99a53cba","Type":"ContainerStarted","Data":"e5dadcb041e92b126b936bf7a79b72760edb0b660bd0d9921451214e258124d5"}
Jul 16 00:19:44.047995 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:44.047938    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" podStartSLOduration=1.047918118 podStartE2EDuration="1.047918118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:19:44.046062209 +0000 UTC m=+1944.312659826" watchObservedRunningTime="2026-07-16 00:19:44.047918118 +0000 UTC m=+1944.314515734"
Jul 16 00:19:44.453518 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:44.453481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:44.459181 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:44.459152    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:45.024344 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:45.024302    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:19:45.025346 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:19:45.025322    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:20:01.066832 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:01.066777    2576 patch_prober.go:28] interesting pod/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 00:20:01.067247 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:01.066874    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 00:20:02.128525 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:02.128427    2576 generic.go:356] "Generic (PLEG): container finished" podID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerID="e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460" exitCode=0
Jul 16 00:20:02.128525 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:02.128501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" event={"ID":"dfa4818e-31b0-46a5-9854-fa4b99a53cba","Type":"ContainerDied","Data":"e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460"}
Jul 16 00:20:02.128966 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:02.128937    2576 scope.go:117] "RemoveContainer" containerID="e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460"
Jul 16 00:20:02.129937 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:02.129912    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:20:02.129987 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:02.129976    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:20:02.130022 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:02.130011    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 00:20:03.136338 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:03.136303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" event={"ID":"dfa4818e-31b0-46a5-9854-fa4b99a53cba","Type":"ContainerStarted","Data":"734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3"}
Jul 16 00:20:03.454051 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:03.453944    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:20:03.454237 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:03.454080    2576 patch_prober.go:28] interesting pod/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 16 00:20:03.454237 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:03.454136    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 16 00:20:04.454245 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:04.454200    2576 patch_prober.go:28] interesting pod/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 16 00:20:04.454780 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:04.454281    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 16 00:20:05.454460 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:05.454419    2576 patch_prober.go:28] interesting pod/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 16 00:20:05.455110 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:05.454507    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 16 00:20:06.453592 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:06.453549    2576 patch_prober.go:28] interesting pod/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 16 00:20:06.453850 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:06.453642    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 16 00:20:07.457815 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:07.457782    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:20:07.458271 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:07.458083    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:20:07.458910 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:20:07.458890    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:22:20.273778 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:22:20.273749    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:22:20.282457 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:22:20.282434    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:26:27.506657 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.506551    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7251-139645387984304"]
Jul 16 00:26:27.510134 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.510117    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645387984304"
Jul 16 00:26:27.512353 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.512337    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-brw85\""
Jul 16 00:26:27.517426 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.517389    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645387984304"]
Jul 16 00:26:27.610993 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.610957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcghq\" (UniqueName: \"kubernetes.io/projected/444d3522-d51e-4507-85b6-c24c390bddf3-kube-api-access-zcghq\") pod \"test-curl-7251-139645387984304\" (UID: \"444d3522-d51e-4507-85b6-c24c390bddf3\") " pod="opendatahub/test-curl-7251-139645387984304"
Jul 16 00:26:27.711696 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.711658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcghq\" (UniqueName: \"kubernetes.io/projected/444d3522-d51e-4507-85b6-c24c390bddf3-kube-api-access-zcghq\") pod \"test-curl-7251-139645387984304\" (UID: \"444d3522-d51e-4507-85b6-c24c390bddf3\") " pod="opendatahub/test-curl-7251-139645387984304"
Jul 16 00:26:27.722157 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.722123    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcghq\" (UniqueName: \"kubernetes.io/projected/444d3522-d51e-4507-85b6-c24c390bddf3-kube-api-access-zcghq\") pod \"test-curl-7251-139645387984304\" (UID: \"444d3522-d51e-4507-85b6-c24c390bddf3\") " pod="opendatahub/test-curl-7251-139645387984304"
Jul 16 00:26:27.821143 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.821054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645387984304"
Jul 16 00:26:27.964018 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.963989    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645387984304"]
Jul 16 00:26:27.964907 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:26:27.964876    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod444d3522_d51e_4507_85b6_c24c390bddf3.slice/crio-7a676467f24f0201208caff7f7d90bd54518469711012edf631a78e28eff3da4 WatchSource:0}: Error finding container 7a676467f24f0201208caff7f7d90bd54518469711012edf631a78e28eff3da4: Status 404 returned error can't find the container with id 7a676467f24f0201208caff7f7d90bd54518469711012edf631a78e28eff3da4
Jul 16 00:26:27.966099 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:27.966084    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:26:28.349529 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:28.349478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645387984304" event={"ID":"444d3522-d51e-4507-85b6-c24c390bddf3","Type":"ContainerStarted","Data":"7a676467f24f0201208caff7f7d90bd54518469711012edf631a78e28eff3da4"}
Jul 16 00:26:29.358194 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:29.358159    2576 generic.go:356] "Generic (PLEG): container finished" podID="444d3522-d51e-4507-85b6-c24c390bddf3" containerID="e5b9c799177c913dd1a6c6e3c999ecdf012ce225fb5024c52264f3acd63896cd" exitCode=0
Jul 16 00:26:29.358630 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:29.358238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645387984304" event={"ID":"444d3522-d51e-4507-85b6-c24c390bddf3","Type":"ContainerDied","Data":"e5b9c799177c913dd1a6c6e3c999ecdf012ce225fb5024c52264f3acd63896cd"}
Jul 16 00:26:30.502159 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.502130    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645387984304"
Jul 16 00:26:30.536420 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.536385    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7251-139645387984304_444d3522-d51e-4507-85b6-c24c390bddf3/test-curl-7251-139645387984304/0.log"
Jul 16 00:26:30.563029 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.562996    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7251-139645387984304"]
Jul 16 00:26:30.566690 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.566667    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7251-139645387984304"]
Jul 16 00:26:30.643439 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.643408    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcghq\" (UniqueName: \"kubernetes.io/projected/444d3522-d51e-4507-85b6-c24c390bddf3-kube-api-access-zcghq\") pod \"444d3522-d51e-4507-85b6-c24c390bddf3\" (UID: \"444d3522-d51e-4507-85b6-c24c390bddf3\") "
Jul 16 00:26:30.645792 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.645764    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444d3522-d51e-4507-85b6-c24c390bddf3-kube-api-access-zcghq" (OuterVolumeSpecName: "kube-api-access-zcghq") pod "444d3522-d51e-4507-85b6-c24c390bddf3" (UID: "444d3522-d51e-4507-85b6-c24c390bddf3"). InnerVolumeSpecName "kube-api-access-zcghq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:26:30.690247 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.690210    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7251-139645387981744"]
Jul 16 00:26:30.690650 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.690637    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444d3522-d51e-4507-85b6-c24c390bddf3" containerName="test-curl-7251-139645387984304"
Jul 16 00:26:30.690699 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.690652    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="444d3522-d51e-4507-85b6-c24c390bddf3" containerName="test-curl-7251-139645387984304"
Jul 16 00:26:30.690735 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.690713    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="444d3522-d51e-4507-85b6-c24c390bddf3" containerName="test-curl-7251-139645387984304"
Jul 16 00:26:30.693877 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.693861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645387981744"
Jul 16 00:26:30.699465 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.699439    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645387981744"]
Jul 16 00:26:30.745193 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.745154    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcghq\" (UniqueName: \"kubernetes.io/projected/444d3522-d51e-4507-85b6-c24c390bddf3-kube-api-access-zcghq\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:26:30.846129 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.846088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t87d\" (UniqueName: \"kubernetes.io/projected/82cf1327-d33f-4108-8ca1-c70aadf80fbb-kube-api-access-2t87d\") pod \"test-curl-7251-139645387981744\" (UID: \"82cf1327-d33f-4108-8ca1-c70aadf80fbb\") " pod="opendatahub/test-curl-7251-139645387981744"
Jul 16 00:26:30.947743 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.947636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t87d\" (UniqueName: \"kubernetes.io/projected/82cf1327-d33f-4108-8ca1-c70aadf80fbb-kube-api-access-2t87d\") pod \"test-curl-7251-139645387981744\" (UID: \"82cf1327-d33f-4108-8ca1-c70aadf80fbb\") " pod="opendatahub/test-curl-7251-139645387981744"
Jul 16 00:26:30.956663 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:30.956633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t87d\" (UniqueName: \"kubernetes.io/projected/82cf1327-d33f-4108-8ca1-c70aadf80fbb-kube-api-access-2t87d\") pod \"test-curl-7251-139645387981744\" (UID: \"82cf1327-d33f-4108-8ca1-c70aadf80fbb\") " pod="opendatahub/test-curl-7251-139645387981744"
Jul 16 00:26:31.004687 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:31.004647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645387981744"
Jul 16 00:26:31.151187 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:31.151154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645387981744"]
Jul 16 00:26:31.151650 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:26:31.151619    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82cf1327_d33f_4108_8ca1_c70aadf80fbb.slice/crio-c7193d3bc94a13901cc94a04b5802a5e267bca0fa849ac05dd0c3d59b249dbd2 WatchSource:0}: Error finding container c7193d3bc94a13901cc94a04b5802a5e267bca0fa849ac05dd0c3d59b249dbd2: Status 404 returned error can't find the container with id c7193d3bc94a13901cc94a04b5802a5e267bca0fa849ac05dd0c3d59b249dbd2
Jul 16 00:26:31.372004 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:31.371890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645387981744" event={"ID":"82cf1327-d33f-4108-8ca1-c70aadf80fbb","Type":"ContainerStarted","Data":"c7193d3bc94a13901cc94a04b5802a5e267bca0fa849ac05dd0c3d59b249dbd2"}
Jul 16 00:26:31.373301 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:31.373283    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645387984304"
Jul 16 00:26:31.373421 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:31.373291    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a676467f24f0201208caff7f7d90bd54518469711012edf631a78e28eff3da4"
Jul 16 00:26:31.383859 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:26:31.383829    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7251-139645387984304\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="444d3522-d51e-4507-85b6-c24c390bddf3" pod="opendatahub/test-curl-7251-139645387984304"
Jul 16 00:26:32.187981 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:32.187947    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="444d3522-d51e-4507-85b6-c24c390bddf3" path="/var/lib/kubelet/pods/444d3522-d51e-4507-85b6-c24c390bddf3/volumes"
Jul 16 00:26:32.380530 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:32.380494    2576 generic.go:356] "Generic (PLEG): container finished" podID="82cf1327-d33f-4108-8ca1-c70aadf80fbb" containerID="adafa4b9bf26d5dea9c1e1ed0a08c4e3a5ba85c4be54430e8ccde2c03ef8f55b" exitCode=0
Jul 16 00:26:32.380530 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:32.380531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645387981744" event={"ID":"82cf1327-d33f-4108-8ca1-c70aadf80fbb","Type":"ContainerDied","Data":"adafa4b9bf26d5dea9c1e1ed0a08c4e3a5ba85c4be54430e8ccde2c03ef8f55b"}
Jul 16 00:26:33.525678 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.525649    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645387981744"
Jul 16 00:26:33.560936 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.560894    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7251-139645387981744_82cf1327-d33f-4108-8ca1-c70aadf80fbb/test-curl-7251-139645387981744/0.log"
Jul 16 00:26:33.594194 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.594159    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7251-139645387981744"]
Jul 16 00:26:33.599102 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.599074    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7251-139645387981744"]
Jul 16 00:26:33.674532 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.674436    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t87d\" (UniqueName: \"kubernetes.io/projected/82cf1327-d33f-4108-8ca1-c70aadf80fbb-kube-api-access-2t87d\") pod \"82cf1327-d33f-4108-8ca1-c70aadf80fbb\" (UID: \"82cf1327-d33f-4108-8ca1-c70aadf80fbb\") "
Jul 16 00:26:33.676663 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.676588    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82cf1327-d33f-4108-8ca1-c70aadf80fbb-kube-api-access-2t87d" (OuterVolumeSpecName: "kube-api-access-2t87d") pod "82cf1327-d33f-4108-8ca1-c70aadf80fbb" (UID: "82cf1327-d33f-4108-8ca1-c70aadf80fbb"). InnerVolumeSpecName "kube-api-access-2t87d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:26:33.769983 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.769951    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:33.770395 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.770383    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cf1327-d33f-4108-8ca1-c70aadf80fbb" containerName="test-curl-7251-139645387981744"
Jul 16 00:26:33.770454 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.770397    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cf1327-d33f-4108-8ca1-c70aadf80fbb" containerName="test-curl-7251-139645387981744"
Jul 16 00:26:33.770490 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.770470    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="82cf1327-d33f-4108-8ca1-c70aadf80fbb" containerName="test-curl-7251-139645387981744"
Jul 16 00:26:33.773686 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.773667    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:33.776211 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.776190    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t87d\" (UniqueName: \"kubernetes.io/projected/82cf1327-d33f-4108-8ca1-c70aadf80fbb-kube-api-access-2t87d\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:26:33.787012 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.786983    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:33.877458 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.877421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrcl5\" (UniqueName: \"kubernetes.io/projected/a2d78d2b-ad61-4747-b84e-f057545edf4b-kube-api-access-hrcl5\") pod \"test-curl-7251-139645388385568\" (UID: \"a2d78d2b-ad61-4747-b84e-f057545edf4b\") " pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:33.978949 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.978861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrcl5\" (UniqueName: \"kubernetes.io/projected/a2d78d2b-ad61-4747-b84e-f057545edf4b-kube-api-access-hrcl5\") pod \"test-curl-7251-139645388385568\" (UID: \"a2d78d2b-ad61-4747-b84e-f057545edf4b\") " pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:33.988449 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:33.988423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrcl5\" (UniqueName: \"kubernetes.io/projected/a2d78d2b-ad61-4747-b84e-f057545edf4b-kube-api-access-hrcl5\") pod \"test-curl-7251-139645388385568\" (UID: \"a2d78d2b-ad61-4747-b84e-f057545edf4b\") " pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:34.083586 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:34.083549    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:34.190556 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:34.190509    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82cf1327-d33f-4108-8ca1-c70aadf80fbb" path="/var/lib/kubelet/pods/82cf1327-d33f-4108-8ca1-c70aadf80fbb/volumes"
Jul 16 00:26:34.231459 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:34.231430    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:34.231674 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:26:34.231649    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2d78d2b_ad61_4747_b84e_f057545edf4b.slice/crio-4f63d32870e9d9206b38a3d8113ec93b70fb247306d8862bb39702ca9a2d2eb4 WatchSource:0}: Error finding container 4f63d32870e9d9206b38a3d8113ec93b70fb247306d8862bb39702ca9a2d2eb4: Status 404 returned error can't find the container with id 4f63d32870e9d9206b38a3d8113ec93b70fb247306d8862bb39702ca9a2d2eb4
Jul 16 00:26:34.393406 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:34.393359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645388385568" event={"ID":"a2d78d2b-ad61-4747-b84e-f057545edf4b","Type":"ContainerStarted","Data":"4f63d32870e9d9206b38a3d8113ec93b70fb247306d8862bb39702ca9a2d2eb4"}
Jul 16 00:26:34.394616 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:34.394586    2576 scope.go:117] "RemoveContainer" containerID="adafa4b9bf26d5dea9c1e1ed0a08c4e3a5ba85c4be54430e8ccde2c03ef8f55b"
Jul 16 00:26:34.394723 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:34.394658    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645387981744"
Jul 16 00:26:35.402167 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:35.402129    2576 generic.go:356] "Generic (PLEG): container finished" podID="a2d78d2b-ad61-4747-b84e-f057545edf4b" containerID="ade44c342dfd31e04f15a088ee570864379f3f549736f5fa417c0802eb9d0f7b" exitCode=0
Jul 16 00:26:35.402557 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:35.402208    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645388385568" event={"ID":"a2d78d2b-ad61-4747-b84e-f057545edf4b","Type":"ContainerDied","Data":"ade44c342dfd31e04f15a088ee570864379f3f549736f5fa417c0802eb9d0f7b"}
Jul 16 00:26:36.566241 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.566214    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:36.592975 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.592946    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7251-139645388385568_a2d78d2b-ad61-4747-b84e-f057545edf4b/test-curl-7251-139645388385568/0.log"
Jul 16 00:26:36.623776 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.623742    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:36.630710 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.630684    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:36.705957 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.705857    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrcl5\" (UniqueName: \"kubernetes.io/projected/a2d78d2b-ad61-4747-b84e-f057545edf4b-kube-api-access-hrcl5\") pod \"a2d78d2b-ad61-4747-b84e-f057545edf4b\" (UID: \"a2d78d2b-ad61-4747-b84e-f057545edf4b\") "
Jul 16 00:26:36.708058 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.708020    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2d78d2b-ad61-4747-b84e-f057545edf4b-kube-api-access-hrcl5" (OuterVolumeSpecName: "kube-api-access-hrcl5") pod "a2d78d2b-ad61-4747-b84e-f057545edf4b" (UID: "a2d78d2b-ad61-4747-b84e-f057545edf4b"). InnerVolumeSpecName "kube-api-access-hrcl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:26:36.753551 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.753512    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:36.753950 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.753935    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2d78d2b-ad61-4747-b84e-f057545edf4b" containerName="test-curl-7251-139645388385568"
Jul 16 00:26:36.753997 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.753951    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2d78d2b-ad61-4747-b84e-f057545edf4b" containerName="test-curl-7251-139645388385568"
Jul 16 00:26:36.754032 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.754023    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2d78d2b-ad61-4747-b84e-f057545edf4b" containerName="test-curl-7251-139645388385568"
Jul 16 00:26:36.757066 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.757040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:36.765441 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.765419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:36.806925 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.806894    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrcl5\" (UniqueName: \"kubernetes.io/projected/a2d78d2b-ad61-4747-b84e-f057545edf4b-kube-api-access-hrcl5\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:26:36.907930 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:36.907878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47xr7\" (UniqueName: \"kubernetes.io/projected/410b1f30-b882-42f2-8fb0-bc4dc771704c-kube-api-access-47xr7\") pod \"test-curl-7251-139645388385568\" (UID: \"410b1f30-b882-42f2-8fb0-bc4dc771704c\") " pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:37.008545 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:37.008440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47xr7\" (UniqueName: \"kubernetes.io/projected/410b1f30-b882-42f2-8fb0-bc4dc771704c-kube-api-access-47xr7\") pod \"test-curl-7251-139645388385568\" (UID: \"410b1f30-b882-42f2-8fb0-bc4dc771704c\") " pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:37.017703 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:37.017669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47xr7\" (UniqueName: \"kubernetes.io/projected/410b1f30-b882-42f2-8fb0-bc4dc771704c-kube-api-access-47xr7\") pod \"test-curl-7251-139645388385568\" (UID: \"410b1f30-b882-42f2-8fb0-bc4dc771704c\") " pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:37.067939 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:37.067904    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:37.208695 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:37.208663    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:37.209414 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:26:37.209382    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod410b1f30_b882_42f2_8fb0_bc4dc771704c.slice/crio-2bcda3c86143e1a8b02332772ef0406c406a8cb57f2db7b8e0d46e2895a42613 WatchSource:0}: Error finding container 2bcda3c86143e1a8b02332772ef0406c406a8cb57f2db7b8e0d46e2895a42613: Status 404 returned error can't find the container with id 2bcda3c86143e1a8b02332772ef0406c406a8cb57f2db7b8e0d46e2895a42613
Jul 16 00:26:37.415422 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:37.415386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645388385568" event={"ID":"410b1f30-b882-42f2-8fb0-bc4dc771704c","Type":"ContainerStarted","Data":"2bcda3c86143e1a8b02332772ef0406c406a8cb57f2db7b8e0d46e2895a42613"}
Jul 16 00:26:37.416777 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:37.416755    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f63d32870e9d9206b38a3d8113ec93b70fb247306d8862bb39702ca9a2d2eb4"
Jul 16 00:26:37.416777 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:37.416775    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:37.429899 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:37.429864    2576 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7251-139645388385568" oldPodUID="a2d78d2b-ad61-4747-b84e-f057545edf4b" podUID="410b1f30-b882-42f2-8fb0-bc4dc771704c"
Jul 16 00:26:38.188507 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:38.188475    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2d78d2b-ad61-4747-b84e-f057545edf4b" path="/var/lib/kubelet/pods/a2d78d2b-ad61-4747-b84e-f057545edf4b/volumes"
Jul 16 00:26:38.423501 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:38.423466    2576 generic.go:356] "Generic (PLEG): container finished" podID="410b1f30-b882-42f2-8fb0-bc4dc771704c" containerID="1fc7387d6cbe91a6b31506992ccb989630dfde877a9d3f8df4bd98db448eb7a1" exitCode=0
Jul 16 00:26:38.423709 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:38.423519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645388385568" event={"ID":"410b1f30-b882-42f2-8fb0-bc4dc771704c","Type":"ContainerDied","Data":"1fc7387d6cbe91a6b31506992ccb989630dfde877a9d3f8df4bd98db448eb7a1"}
Jul 16 00:26:39.582409 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.582383    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:39.614182 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.614151    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7251-139645388385568_410b1f30-b882-42f2-8fb0-bc4dc771704c/test-curl-7251-139645388385568/0.log"
Jul 16 00:26:39.644482 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.644445    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:39.652806 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.652778    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7251-139645388385568"]
Jul 16 00:26:39.734323 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.734221    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47xr7\" (UniqueName: \"kubernetes.io/projected/410b1f30-b882-42f2-8fb0-bc4dc771704c-kube-api-access-47xr7\") pod \"410b1f30-b882-42f2-8fb0-bc4dc771704c\" (UID: \"410b1f30-b882-42f2-8fb0-bc4dc771704c\") "
Jul 16 00:26:39.736285 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.736261    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410b1f30-b882-42f2-8fb0-bc4dc771704c-kube-api-access-47xr7" (OuterVolumeSpecName: "kube-api-access-47xr7") pod "410b1f30-b882-42f2-8fb0-bc4dc771704c" (UID: "410b1f30-b882-42f2-8fb0-bc4dc771704c"). InnerVolumeSpecName "kube-api-access-47xr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:26:39.800461 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.800425    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7251-139645388456272"]
Jul 16 00:26:39.800895 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.800881    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="410b1f30-b882-42f2-8fb0-bc4dc771704c" containerName="test-curl-7251-139645388385568"
Jul 16 00:26:39.800946 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.800896    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="410b1f30-b882-42f2-8fb0-bc4dc771704c" containerName="test-curl-7251-139645388385568"
Jul 16 00:26:39.800989 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.800978    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="410b1f30-b882-42f2-8fb0-bc4dc771704c" containerName="test-curl-7251-139645388385568"
Jul 16 00:26:39.804177 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.804159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388456272"
Jul 16 00:26:39.813876 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.813852    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645388456272"]
Jul 16 00:26:39.835408 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.835372    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47xr7\" (UniqueName: \"kubernetes.io/projected/410b1f30-b882-42f2-8fb0-bc4dc771704c-kube-api-access-47xr7\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:26:39.936439 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:39.936402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f56x4\" (UniqueName: \"kubernetes.io/projected/a61f254b-551d-49a0-b4fc-c91480431cba-kube-api-access-f56x4\") pod \"test-curl-7251-139645388456272\" (UID: \"a61f254b-551d-49a0-b4fc-c91480431cba\") " pod="opendatahub/test-curl-7251-139645388456272"
Jul 16 00:26:40.037429 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:40.037328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f56x4\" (UniqueName: \"kubernetes.io/projected/a61f254b-551d-49a0-b4fc-c91480431cba-kube-api-access-f56x4\") pod \"test-curl-7251-139645388456272\" (UID: \"a61f254b-551d-49a0-b4fc-c91480431cba\") " pod="opendatahub/test-curl-7251-139645388456272"
Jul 16 00:26:40.046772 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:40.046739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f56x4\" (UniqueName: \"kubernetes.io/projected/a61f254b-551d-49a0-b4fc-c91480431cba-kube-api-access-f56x4\") pod \"test-curl-7251-139645388456272\" (UID: \"a61f254b-551d-49a0-b4fc-c91480431cba\") " pod="opendatahub/test-curl-7251-139645388456272"
Jul 16 00:26:40.113810 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:40.113755    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388456272"
Jul 16 00:26:40.188492 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:40.188458    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410b1f30-b882-42f2-8fb0-bc4dc771704c" path="/var/lib/kubelet/pods/410b1f30-b882-42f2-8fb0-bc4dc771704c/volumes"
Jul 16 00:26:40.271886 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:40.271861    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7251-139645388456272"]
Jul 16 00:26:40.273543 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:26:40.273520    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda61f254b_551d_49a0_b4fc_c91480431cba.slice/crio-f0afbf7ade5885644020351711d2c9727d36f848c810382c191f231e581f34a1 WatchSource:0}: Error finding container f0afbf7ade5885644020351711d2c9727d36f848c810382c191f231e581f34a1: Status 404 returned error can't find the container with id f0afbf7ade5885644020351711d2c9727d36f848c810382c191f231e581f34a1
Jul 16 00:26:40.436759 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:40.436725    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388385568"
Jul 16 00:26:40.436948 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:40.436768    2576 scope.go:117] "RemoveContainer" containerID="1fc7387d6cbe91a6b31506992ccb989630dfde877a9d3f8df4bd98db448eb7a1"
Jul 16 00:26:40.438192 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:40.438168    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645388456272" event={"ID":"a61f254b-551d-49a0-b4fc-c91480431cba","Type":"ContainerStarted","Data":"f0afbf7ade5885644020351711d2c9727d36f848c810382c191f231e581f34a1"}
Jul 16 00:26:41.447645 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:41.447581    2576 generic.go:356] "Generic (PLEG): container finished" podID="a61f254b-551d-49a0-b4fc-c91480431cba" containerID="0b3d9824535a28d2b4b001df20ee8073a0deddf4062fc7752b86af3a994ef42c" exitCode=0
Jul 16 00:26:41.448133 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:41.447664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7251-139645388456272" event={"ID":"a61f254b-551d-49a0-b4fc-c91480431cba","Type":"ContainerDied","Data":"0b3d9824535a28d2b4b001df20ee8073a0deddf4062fc7752b86af3a994ef42c"}
Jul 16 00:26:42.598210 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:42.598184    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388456272"
Jul 16 00:26:42.640128 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:42.640097    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7251-139645388456272_a61f254b-551d-49a0-b4fc-c91480431cba/test-curl-7251-139645388456272/0.log"
Jul 16 00:26:42.678211 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:42.678174    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7251-139645388456272"]
Jul 16 00:26:42.680491 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:42.680467    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7251-139645388456272"]
Jul 16 00:26:42.765671 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:42.765547    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f56x4\" (UniqueName: \"kubernetes.io/projected/a61f254b-551d-49a0-b4fc-c91480431cba-kube-api-access-f56x4\") pod \"a61f254b-551d-49a0-b4fc-c91480431cba\" (UID: \"a61f254b-551d-49a0-b4fc-c91480431cba\") "
Jul 16 00:26:42.767609 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:42.767579    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a61f254b-551d-49a0-b4fc-c91480431cba-kube-api-access-f56x4" (OuterVolumeSpecName: "kube-api-access-f56x4") pod "a61f254b-551d-49a0-b4fc-c91480431cba" (UID: "a61f254b-551d-49a0-b4fc-c91480431cba"). InnerVolumeSpecName "kube-api-access-f56x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:26:42.866554 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:42.866517    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f56x4\" (UniqueName: \"kubernetes.io/projected/a61f254b-551d-49a0-b4fc-c91480431cba-kube-api-access-f56x4\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:26:43.462450 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:43.462419    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7251-139645388456272"
Jul 16 00:26:43.462450 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:43.462449    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0afbf7ade5885644020351711d2c9727d36f848c810382c191f231e581f34a1"
Jul 16 00:26:43.472910 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:26:43.472877    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7251-139645388456272\" is forbidden: User \"system:node:ip-10-0-140-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-110.ec2.internal' and this object" podUID="a61f254b-551d-49a0-b4fc-c91480431cba" pod="opendatahub/test-curl-7251-139645388456272"
Jul 16 00:26:44.187856 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:26:44.187811    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a61f254b-551d-49a0-b4fc-c91480431cba" path="/var/lib/kubelet/pods/a61f254b-551d-49a0-b4fc-c91480431cba/volumes"
Jul 16 00:27:03.108205 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:03.108172    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"]
Jul 16 00:27:03.108756 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:03.108382    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy" containerID="cri-o://734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3" gracePeriod=30
Jul 16 00:27:03.787218 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:03.787183    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58f9d87bcb-f5xvh_adcdd6d6-2cd2-4551-b766-64c1ecd93fb1/authorino/0.log"
Jul 16 00:27:07.460774 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:07.460738    2576 patch_prober.go:28] interesting pod/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 00:27:07.461286 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:07.460804    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 00:27:08.372115 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.372060    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:27:08.496728 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.496681    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-envoy\") pod \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") "
Jul 16 00:27:08.496728 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.496736    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-data\") pod \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") "
Jul 16 00:27:08.497271 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.496789    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-socket\") pod \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") "
Jul 16 00:27:08.497271 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.496817    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-podinfo\") pod \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") "
Jul 16 00:27:08.497271 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.496852    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istiod-ca-cert\") pod \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") "
Jul 16 00:27:08.497271 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.496881    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-token\") pod \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") "
Jul 16 00:27:08.497271 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.496924    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr4ls\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-kube-api-access-jr4ls\") pod \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") "
Jul 16 00:27:08.497271 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.496997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-credential-socket\") pod \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") "
Jul 16 00:27:08.497271 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.497047    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-certs\") pod \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\" (UID: \"dfa4818e-31b0-46a5-9854-fa4b99a53cba\") "
Jul 16 00:27:08.497271 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.497102    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfa4818e-31b0-46a5-9854-fa4b99a53cba" (UID: "dfa4818e-31b0-46a5-9854-fa4b99a53cba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:27:08.497665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.497315    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfa4818e-31b0-46a5-9854-fa4b99a53cba" (UID: "dfa4818e-31b0-46a5-9854-fa4b99a53cba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:27:08.497665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.497368    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-socket\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:27:08.497665 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.497363    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfa4818e-31b0-46a5-9854-fa4b99a53cba" (UID: "dfa4818e-31b0-46a5-9854-fa4b99a53cba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:27:08.497844 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.497700    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfa4818e-31b0-46a5-9854-fa4b99a53cba" (UID: "dfa4818e-31b0-46a5-9854-fa4b99a53cba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:27:08.497905 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.497877    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfa4818e-31b0-46a5-9854-fa4b99a53cba" (UID: "dfa4818e-31b0-46a5-9854-fa4b99a53cba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:27:08.499156 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.499119    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfa4818e-31b0-46a5-9854-fa4b99a53cba" (UID: "dfa4818e-31b0-46a5-9854-fa4b99a53cba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:27:08.499274 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.499165    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfa4818e-31b0-46a5-9854-fa4b99a53cba" (UID: "dfa4818e-31b0-46a5-9854-fa4b99a53cba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 00:27:08.499274 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.499196    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-kube-api-access-jr4ls" (OuterVolumeSpecName: "kube-api-access-jr4ls") pod "dfa4818e-31b0-46a5-9854-fa4b99a53cba" (UID: "dfa4818e-31b0-46a5-9854-fa4b99a53cba"). InnerVolumeSpecName "kube-api-access-jr4ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:27:08.499352 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.499281    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfa4818e-31b0-46a5-9854-fa4b99a53cba" (UID: "dfa4818e-31b0-46a5-9854-fa4b99a53cba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:27:08.598721 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.598686    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-podinfo\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:27:08.598721 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.598714    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istiod-ca-cert\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:27:08.598721 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.598723    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-token\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:27:08.598953 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.598731    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr4ls\" (UniqueName: \"kubernetes.io/projected/dfa4818e-31b0-46a5-9854-fa4b99a53cba-kube-api-access-jr4ls\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:27:08.598953 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.598742    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-credential-socket\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:27:08.598953 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.598750    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-workload-certs\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:27:08.598953 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.598759    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-envoy\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:27:08.598953 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.598766    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4818e-31b0-46a5-9854-fa4b99a53cba-istio-data\") on node \"ip-10-0-140-110.ec2.internal\" DevicePath \"\""
Jul 16 00:27:08.623191 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.623103    2576 generic.go:356] "Generic (PLEG): container finished" podID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerID="734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3" exitCode=0
Jul 16 00:27:08.623191 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.623159    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"
Jul 16 00:27:08.623191 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.623183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" event={"ID":"dfa4818e-31b0-46a5-9854-fa4b99a53cba","Type":"ContainerDied","Data":"734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3"}
Jul 16 00:27:08.623459 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.623237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l" event={"ID":"dfa4818e-31b0-46a5-9854-fa4b99a53cba","Type":"ContainerDied","Data":"e5dadcb041e92b126b936bf7a79b72760edb0b660bd0d9921451214e258124d5"}
Jul 16 00:27:08.623459 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.623269    2576 scope.go:117] "RemoveContainer" containerID="734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3"
Jul 16 00:27:08.633089 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.633066    2576 scope.go:117] "RemoveContainer" containerID="e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460"
Jul 16 00:27:08.641470 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.641453    2576 scope.go:117] "RemoveContainer" containerID="734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3"
Jul 16 00:27:08.641834 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:27:08.641803    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3\": container with ID starting with 734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3 not found: ID does not exist" containerID="734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3"
Jul 16 00:27:08.641931 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.641844    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3"} err="failed to get container status \"734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3\": rpc error: code = NotFound desc = could not find container \"734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3\": container with ID starting with 734081718d6257548fc102e6e719656d52b435e6092a38377fbe3971573b13d3 not found: ID does not exist"
Jul 16 00:27:08.641931 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.641868    2576 scope.go:117] "RemoveContainer" containerID="e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460"
Jul 16 00:27:08.642149 ip-10-0-140-110 kubenswrapper[2576]: E0716 00:27:08.642127    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460\": container with ID starting with e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460 not found: ID does not exist" containerID="e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460"
Jul 16 00:27:08.642194 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.642154    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460"} err="failed to get container status \"e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460\": rpc error: code = NotFound desc = could not find container \"e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460\": container with ID starting with e553f9efb55fef4be25e28e6c97e2514e537b0e31683dcf5bc0e8fa2ac98f460 not found: ID does not exist"
Jul 16 00:27:08.664594 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.664571    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"]
Jul 16 00:27:08.667132 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:08.667108    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c688a9-openshift-default-bfb69978c-2mc9l"]
Jul 16 00:27:09.599534 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:09.599500    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kkvj4_5da6dde6-5159-42e8-be68-e7ea7e3569ad/manager/0.log"
Jul 16 00:27:09.734482 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:09.734451    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-k99b6_4d0d2432-bbb9-4875-bb46-5f6444a02c29/manager/0.log"
Jul 16 00:27:09.884432 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:09.884357    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67c79c5bd5-6vptz_1422ba92-d912-4dbe-ae7b-05eb706d3043/manager/0.log"
Jul 16 00:27:10.153849 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:10.153820    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2mm67_53f83ad8-d610-41c9-a230-db8bb149dbe0/manager/0.log"
Jul 16 00:27:10.188110 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:10.188065    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" path="/var/lib/kubelet/pods/dfa4818e-31b0-46a5-9854-fa4b99a53cba/volumes"
Jul 16 00:27:10.282649 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:10.282619    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b4446c48-c45tz_6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb/copy-manifests/0.log"
Jul 16 00:27:10.316595 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:10.316565    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b4446c48-c45tz_6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb/manager/0.log"
Jul 16 00:27:11.079154 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:11.079125    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-689b9d8676-6jnqt_7311baa8-d674-4aab-a357-6290cacbe5b7/maas-api/0.log"
Jul 16 00:27:13.136019 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:13.135989    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4rkfp_139bf852-9dd4-452c-aed3-31a5fefb85d4/postgres/0.log"
Jul 16 00:27:13.939903 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:13.939869    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg_7b3a5d3d-004d-4ca2-8264-0d5df9402d0f/util/0.log"
Jul 16 00:27:13.950658 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:13.950627    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg_7b3a5d3d-004d-4ca2-8264-0d5df9402d0f/pull/0.log"
Jul 16 00:27:13.958977 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:13.958951    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg_7b3a5d3d-004d-4ca2-8264-0d5df9402d0f/extract/0.log"
Jul 16 00:27:14.091111 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.091077    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt_749d2926-7925-4e79-b0db-ed575618f5a4/util/0.log"
Jul 16 00:27:14.099716 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.099688    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt_749d2926-7925-4e79-b0db-ed575618f5a4/pull/0.log"
Jul 16 00:27:14.108427 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.108402    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt_749d2926-7925-4e79-b0db-ed575618f5a4/extract/0.log"
Jul 16 00:27:14.229189 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.229107    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk_df33f5d7-09ed-4135-a209-edc1b34e7117/util/0.log"
Jul 16 00:27:14.239592 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.239566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk_df33f5d7-09ed-4135-a209-edc1b34e7117/pull/0.log"
Jul 16 00:27:14.247326 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.247298    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk_df33f5d7-09ed-4135-a209-edc1b34e7117/extract/0.log"
Jul 16 00:27:14.369384 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.369355    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs_13990d74-b3aa-4881-a85a-4ce64573add0/util/0.log"
Jul 16 00:27:14.382234 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.382209    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs_13990d74-b3aa-4881-a85a-4ce64573add0/pull/0.log"
Jul 16 00:27:14.396811 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.396784    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs_13990d74-b3aa-4881-a85a-4ce64573add0/extract/0.log"
Jul 16 00:27:14.529235 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.529151    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58f9d87bcb-f5xvh_adcdd6d6-2cd2-4551-b766-64c1ecd93fb1/authorino/0.log"
Jul 16 00:27:14.660721 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.660686    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kf5dh_2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc/manager/0.log"
Jul 16 00:27:14.910168 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:14.910140    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mdkss_ce458c4f-14d7-4d5e-b44b-81ccd86d28f4/kuadrant-console-plugin/0.log"
Jul 16 00:27:15.040183 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:15.040149    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lvptw_3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0/registry-server/0.log"
Jul 16 00:27:15.189090 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:15.188994    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-w4mwh_bf91712e-1bd5-4a71-9434-db0256cabe32/manager/0.log"
Jul 16 00:27:16.086794 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:16.086766    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797ddd4965-5w98x_d8e7bd56-d384-4f16-a015-689b9bc9d12b/kube-auth-proxy/0.log"
Jul 16 00:27:16.332333 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:16.332302    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxh2p_6ddcaa21-41ef-41a3-836c-dbda32baa60b/istio-proxy/1.log"
Jul 16 00:27:16.466760 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:16.466723    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5mplf_d7718a10-e241-452b-9b1a-375301e9c29a/payload-pre-processing/0.log"
Jul 16 00:27:16.603917 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:16.603884    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-x2c2v_94db9a76-6a8c-4d36-bf6d-73060af86981/payload-processing/0.log"
Jul 16 00:27:17.069873 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:17.069843    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mfwst_cc948fbd-b3b3-45ce-9fd7-13b9848121fb/main/0.log"
Jul 16 00:27:17.193548 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:17.193519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-pjbd6_b517b1c1-9926-46f8-93fa-51c3e6aa763f/main/0.log"
Jul 16 00:27:17.303297 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:17.303267    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pgcwb_30ae3c91-7994-45dd-80b3-157d7346321b/main/0.log"
Jul 16 00:27:17.533237 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:17.533206    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-jjfkc_ffd60ae6-f9bd-4f0d-b38e-667493f8c3fc/main/0.log"
Jul 16 00:27:20.310980 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:20.310950    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:27:20.319922 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:20.319903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ztgd_e67d1976-528e-4da7-a090-1adf0805ca78/ovn-acl-logging/0.log"
Jul 16 00:27:23.591275 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591242    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9plpw/must-gather-b2l75"]
Jul 16 00:27:23.591756 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591740    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy"
Jul 16 00:27:23.591756 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591758    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy"
Jul 16 00:27:23.591834 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591767    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy"
Jul 16 00:27:23.591834 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591773    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy"
Jul 16 00:27:23.591834 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591781    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a61f254b-551d-49a0-b4fc-c91480431cba" containerName="test-curl-7251-139645388456272"
Jul 16 00:27:23.591834 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591787    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a61f254b-551d-49a0-b4fc-c91480431cba" containerName="test-curl-7251-139645388456272"
Jul 16 00:27:23.591961 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591858    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a61f254b-551d-49a0-b4fc-c91480431cba" containerName="test-curl-7251-139645388456272"
Jul 16 00:27:23.591961 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591866    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy"
Jul 16 00:27:23.591961 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.591875    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa4818e-31b0-46a5-9854-fa4b99a53cba" containerName="istio-proxy"
Jul 16 00:27:23.596813 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.596792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9plpw/must-gather-b2l75"
Jul 16 00:27:23.599500 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.599481    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9plpw\"/\"default-dockercfg-2clp9\""
Jul 16 00:27:23.599878 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.599856    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9plpw\"/\"kube-root-ca.crt\""
Jul 16 00:27:23.599992 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.599890    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9plpw\"/\"openshift-service-ca.crt\""
Jul 16 00:27:23.615265 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.615237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9plpw/must-gather-b2l75"]
Jul 16 00:27:23.743972 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.743933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7556bdc5-9a91-4510-8a73-dcfaabf4cd84-must-gather-output\") pod \"must-gather-b2l75\" (UID: \"7556bdc5-9a91-4510-8a73-dcfaabf4cd84\") " pod="openshift-must-gather-9plpw/must-gather-b2l75"
Jul 16 00:27:23.744171 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.744022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvtbj\" (UniqueName: \"kubernetes.io/projected/7556bdc5-9a91-4510-8a73-dcfaabf4cd84-kube-api-access-lvtbj\") pod \"must-gather-b2l75\" (UID: \"7556bdc5-9a91-4510-8a73-dcfaabf4cd84\") " pod="openshift-must-gather-9plpw/must-gather-b2l75"
Jul 16 00:27:23.845117 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.845009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7556bdc5-9a91-4510-8a73-dcfaabf4cd84-must-gather-output\") pod \"must-gather-b2l75\" (UID: \"7556bdc5-9a91-4510-8a73-dcfaabf4cd84\") " pod="openshift-must-gather-9plpw/must-gather-b2l75"
Jul 16 00:27:23.845117 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.845084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvtbj\" (UniqueName: \"kubernetes.io/projected/7556bdc5-9a91-4510-8a73-dcfaabf4cd84-kube-api-access-lvtbj\") pod \"must-gather-b2l75\" (UID: \"7556bdc5-9a91-4510-8a73-dcfaabf4cd84\") " pod="openshift-must-gather-9plpw/must-gather-b2l75"
Jul 16 00:27:23.845350 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.845329    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7556bdc5-9a91-4510-8a73-dcfaabf4cd84-must-gather-output\") pod \"must-gather-b2l75\" (UID: \"7556bdc5-9a91-4510-8a73-dcfaabf4cd84\") " pod="openshift-must-gather-9plpw/must-gather-b2l75"
Jul 16 00:27:23.868332 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.868308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvtbj\" (UniqueName: \"kubernetes.io/projected/7556bdc5-9a91-4510-8a73-dcfaabf4cd84-kube-api-access-lvtbj\") pod \"must-gather-b2l75\" (UID: \"7556bdc5-9a91-4510-8a73-dcfaabf4cd84\") " pod="openshift-must-gather-9plpw/must-gather-b2l75"
Jul 16 00:27:23.906292 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:23.906264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9plpw/must-gather-b2l75"
Jul 16 00:27:24.077931 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:24.077827    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9plpw/must-gather-b2l75"]
Jul 16 00:27:24.081282 ip-10-0-140-110 kubenswrapper[2576]: W0716 00:27:24.081255    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7556bdc5_9a91_4510_8a73_dcfaabf4cd84.slice/crio-2c4d3a6b62b4bd75730866ad5af8574dbba0f79375e5801d950f4b945bddbf38 WatchSource:0}: Error finding container 2c4d3a6b62b4bd75730866ad5af8574dbba0f79375e5801d950f4b945bddbf38: Status 404 returned error can't find the container with id 2c4d3a6b62b4bd75730866ad5af8574dbba0f79375e5801d950f4b945bddbf38
Jul 16 00:27:24.720739 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:24.720697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9plpw/must-gather-b2l75" event={"ID":"7556bdc5-9a91-4510-8a73-dcfaabf4cd84","Type":"ContainerStarted","Data":"2c4d3a6b62b4bd75730866ad5af8574dbba0f79375e5801d950f4b945bddbf38"}
Jul 16 00:27:25.733013 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:25.732975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9plpw/must-gather-b2l75" event={"ID":"7556bdc5-9a91-4510-8a73-dcfaabf4cd84","Type":"ContainerStarted","Data":"71b7c59b535f23fadad5273122d8e6eac5781dd8ccd90c052f88c0397ad03039"}
Jul 16 00:27:25.733594 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:25.733570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9plpw/must-gather-b2l75" event={"ID":"7556bdc5-9a91-4510-8a73-dcfaabf4cd84","Type":"ContainerStarted","Data":"672cf745a67db1ac2473c062f91970f64b7782b9416a8d97550815ccc361707b"}
Jul 16 00:27:26.667885 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:26.667838    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r8zt8_65f72dc6-a50b-4bd4-a8e7-58d1fc98badb/global-pull-secret-syncer/0.log"
Jul 16 00:27:26.958705 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:26.958624    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vgndt_27e33601-f83b-41e7-a5da-adba4ff5326f/konnectivity-agent/0.log"
Jul 16 00:27:27.036481 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:27.036451    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-110.ec2.internal_d83b6c4466b41c709fe7423fe0495f53/haproxy/0.log"
Jul 16 00:27:31.515516 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.515466    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg_7b3a5d3d-004d-4ca2-8264-0d5df9402d0f/extract/0.log"
Jul 16 00:27:31.543797 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.543771    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg_7b3a5d3d-004d-4ca2-8264-0d5df9402d0f/util/0.log"
Jul 16 00:27:31.573393 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.573368    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595jwqg_7b3a5d3d-004d-4ca2-8264-0d5df9402d0f/pull/0.log"
Jul 16 00:27:31.619168 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.619139    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt_749d2926-7925-4e79-b0db-ed575618f5a4/extract/0.log"
Jul 16 00:27:31.656899 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.656852    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt_749d2926-7925-4e79-b0db-ed575618f5a4/util/0.log"
Jul 16 00:27:31.695427 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.695395    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g4zmt_749d2926-7925-4e79-b0db-ed575618f5a4/pull/0.log"
Jul 16 00:27:31.738224 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.738198    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk_df33f5d7-09ed-4135-a209-edc1b34e7117/extract/0.log"
Jul 16 00:27:31.769733 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.769645    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk_df33f5d7-09ed-4135-a209-edc1b34e7117/util/0.log"
Jul 16 00:27:31.821544 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.821505    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kqbfk_df33f5d7-09ed-4135-a209-edc1b34e7117/pull/0.log"
Jul 16 00:27:31.858366 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.858333    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs_13990d74-b3aa-4881-a85a-4ce64573add0/extract/0.log"
Jul 16 00:27:31.884589 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.884558    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs_13990d74-b3aa-4881-a85a-4ce64573add0/util/0.log"
Jul 16 00:27:31.914125 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:31.914092    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kqcvs_13990d74-b3aa-4881-a85a-4ce64573add0/pull/0.log"
Jul 16 00:27:32.543549 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:32.543513    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58f9d87bcb-f5xvh_adcdd6d6-2cd2-4551-b766-64c1ecd93fb1/authorino/0.log"
Jul 16 00:27:32.596755 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:32.596723    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kf5dh_2aaa9c51-67ff-4881-8bd9-4f9b7e329ffc/manager/0.log"
Jul 16 00:27:32.724185 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:32.724150    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mdkss_ce458c4f-14d7-4d5e-b44b-81ccd86d28f4/kuadrant-console-plugin/0.log"
Jul 16 00:27:32.814158 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:32.814064    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lvptw_3f7f58d7-2d5b-4e30-88c9-eea7ff8415f0/registry-server/0.log"
Jul 16 00:27:33.040074 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:33.040039    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-w4mwh_bf91712e-1bd5-4a71-9434-db0256cabe32/manager/0.log"
Jul 16 00:27:35.220574 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:35.220542    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-rwzct_5f8a3d21-8abc-460e-974d-4bcad36d7097/monitoring-plugin/0.log"
Jul 16 00:27:35.419869 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:35.419835    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxnwq_a3a4629c-c4dd-4249-a73a-edb405f843dd/node-exporter/0.log"
Jul 16 00:27:35.446263 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:35.446236    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxnwq_a3a4629c-c4dd-4249-a73a-edb405f843dd/kube-rbac-proxy/0.log"
Jul 16 00:27:35.478840 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:35.478755    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxnwq_a3a4629c-c4dd-4249-a73a-edb405f843dd/init-textfile/0.log"
Jul 16 00:27:35.854336 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:35.854258    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-wbf8x_1bd5c230-bc5d-493c-86f2-a257aa8779ca/prometheus-operator/0.log"
Jul 16 00:27:35.889444 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:35.889407    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-wbf8x_1bd5c230-bc5d-493c-86f2-a257aa8779ca/kube-rbac-proxy/0.log"
Jul 16 00:27:35.919929 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:35.919898    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-hqf4p_9c1a651f-75e4-4997-8b65-d147e5f7ff05/prometheus-operator-admission-webhook/0.log"
Jul 16 00:27:36.054787 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.054752    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd9697b54-rbhzl_bbf170af-ee49-4ee0-8f49-4a88b2bfb20e/thanos-query/0.log"
Jul 16 00:27:36.078376 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.078349    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd9697b54-rbhzl_bbf170af-ee49-4ee0-8f49-4a88b2bfb20e/kube-rbac-proxy-web/0.log"
Jul 16 00:27:36.106847 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.106770    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd9697b54-rbhzl_bbf170af-ee49-4ee0-8f49-4a88b2bfb20e/kube-rbac-proxy/0.log"
Jul 16 00:27:36.131360 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.131333    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd9697b54-rbhzl_bbf170af-ee49-4ee0-8f49-4a88b2bfb20e/prom-label-proxy/0.log"
Jul 16 00:27:36.157842 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.157809    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd9697b54-rbhzl_bbf170af-ee49-4ee0-8f49-4a88b2bfb20e/kube-rbac-proxy-rules/0.log"
Jul 16 00:27:36.180509 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.180477    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd9697b54-rbhzl_bbf170af-ee49-4ee0-8f49-4a88b2bfb20e/kube-rbac-proxy-metrics/0.log"
Jul 16 00:27:36.691079 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.691012    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9plpw/must-gather-b2l75" podStartSLOduration=12.866780403 podStartE2EDuration="13.690988144s" totalImagesPullingTime="824.207741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:27:25.758900241 +0000 UTC m=+2406.025497854" watchObservedRunningTime="2026-07-16 00:27:36.690988144 +0000 UTC m=+2416.957585759"
Jul 16 00:27:36.695415 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.695383    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"]
Jul 16 00:27:36.704202 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.704173    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.709018 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.708987    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"]
Jul 16 00:27:36.796056 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.796023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8szp\" (UniqueName: \"kubernetes.io/projected/39a7a069-37ba-41fd-a034-fde8afa537b1-kube-api-access-q8szp\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.796261 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.796084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-proc\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.796261 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.796211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-podres\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.796261 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.796255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-sys\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.796406 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.796298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-lib-modules\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.897950 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.897906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-podres\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.898137 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.897964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-sys\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.898137 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.898004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-lib-modules\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.898137 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.898116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-podres\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.898320 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.898143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8szp\" (UniqueName: \"kubernetes.io/projected/39a7a069-37ba-41fd-a034-fde8afa537b1-kube-api-access-q8szp\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.898320 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.898170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-lib-modules\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.898320 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.898220    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-sys\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.898320 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.898225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-proc\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.898320 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.898263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39a7a069-37ba-41fd-a034-fde8afa537b1-proc\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:36.907979 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:36.907942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8szp\" (UniqueName: \"kubernetes.io/projected/39a7a069-37ba-41fd-a034-fde8afa537b1-kube-api-access-q8szp\") pod \"perf-node-gather-daemonset-2qpqm\" (UID: \"39a7a069-37ba-41fd-a034-fde8afa537b1\") " pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:37.020143 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:37.020052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:37.210031 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:37.209984    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"]
Jul 16 00:27:37.837867 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:37.837826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm" event={"ID":"39a7a069-37ba-41fd-a034-fde8afa537b1","Type":"ContainerStarted","Data":"dffe73a53a24db198f623c0d33782f402f3a72a5d94f90769d796b9b3e8943cb"}
Jul 16 00:27:37.838344 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:37.837893    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm" event={"ID":"39a7a069-37ba-41fd-a034-fde8afa537b1","Type":"ContainerStarted","Data":"7905f4e61699327f07f7f520ff2fa85484fae97c17c947b36d94097e2b3a6624"}
Jul 16 00:27:37.838839 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:37.838815    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:37.860008 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:37.859944    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm" podStartSLOduration=1.859922451 podStartE2EDuration="1.859922451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:27:37.856344092 +0000 UTC m=+2418.122941707" watchObservedRunningTime="2026-07-16 00:27:37.859922451 +0000 UTC m=+2418.126520066"
Jul 16 00:27:38.446881 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:38.446827    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b58c648cf-6w4cq_e05a6db6-ad5c-4697-b5f9-fc38be0768d1/console/0.log"
Jul 16 00:27:40.358845 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:40.358817    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z8gwr_c1d69480-9524-4755-b990-2126aa5d8f2f/dns/0.log"
Jul 16 00:27:40.383869 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:40.383840    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z8gwr_c1d69480-9524-4755-b990-2126aa5d8f2f/kube-rbac-proxy/0.log"
Jul 16 00:27:40.471171 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:40.471140    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sp624_65747fd6-6d9e-446e-b541-c163a45b1414/dns-node-resolver/0.log"
Jul 16 00:27:41.097439 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:41.097406    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86db6bdb55-flpz9_4514d8bb-98a6-45e6-af27-193be26b0dbe/registry/0.log"
Jul 16 00:27:41.185973 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:41.185943    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sq2n2_897f585f-c3d5-4d52-ab8f-1dd1b900f750/node-ca/0.log"
Jul 16 00:27:42.366117 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:42.366046    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797ddd4965-5w98x_d8e7bd56-d384-4f16-a015-689b9bc9d12b/kube-auth-proxy/0.log"
Jul 16 00:27:42.428336 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:42.428297    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxh2p_6ddcaa21-41ef-41a3-836c-dbda32baa60b/istio-proxy/0.log"
Jul 16 00:27:42.491858 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:42.491820    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxh2p_6ddcaa21-41ef-41a3-836c-dbda32baa60b/istio-proxy/1.log"
Jul 16 00:27:42.539663 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:42.539633    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5mplf_d7718a10-e241-452b-9b1a-375301e9c29a/payload-pre-processing/0.log"
Jul 16 00:27:42.592563 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:42.592532    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-x2c2v_94db9a76-6a8c-4d36-bf6d-73060af86981/payload-processing/0.log"
Jul 16 00:27:43.371843 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:43.371813    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gq2lm_90bf70d5-2d3e-4b42-8fd0-d55d7db967e8/serve-healthcheck-canary/0.log"
Jul 16 00:27:44.095842 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:44.095811    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pwgfb_91477475-8000-491f-806a-47df0f8e56b0/kube-rbac-proxy/0.log"
Jul 16 00:27:44.127476 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:44.127445    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pwgfb_91477475-8000-491f-806a-47df0f8e56b0/exporter/0.log"
Jul 16 00:27:44.179395 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:44.179368    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pwgfb_91477475-8000-491f-806a-47df0f8e56b0/extractor/0.log"
Jul 16 00:27:44.869156 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:44.869124    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9plpw/perf-node-gather-daemonset-2qpqm"
Jul 16 00:27:46.583822 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:46.583749    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kkvj4_5da6dde6-5159-42e8-be68-e7ea7e3569ad/manager/0.log"
Jul 16 00:27:46.860912 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:46.860878    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-k99b6_4d0d2432-bbb9-4875-bb46-5f6444a02c29/manager/0.log"
Jul 16 00:27:47.057491 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:47.057458    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67c79c5bd5-6vptz_1422ba92-d912-4dbe-ae7b-05eb706d3043/manager/0.log"
Jul 16 00:27:47.256050 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:47.256016    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797ddd4965-5w98x_d8e7bd56-d384-4f16-a015-689b9bc9d12b/kube-auth-proxy/0.log"
Jul 16 00:27:47.289292 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:47.289260    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2mm67_53f83ad8-d610-41c9-a230-db8bb149dbe0/manager/0.log"
Jul 16 00:27:47.343323 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:47.343288    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxh2p_6ddcaa21-41ef-41a3-836c-dbda32baa60b/istio-proxy/0.log"
Jul 16 00:27:47.443369 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:47.443315    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxh2p_6ddcaa21-41ef-41a3-836c-dbda32baa60b/istio-proxy/1.log"
Jul 16 00:27:47.478947 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:47.478870    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b4446c48-c45tz_6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb/manager/0.log"
Jul 16 00:27:47.492263 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:47.492234    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5mplf_d7718a10-e241-452b-9b1a-375301e9c29a/payload-pre-processing/0.log"
Jul 16 00:27:47.549106 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:47.549080    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-x2c2v_94db9a76-6a8c-4d36-bf6d-73060af86981/payload-processing/0.log"
Jul 16 00:27:47.583622 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:47.583577    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b4446c48-c45tz_6e7b9dc2-98d6-453f-b3e2-7b7c6584ecbb/copy-manifests/0.log"
Jul 16 00:27:48.999672 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:48.999641    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797ddd4965-5w98x_d8e7bd56-d384-4f16-a015-689b9bc9d12b/kube-auth-proxy/0.log"
Jul 16 00:27:49.064045 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:49.063995    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxh2p_6ddcaa21-41ef-41a3-836c-dbda32baa60b/istio-proxy/0.log"
Jul 16 00:27:49.123626 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:49.123582    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxh2p_6ddcaa21-41ef-41a3-836c-dbda32baa60b/istio-proxy/1.log"
Jul 16 00:27:49.173102 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:49.173068    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5mplf_d7718a10-e241-452b-9b1a-375301e9c29a/payload-pre-processing/0.log"
Jul 16 00:27:49.184281 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:49.184129    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-r2rwz_c6b0cea3-00b2-4c0c-beb3-55812cc4454d/openshift-lws-operator/0.log"
Jul 16 00:27:49.211484 ip-10-0-140-110 kubenswrapper[2576]: I0716 00:27:49.211447    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-x2c2v_94db9a76-6a8c-4d36-bf6d-73060af86981/payload-processing/0.log"