Jul 15 18:51:15.706570 ip-10-0-130-233 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.077656    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082085    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082098    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082103    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082108    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082112    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082117    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082124    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:51:16.174642 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082129    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:51:16.141816 ip-10-0-130-233 systemd[1]: Started Kubernetes Kubelet.
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082134    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082138    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082143    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082147    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082151    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082155    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082160    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082164    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082176    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082181    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082185    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082189    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082193    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082200    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082205    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082209    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082213    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082217    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:51:16.194336 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082222    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082225    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082230    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082234    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082238    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082241    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082245    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082249    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082253    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082257    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082261    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082265    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082269    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082273    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082290    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082294    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082298    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082302    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082313    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082318    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:51:16.206078 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082322    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082325    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082329    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082334    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082337    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082341    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082344    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082347    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082351    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082355    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082365    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082369    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082373    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082378    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082382    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082387    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082390    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082394    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082397    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:51:16.206771 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082401    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082405    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082409    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082412    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082416    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082420    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082423    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082427    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082431    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082435    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082440    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082444    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082454    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082458    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082463    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082467    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082471    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082474    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082479    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082483    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:51:16.207425 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082486    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082490    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082493    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082497    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082501    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082506    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082510    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082513    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082516    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082520    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082524    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082528    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082532    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.082538    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083627    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083636    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083641    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083645    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083649    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:51:16.208028 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083661    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083665    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083669    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083674    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083678    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083682    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083695    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083700    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083704    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083708    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083712    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083716    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083719    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083722    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083726    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083730    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083734    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083737    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083741    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083745    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:51:16.208641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083748    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083752    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083757    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083761    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083765    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083768    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083772    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083777    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083782    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083786    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083789    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083793    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083796    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083800    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083804    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083809    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083812    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083829    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083834    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083845    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:51:16.209229 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083849    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083853    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083857    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083861    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083868    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083872    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083877    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083881    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083885    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083888    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083892    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083897    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083901    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083907    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083910    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083914    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083917    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083920    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083924    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:51:16.209798 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083929    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083933    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083936    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083940    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083944    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083948    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083951    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083956    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083959    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083963    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083966    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083970    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083975    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083985    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083990    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083993    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.083996    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084000    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084004    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084008    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:51:16.210384 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084012    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084016    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084020    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084023    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084027    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084031    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084035    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084038    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084042    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084045    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084049    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084052    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084056    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084062    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.084073    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086334    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086347    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086351    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086354    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086358    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:51:16.210917 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086361    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086364    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086377    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086384    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086387    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086390    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086394    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086397    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086400    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086403    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086406    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086408    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086411    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086414    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086417    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086419    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086424    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086429    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086434    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:51:16.211558 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086441    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086445    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086450    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086454    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086457    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086461    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086465    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086469    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086475    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086479    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086483    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086487    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086490    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086493    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086496    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086499    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086503    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086506    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086509    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086511    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:51:16.212091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086517    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086519    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086522    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086525    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086535    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086538    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086541    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086543    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086546    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086549    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086552    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086555    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086563    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086566    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086569    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086572    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086575    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086580    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086583    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086586    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:51:16.212660 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086589    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086591    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086594    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086598    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086603    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086606    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086609    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086611    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086614    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086617    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086620    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086623    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086625    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086628    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086631    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086633    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086636    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086641    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086643    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086646    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:51:16.213148 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086649    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086651    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086654    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086657    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086660    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086663    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086666    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086668    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086671    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086674    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086678    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086681    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086684    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086687    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.086697    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086787    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086795    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086808    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086817    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086821    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086825    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 18:51:16.213691 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086829    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086837    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086840    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086843    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086847    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086860    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086864    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086867    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086870    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086874    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086879    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086882    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086886    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086889    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086892    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086896    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086900    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086904    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086909    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086912    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086916    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086919    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086922    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086925    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 18:51:16.214208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086928    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086931    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086935    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086941    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086944    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086948    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086951    2571 flags.go:64] FLAG: --enable-server="true"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086954    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086958    2571 flags.go:64] FLAG: --event-burst="100"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086962    2571 flags.go:64] FLAG: --event-qps="50"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086965    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086970    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086973    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086980    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086983    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086986    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086989    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086992    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.086996    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087001    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087004    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087007    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087010    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087021    2571 flags.go:64] FLAG: --feature-gates=""
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087027    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 18:51:16.215538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087030    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087034    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087037    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087043    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087046    2571 flags.go:64] FLAG: --help="false"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087049    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087052    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087055    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087058    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087062    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087065    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087071    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087074    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087077    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087081    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087083    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087087    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087090    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087093    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087097    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087103    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087106    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087109    2571 flags.go:64] FLAG: --lock-file=""
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087112    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 18:51:16.216583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087115    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087118    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087124    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087127    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087130    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087135    2571 flags.go:64] FLAG: --logging-format="text"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087139    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087142    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087145    2571 flags.go:64] FLAG: --manifest-url=""
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087148    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087153    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087156    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087160    2571 flags.go:64] FLAG: --max-pods="110"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087173    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087176    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087179    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087183    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087186    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087189    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087192    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087206    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087209    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087212    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 18:51:16.217432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087215    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087219    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087223    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087227    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087230    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087235    2571 flags.go:64] FLAG: --port="10250"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087239    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087242    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0001f4cc20bc1e614"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087246    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087249    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087252    2571 flags.go:64] FLAG: --register-node="true"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087255    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087259    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087262    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087267    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087271    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087275    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087292    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087297    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087302    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087307    2571 flags.go:64] FLAG: --runonce="false"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087443    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087456    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087462    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087468    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 18:51:16.218249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087472    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087475    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087479    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087482    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087485    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087488    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087491    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087494    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087497    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087501    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087504    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087514    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087518    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087521    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087526    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087529    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087532    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087535    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087538    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087543    2571 flags.go:64] FLAG: --v="2"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087548    2571 flags.go:64] FLAG: --version="false"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087552    2571 flags.go:64] FLAG: --vmodule=""
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087556    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.087559    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087677    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:51:16.219070 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087682    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087687    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087690    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087694    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087697    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087699    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087702    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087705    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087708    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087710    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087713    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087716    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087719    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087721    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087724    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087727    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087730    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087732    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087736    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:51:16.398503 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087738    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087741    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087743    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087746    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087748    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087752    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087756    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087759    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087762    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087765    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087767    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087771    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087776    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087779    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087783    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087786    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087789    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087792    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087795    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087798    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:51:16.400356 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087801    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087804    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087806    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087809    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087812    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087814    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087817    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087820    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087823    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087825    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087828    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087830    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087833    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087835    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087838    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087842    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087845    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087847    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087850    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087853    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:51:16.401641 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087855    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087858    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087861    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087863    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087872    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087875    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087879    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087881    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087884    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087887    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087889    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087892    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087894    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087897    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087900    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087902    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087905    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087908    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087910    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087913    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:51:16.402174 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087915    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087918    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087921    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087925    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087928    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087931    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087934    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087939    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087942    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087944    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087947    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087949    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087952    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087955    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087957    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087960    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087963    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087971    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:51:16.402712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.087975    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.088516    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.095107    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.095120    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.095137    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.095143    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095199    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095204    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095208    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095211    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095214    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095217    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095220    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095223    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:51:16.403243 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095227    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095232    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095235    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095238    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095240    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095243    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095246    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095248    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095251    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095254    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095256    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095259    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095262    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095265    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095268    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095271    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095273    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095291    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095298    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095302    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:51:16.403646 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095305    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095309    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095312    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095315    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095318    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095321    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095324    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095326    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095329    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095332    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095334    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095337    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095340    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095343    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095348    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095352    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095355    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095357    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095360    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095363    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:51:16.404195 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095365    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095368    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095370    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095373    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095377    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095381    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095384    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095387    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095390    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095393    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095397    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095399    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095402    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095405    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095408    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095411    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095413    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095416    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095419    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095425    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:51:16.404720 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095427    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095430    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095433    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095436    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095438    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095441    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095444    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095447    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095450    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095452    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095455    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095458    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095460    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095463    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095466    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095468    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095471    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095474    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095476    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095479    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:51:16.405258 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095482    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095484    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095487    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095490    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095493    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095495    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095498    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095500    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095503    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095505    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095508    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.095515    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095630    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095634    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:51:16.405764 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095638    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095641    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095644    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095646    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095649    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095652    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095656    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095659    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095661    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095664    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095666    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095669    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095671    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095674    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095677    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095679    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095682    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095684    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095687    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095690    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:51:16.541717 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095692    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095695    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095698    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095701    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095704    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095706    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095709    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095711    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095714    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095719    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095723    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095725    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095728    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095730    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095733    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095735    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095738    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095740    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095744    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:51:16.543091 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095747    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095749    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095753    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095757    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095760    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095763    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095767    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095770    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095773    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095776    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095778    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095781    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095784    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095787    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095790    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095793    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095796    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095799    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095802    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:51:16.544266 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095804    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095807    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095810    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095814    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095816    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095819    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095822    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095824    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095827    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095829    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095832    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095835    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095839    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095842    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095845    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095847    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095850    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095852    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095855    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095857    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:51:16.545050 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095860    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095863    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095865    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095868    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095870    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095873    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095875    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095878    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095881    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095883    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095886    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095889    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095892    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095894    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095897    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095901    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095903    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095906    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:51:16.546210 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:16.095908    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.095913    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.096011    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.098548    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.099678    2571 server.go:1019] "Starting client certificate rotation"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.099771    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.099803    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.101725    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.102895    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.114512    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.116420    2571 log.go:25] "Validated CRI v1 image API"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.117109    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 18:51:16.546994 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.119340    2571 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 988f59d7-fdd8-43a6-9c8c-7d788e7e9e0a:/dev/nvme0n1p4 daad9c98-a3c2-4c55-a499-1d09132ec6c4:/dev/nvme0n1p3]
Jul 15 18:51:16.547781 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.119359    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 18:51:16.548188 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.125527    2571 manager.go:216] Machine: {Timestamp:2026-07-15 18:51:16.123854716 +0000 UTC m=+0.305627380 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3161676 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2960c697c13e9b5953f897a0b957b4 SystemUUID:ec2960c6-97c1-3e9b-5953-f897a0b957b4 BootID:c5945600-62ef-4c7b-9dbb-fe63302b9e3a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:cb:6c:27:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:cb:6c:27:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:d0:35:47:7d:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 18:51:16.548188 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.125655    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 18:51:16.548188 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.125741    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 18:51:16.548188 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.126137    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 18:51:16.548188 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.126650    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 18:51:16.548188 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.126682    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 18:51:16.548188 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.127246    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.127256    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.127263    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.127778    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.128974    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.132357    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.132473    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.132499    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.132508    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.132521    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.132530    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.132538    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.132843    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.132863    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.134991    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.136890    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.136916    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137054    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137066    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137072    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137077    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137085    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137090    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137510    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137516    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137522    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137527    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137540    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137549    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137575    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.137580    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.140638    2571 server.go:1268] "Started kubelet"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.140690    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.140709    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.140783    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.141762    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.141772    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.141832    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.141944    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 18:51:16.548978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.142648    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.145526    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.145838    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-233.ec2.internal.18c28b384266f7a5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-233.ec2.internal,UID:ip-10-0-130-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-233.ec2.internal,},FirstTimestamp:2026-07-15 18:51:16.140611493 +0000 UTC m=+0.322384153,LastTimestamp:2026-07-15 18:51:16.140611493 +0000 UTC m=+0.322384153,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-233.ec2.internal,}"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.148750    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.148764    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.148866    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-233.ec2.internal\" not found"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.149758    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.149781    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.149758    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.149941    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.149951    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.150582    2571 factory.go:55] Registering systemd factory
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.150595    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.150776    2571 factory.go:153] Registering CRI-O factory
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.150787    2571 factory.go:223] Registration of the crio container factory successfully
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.150850    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.150870    2571 factory.go:103] Registering Raw factory
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.150881    2571 manager.go:1196] Started watching for new ooms in manager
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.151347    2571 manager.go:349] Starting recovery of all containers
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.152070    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2nbbl"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.153875    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.153955    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.159260    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2nbbl"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.167367    2571 manager.go:354] Recovery completed
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.171611    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.173301    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.173321    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.173331    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.173835    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.173842    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.173856    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.174491    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.175072    2571 policy_none.go:49] "None policy: Start"
Jul 15 18:51:16.550969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.175088    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.175101    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.175136    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-233.ec2.internal.18c28b384459f277  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-233.ec2.internal,UID:ip-10-0-130-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-233.ec2.internal,},FirstTimestamp:2026-07-15 18:51:16.173312631 +0000 UTC m=+0.355085291,LastTimestamp:2026-07-15 18:51:16.173312631 +0000 UTC m=+0.355085291,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-233.ec2.internal,}"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.175271    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.175330    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.175346    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.179263    2571 policy_none.go:47] "Start"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.214958    2571 manager.go:337] "Starting Device Plugin manager"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.214985    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.214995    2571 server.go:87] "Starting device plugin registration server"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.218835    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.218845    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.218939    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.219074    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.219084    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.219686    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.219737    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-233.ec2.internal\" not found"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.319507    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.320504    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.320536    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.320549    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.320584    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.329851    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.331001    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.331038    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-233.ec2.internal\": node \"ip-10-0-130-233.ec2.internal\" not found"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.331255    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.331308    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.331342    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.331382    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.333589    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.381392    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-233.ec2.internal\" not found"
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.431580    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"]
Jul 15 18:51:16.552564 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.431675    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.433237    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.433268    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.433294    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.434888    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.434981    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.435004    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.435651    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.435663    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.435671    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.435684    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.435685    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.435699    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.436864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.436883    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.437628    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.437647    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.437656    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.450664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27d6e657e0fc42c84018a1763a94d169-config\") pod \"kube-apiserver-proxy-ip-10-0-130-233.ec2.internal\" (UID: \"27d6e657e0fc42c84018a1763a94d169\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.450684    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a4630631040b00b5b7262f1ad99b11e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal\" (UID: \"4a4630631040b00b5b7262f1ad99b11e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:16.450702    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a4630631040b00b5b7262f1ad99b11e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal\" (UID: \"4a4630631040b00b5b7262f1ad99b11e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.473856    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-233.ec2.internal\" not found" node="ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.477067    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-233.ec2.internal\" not found" node="ip-10-0-130-233.ec2.internal"
Jul 15 18:51:16.558855 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:16.483778    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-233.ec2.internal\" not found"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:17.036923    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-233.ec2.internal\" not found"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.036957    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27d6e657e0fc42c84018a1763a94d169-config\") pod \"kube-apiserver-proxy-ip-10-0-130-233.ec2.internal\" (UID: \"27d6e657e0fc42c84018a1763a94d169\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.037034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a4630631040b00b5b7262f1ad99b11e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal\" (UID: \"4a4630631040b00b5b7262f1ad99b11e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.037079    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a4630631040b00b5b7262f1ad99b11e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal\" (UID: \"4a4630631040b00b5b7262f1ad99b11e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.037084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27d6e657e0fc42c84018a1763a94d169-config\") pod \"kube-apiserver-proxy-ip-10-0-130-233.ec2.internal\" (UID: \"27d6e657e0fc42c84018a1763a94d169\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.037433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a4630631040b00b5b7262f1ad99b11e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal\" (UID: \"4a4630631040b00b5b7262f1ad99b11e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.037479    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a4630631040b00b5b7262f1ad99b11e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal\" (UID: \"4a4630631040b00b5b7262f1ad99b11e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.076497    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.080311    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.099394    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.099522    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:17.137148    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-233.ec2.internal\" not found"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.162899    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 18:46:16 +0000 UTC" deadline="2028-04-09 23:06:46.171919402 +0000 UTC"
Jul 15 18:51:17.176068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.162921    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15220h15m29.00900148s"
Jul 15 18:51:17.299374 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:17.238451    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-233.ec2.internal\" not found"
Jul 15 18:51:17.299374 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.288314    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:51:17.770522 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:17.680454    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-233.ec2.internal\" not found"
Jul 15 18:51:17.770522 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.683492    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:51:17.770522 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.686760    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:51:17.770522 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.749208    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.770522 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.768582    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 18:51:17.770522 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.769614    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal"
Jul 15 18:51:17.781271 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:17.779949    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.058887    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.133669    2571 apiserver.go:52] "Watching apiserver"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.137023    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4630631040b00b5b7262f1ad99b11e.slice/crio-ab3f95ce6b7e0cdbf07eff4c9c67068ffda8086362b51b7547daa887c518abc6 WatchSource:0}: Error finding container ab3f95ce6b7e0cdbf07eff4c9c67068ffda8086362b51b7547daa887c518abc6: Status 404 returned error can't find the container with id ab3f95ce6b7e0cdbf07eff4c9c67068ffda8086362b51b7547daa887c518abc6
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.137552    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d6e657e0fc42c84018a1763a94d169.slice/crio-989d9418eb937ac1fa7f6fdc2a715cd7d62ced3dd80db521c4de38a22781e93d WatchSource:0}: Error finding container 989d9418eb937ac1fa7f6fdc2a715cd7d62ced3dd80db521c4de38a22781e93d: Status 404 returned error can't find the container with id 989d9418eb937ac1fa7f6fdc2a715cd7d62ced3dd80db521c4de38a22781e93d
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.141036    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.142294    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26","openshift-dns/node-resolver-8f7cx","openshift-image-registry/node-ca-sckqh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal","openshift-multus/multus-additional-cni-plugins-sc4zx","openshift-network-operator/iptables-alerter-2xkdk","openshift-ovn-kubernetes/ovnkube-node-g6gmn","kube-system/global-pull-secret-syncer-sgnm6","kube-system/konnectivity-agent-l9dbk","openshift-cluster-node-tuning-operator/tuned-dfnbg","openshift-multus/multus-q279n","openshift-multus/network-metrics-daemon-jjh6s","openshift-network-diagnostics/network-check-target-zxt7k"]
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.143802    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.144695    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.145945    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.146009    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.147271    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.147330    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.147861    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.147872    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.147863    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.148147    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.148213    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.148374    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ck2bd\""
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.148581    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.150008    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.150059    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.190147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.151035    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 18:51:18.192031 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.151215    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 18:51:18.192031 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.151369    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 18:51:18.192031 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.151485    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2rj6s\""
Jul 15 18:51:18.192031 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.151548    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.293636 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.293553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ad7dc16-b990-45fc-a39b-1639612de7b3-env-overrides\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.293636 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.293610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ad7dc16-b990-45fc-a39b-1639612de7b3-ovnkube-script-lib\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.293833 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.293645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2ec0d0f-67af-4da1-bc2a-7eca409852d0-serviceca\") pod \"node-ca-sckqh\" (UID: \"f2ec0d0f-67af-4da1-bc2a-7eca409852d0\") " pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.293833 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.293678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-run-openvswitch\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.293833 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.293725    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65b8l\" (UniqueName: \"kubernetes.io/projected/7ad7dc16-b990-45fc-a39b-1639612de7b3-kube-api-access-65b8l\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.293833 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.293758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29c73127-918d-4b8b-93f8-d1cafcaced4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.293833 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.293804    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-cnibin\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.294077 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.293946    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.294123    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.293949    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.294996    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295304    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8rsz6\""
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295564    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-kubelet\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295599    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-run-netns\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-cni-bin\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295657    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2ec0d0f-67af-4da1-bc2a-7eca409852d0-host\") pod \"node-ca-sckqh\" (UID: \"f2ec0d0f-67af-4da1-bc2a-7eca409852d0\") " pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295691    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-etc-openvswitch\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295723    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-run-ovn\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295754    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-node-log\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295786    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295808    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-run-systemd\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.296399 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295840    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-var-lib-openvswitch\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295871    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29c73127-918d-4b8b-93f8-d1cafcaced4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295907    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19e2acdf-274f-4fd4-9322-47ac0c7cefa0-host-slash\") pod \"iptables-alerter-2xkdk\" (UID: \"19e2acdf-274f-4fd4-9322-47ac0c7cefa0\") " pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29c73127-918d-4b8b-93f8-d1cafcaced4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.295981    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpf82\" (UniqueName: \"kubernetes.io/projected/f2ec0d0f-67af-4da1-bc2a-7eca409852d0-kube-api-access-fpf82\") pod \"node-ca-sckqh\" (UID: \"f2ec0d0f-67af-4da1-bc2a-7eca409852d0\") " pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbc8n\" (UniqueName: \"kubernetes.io/projected/29c73127-918d-4b8b-93f8-d1cafcaced4b-kube-api-access-hbc8n\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296071    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5vgk2\""
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5sh8\" (UniqueName: \"kubernetes.io/projected/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-kube-api-access-g5sh8\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296126    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-systemd-units\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296148    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296420    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296150    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-log-socket\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296639    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296675    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ad7dc16-b990-45fc-a39b-1639612de7b3-ovnkube-config\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.297228 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296730    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296742    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-system-cni-dir\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296759    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296775    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-os-release\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296836    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ad7dc16-b990-45fc-a39b-1639612de7b3-ovn-node-metrics-cert\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296862    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/19e2acdf-274f-4fd4-9322-47ac0c7cefa0-iptables-alerter-script\") pod \"iptables-alerter-2xkdk\" (UID: \"19e2acdf-274f-4fd4-9322-47ac0c7cefa0\") " pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdgx\" (UniqueName: \"kubernetes.io/projected/19e2acdf-274f-4fd4-9322-47ac0c7cefa0-kube-api-access-wvdgx\") pod \"iptables-alerter-2xkdk\" (UID: \"19e2acdf-274f-4fd4-9322-47ac0c7cefa0\") " pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296923    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-slash\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.296955    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-cni-netd\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.297633    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 18:51:18.298000 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.297790    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 18:51:18.298744 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.298449    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:18.299127 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.299109    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 18:51:18.301189 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.301107    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.301286 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.301266    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 18:51:18.301504 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.301110    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pckkw\""
Jul 15 18:51:18.301701 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.301663    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 18:51:18.302616 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.302599    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.303832 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.303817    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 18:51:18.304009 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.303996    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:51:18.304349 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.304328    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 18:51:18.304446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.304405    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.304446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.304412    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6nq49\""
Jul 15 18:51:18.304553 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.304501    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6qzzc"
Jul 15 18:51:18.305062 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.305044    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 18:51:18.305127 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.305087    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p6p59\""
Jul 15 18:51:18.306066 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.306053    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.306848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.306831    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-44l4b\""
Jul 15 18:51:18.307049 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.307036    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 18:51:18.307087 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.307074    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 18:51:18.308574 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.308554    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 18:51:18.308667 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.308638    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 18:51:18.308750 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.308734    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k9fpq\""
Jul 15 18:51:18.308822 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.308806    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 18:51:18.350697 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.350680    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 18:51:18.397579 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397545    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/427e95a8-c850-44bd-b203-06dc475f06b2-agent-certs\") pod \"konnectivity-agent-l9dbk\" (UID: \"427e95a8-c850-44bd-b203-06dc475f06b2\") " pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:18.397579 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397580    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-socket-dir-parent\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.397812 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397604    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-hostroot\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.397812 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-slash\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.397812 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397683    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-daemon-config\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.397812 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397707    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-slash\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.397812 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-socket-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.397812 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397769    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-sysctl-conf\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.397812 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397791    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36c5fcb6-02c3-43da-affa-4aaea3d1767e-tmp\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bda29dcc-2bcd-41cf-9222-9bdd6d736afa-tmp-dir\") pod \"node-resolver-8f7cx\" (UID: \"bda29dcc-2bcd-41cf-9222-9bdd6d736afa\") " pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397898    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-cnibin\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397927    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-run-netns\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397989    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-system-cni-dir\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398029    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-cnibin\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.398048    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzc2t\" (UniqueName: \"kubernetes.io/projected/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-kube-api-access-pzc2t\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398093    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-sysconfig\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.398121    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs podName:a29b97d4-7ee7-4343-9fc5-a1d7b355d8af nodeName:}" failed. No retries permitted until 2026-07-15 18:51:18.898104165 +0000 UTC m=+3.079876818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs") pod "network-metrics-daemon-jjh6s" (UID: "a29b97d4-7ee7-4343-9fc5-a1d7b355d8af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:18.398170 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-sys\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2ec0d0f-67af-4da1-bc2a-7eca409852d0-host\") pod \"node-ca-sckqh\" (UID: \"f2ec0d0f-67af-4da1-bc2a-7eca409852d0\") " pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2ec0d0f-67af-4da1-bc2a-7eca409852d0-host\") pod \"node-ca-sckqh\" (UID: \"f2ec0d0f-67af-4da1-bc2a-7eca409852d0\") " pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-etc-openvswitch\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398395    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-etc-openvswitch\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398381    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398448    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/770ec833-12f2-442d-8108-0eeec52dea3a-dbus\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-run-multus-certs\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.397997    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-run-netns\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-run\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-host\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398584    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bda29dcc-2bcd-41cf-9222-9bdd6d736afa-hosts-file\") pod \"node-resolver-8f7cx\" (UID: \"bda29dcc-2bcd-41cf-9222-9bdd6d736afa\") " pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.398735 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ad7dc16-b990-45fc-a39b-1639612de7b3-ovnkube-config\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398718    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/770ec833-12f2-442d-8108-0eeec52dea3a-kubelet-config\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398759    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-var-lib-cni-multus\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398790    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-run-systemd\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398810    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-var-lib-openvswitch\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398837    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29c73127-918d-4b8b-93f8-d1cafcaced4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-run-systemd\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398886    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-run-netns\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.398915    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-var-lib-openvswitch\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19e2acdf-274f-4fd4-9322-47ac0c7cefa0-host-slash\") pod \"iptables-alerter-2xkdk\" (UID: \"19e2acdf-274f-4fd4-9322-47ac0c7cefa0\") " pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399071    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19e2acdf-274f-4fd4-9322-47ac0c7cefa0-host-slash\") pod \"iptables-alerter-2xkdk\" (UID: \"19e2acdf-274f-4fd4-9322-47ac0c7cefa0\") " pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399075    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpf82\" (UniqueName: \"kubernetes.io/projected/f2ec0d0f-67af-4da1-bc2a-7eca409852d0-kube-api-access-fpf82\") pod \"node-ca-sckqh\" (UID: \"f2ec0d0f-67af-4da1-bc2a-7eca409852d0\") " pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-etc-kubernetes\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.399489 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399129    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpcdn\" (UniqueName: \"kubernetes.io/projected/36c5fcb6-02c3-43da-affa-4aaea3d1767e-kube-api-access-qpcdn\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399158    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-system-cni-dir\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-os-release\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399209    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ad7dc16-b990-45fc-a39b-1639612de7b3-ovn-node-metrics-cert\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-modprobe-d\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399315    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ad7dc16-b990-45fc-a39b-1639612de7b3-ovnkube-config\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-tuned\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399332    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-os-release\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/19e2acdf-274f-4fd4-9322-47ac0c7cefa0-iptables-alerter-script\") pod \"iptables-alerter-2xkdk\" (UID: \"19e2acdf-274f-4fd4-9322-47ac0c7cefa0\") " pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdgx\" (UniqueName: \"kubernetes.io/projected/19e2acdf-274f-4fd4-9322-47ac0c7cefa0-kube-api-access-wvdgx\") pod \"iptables-alerter-2xkdk\" (UID: \"19e2acdf-274f-4fd4-9322-47ac0c7cefa0\") " pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-cni-netd\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399490    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29c73127-918d-4b8b-93f8-d1cafcaced4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.400168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399507    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ad7dc16-b990-45fc-a39b-1639612de7b3-env-overrides\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399531    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ad7dc16-b990-45fc-a39b-1639612de7b3-ovnkube-script-lib\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399538    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-cni-netd\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399567    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-cni-dir\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399627    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2ec0d0f-67af-4da1-bc2a-7eca409852d0-serviceca\") pod \"node-ca-sckqh\" (UID: \"f2ec0d0f-67af-4da1-bc2a-7eca409852d0\") " pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-run-openvswitch\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65b8l\" (UniqueName: \"kubernetes.io/projected/7ad7dc16-b990-45fc-a39b-1639612de7b3-kube-api-access-65b8l\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-cnibin\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399726    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-os-release\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399749    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-var-lib-kubelet\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29c73127-918d-4b8b-93f8-d1cafcaced4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399767    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-kubelet\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-cni-bin\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399824    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-system-cni-dir\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.400643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-var-lib-cni-bin\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-run-ovn\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.399922    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-node-log\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.400030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-node-log\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.400103    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2ec0d0f-67af-4da1-bc2a-7eca409852d0-serviceca\") pod \"node-ca-sckqh\" (UID: \"f2ec0d0f-67af-4da1-bc2a-7eca409852d0\") " pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.400160    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-kubelet\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.400174    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ad7dc16-b990-45fc-a39b-1639612de7b3-env-overrides\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.400185    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ad7dc16-b990-45fc-a39b-1639612de7b3-ovnkube-script-lib\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.400204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-sysctl-d\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.400213    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/19e2acdf-274f-4fd4-9322-47ac0c7cefa0-iptables-alerter-script\") pod \"iptables-alerter-2xkdk\" (UID: \"19e2acdf-274f-4fd4-9322-47ac0c7cefa0\") " pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.400864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-run-openvswitch\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.400223    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-run-ovn\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401072    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29c73127-918d-4b8b-93f8-d1cafcaced4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401092    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-host-cni-bin\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401143    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-systemd\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.401268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401190    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-systemd-units\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401242    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-systemd-units\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/427e95a8-c850-44bd-b203-06dc475f06b2-konnectivity-ca\") pod \"konnectivity-agent-l9dbk\" (UID: \"427e95a8-c850-44bd-b203-06dc475f06b2\") " pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-run-k8s-cni-cncf-io\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401572    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29c73127-918d-4b8b-93f8-d1cafcaced4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401662    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-registration-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401723    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-kubernetes\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-lib-modules\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401794    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmz72\" (UniqueName: \"kubernetes.io/projected/bda29dcc-2bcd-41cf-9222-9bdd6d736afa-kube-api-access-bmz72\") pod \"node-resolver-8f7cx\" (UID: \"bda29dcc-2bcd-41cf-9222-9bdd6d736afa\") " pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbc8n\" (UniqueName: \"kubernetes.io/projected/29c73127-918d-4b8b-93f8-d1cafcaced4b-kube-api-access-hbc8n\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.401944 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401937    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5sh8\" (UniqueName: \"kubernetes.io/projected/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-kube-api-access-g5sh8\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:18.402446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.401969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-log-socket\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.402446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.402024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-device-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.402446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.402060    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-sys-fs\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.402446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.402141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-var-lib-kubelet\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.402446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.402201    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.402446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.402245    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:18.402446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.402271    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-cni-binary-copy\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.402759 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.402583    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-conf-dir\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.402759 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.402615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.402759 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.402682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx8kf\" (UniqueName: \"kubernetes.io/projected/27497247-85c5-48cb-89f0-f7cef85b34e2-kube-api-access-wx8kf\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.403662 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.403641    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29c73127-918d-4b8b-93f8-d1cafcaced4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.404210 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.404044    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ad7dc16-b990-45fc-a39b-1639612de7b3-log-socket\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.404210 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.404174    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29c73127-918d-4b8b-93f8-d1cafcaced4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.404421 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.404398    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ad7dc16-b990-45fc-a39b-1639612de7b3-ovn-node-metrics-cert\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.410160 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.410136    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdgx\" (UniqueName: \"kubernetes.io/projected/19e2acdf-274f-4fd4-9322-47ac0c7cefa0-kube-api-access-wvdgx\") pod \"iptables-alerter-2xkdk\" (UID: \"19e2acdf-274f-4fd4-9322-47ac0c7cefa0\") " pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.410912 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.410887    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpf82\" (UniqueName: \"kubernetes.io/projected/f2ec0d0f-67af-4da1-bc2a-7eca409852d0-kube-api-access-fpf82\") pod \"node-ca-sckqh\" (UID: \"f2ec0d0f-67af-4da1-bc2a-7eca409852d0\") " pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.411006 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.410913    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbc8n\" (UniqueName: \"kubernetes.io/projected/29c73127-918d-4b8b-93f8-d1cafcaced4b-kube-api-access-hbc8n\") pod \"multus-additional-cni-plugins-sc4zx\" (UID: \"29c73127-918d-4b8b-93f8-d1cafcaced4b\") " pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.412182 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.412164    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65b8l\" (UniqueName: \"kubernetes.io/projected/7ad7dc16-b990-45fc-a39b-1639612de7b3-kube-api-access-65b8l\") pod \"ovnkube-node-g6gmn\" (UID: \"7ad7dc16-b990-45fc-a39b-1639612de7b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.414102 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.414088    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:51:18.414148 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.414107    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:51:18.414148 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.414117    2571 projected.go:196] Error preparing data for projected volume kube-api-access-mshc6 for pod openshift-network-diagnostics/network-check-target-zxt7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:18.414212 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.414203    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6 podName:666c5065-674a-4251-aef5-78678916dcf0 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:18.914184641 +0000 UTC m=+3.095957296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mshc6" (UniqueName: "kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6") pod "network-check-target-zxt7k" (UID: "666c5065-674a-4251-aef5-78678916dcf0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:18.416090 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.416067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5sh8\" (UniqueName: \"kubernetes.io/projected/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-kube-api-access-g5sh8\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:18.503802 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-var-lib-cni-bin\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.503802 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503807    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-sysctl-d\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503824    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-systemd\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/427e95a8-c850-44bd-b203-06dc475f06b2-konnectivity-ca\") pod \"konnectivity-agent-l9dbk\" (UID: \"427e95a8-c850-44bd-b203-06dc475f06b2\") " pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-run-k8s-cni-cncf-io\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503892    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-var-lib-cni-bin\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-registration-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-systemd\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-kubernetes\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503960    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-run-k8s-cni-cncf-io\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503974    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-lib-modules\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503977    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-registration-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.503988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-sysctl-d\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmz72\" (UniqueName: \"kubernetes.io/projected/bda29dcc-2bcd-41cf-9222-9bdd6d736afa-kube-api-access-bmz72\") pod \"node-resolver-8f7cx\" (UID: \"bda29dcc-2bcd-41cf-9222-9bdd6d736afa\") " pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-device-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.504060 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504052    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-sys-fs\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-kubernetes\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504076    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-lib-modules\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-var-lib-kubelet\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-var-lib-kubelet\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-sys-fs\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-cni-binary-copy\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504197    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-device-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504216    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-conf-dir\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504273    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx8kf\" (UniqueName: \"kubernetes.io/projected/27497247-85c5-48cb-89f0-f7cef85b34e2-kube-api-access-wx8kf\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/427e95a8-c850-44bd-b203-06dc475f06b2-agent-certs\") pod \"konnectivity-agent-l9dbk\" (UID: \"427e95a8-c850-44bd-b203-06dc475f06b2\") " pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504342    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-conf-dir\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-socket-dir-parent\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-hostroot\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.504702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504431    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-daemon-config\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-socket-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504469    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-socket-dir-parent\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-sysctl-conf\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504507    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/427e95a8-c850-44bd-b203-06dc475f06b2-konnectivity-ca\") pod \"konnectivity-agent-l9dbk\" (UID: \"427e95a8-c850-44bd-b203-06dc475f06b2\") " pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36c5fcb6-02c3-43da-affa-4aaea3d1767e-tmp\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504560    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bda29dcc-2bcd-41cf-9222-9bdd6d736afa-tmp-dir\") pod \"node-resolver-8f7cx\" (UID: \"bda29dcc-2bcd-41cf-9222-9bdd6d736afa\") " pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504602    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-system-cni-dir\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzc2t\" (UniqueName: \"kubernetes.io/projected/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-kube-api-access-pzc2t\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-sysconfig\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-sys\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504696    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-hostroot\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504707    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/770ec833-12f2-442d-8108-0eeec52dea3a-dbus\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-run-multus-certs\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504783    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-run-multus-certs\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.505432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-sysconfig\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504805    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-cni-binary-copy\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504833    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-sys\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-daemon-config\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-run\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-system-cni-dir\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-host\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.504990    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/770ec833-12f2-442d-8108-0eeec52dea3a-dbus\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bda29dcc-2bcd-41cf-9222-9bdd6d736afa-hosts-file\") pod \"node-resolver-8f7cx\" (UID: \"bda29dcc-2bcd-41cf-9222-9bdd6d736afa\") " pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505065    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bda29dcc-2bcd-41cf-9222-9bdd6d736afa-tmp-dir\") pod \"node-resolver-8f7cx\" (UID: \"bda29dcc-2bcd-41cf-9222-9bdd6d736afa\") " pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505074    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-run\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505082    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/770ec833-12f2-442d-8108-0eeec52dea3a-kubelet-config\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505103    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-socket-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505115    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-var-lib-cni-multus\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505166    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-var-lib-cni-multus\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.506011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505171    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-run-netns\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505166    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bda29dcc-2bcd-41cf-9222-9bdd6d736afa-hosts-file\") pod \"node-resolver-8f7cx\" (UID: \"bda29dcc-2bcd-41cf-9222-9bdd6d736afa\") " pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505120    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-sysctl-conf\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-host\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505202    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-run-netns\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-etc-kubernetes\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505252    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpcdn\" (UniqueName: \"kubernetes.io/projected/36c5fcb6-02c3-43da-affa-4aaea3d1767e-kube-api-access-qpcdn\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505280    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-modprobe-d\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505173    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/770ec833-12f2-442d-8108-0eeec52dea3a-kubelet-config\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505305    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-tuned\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505322    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-etc-kubernetes\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505326    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505368    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-modprobe-d\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.506604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-cni-dir\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-cnibin\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505486    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-os-release\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.505514    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-var-lib-kubelet\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505537    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-multus-cni-dir\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-cnibin\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.505609    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret podName:770ec833-12f2-442d-8108-0eeec52dea3a nodeName:}" failed. No retries permitted until 2026-07-15 18:51:19.005582328 +0000 UTC m=+3.187354977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret") pod "global-pull-secret-syncer-sgnm6" (UID: "770ec833-12f2-442d-8108-0eeec52dea3a") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-os-release\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505665    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-host-var-lib-kubelet\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.505719    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27497247-85c5-48cb-89f0-f7cef85b34e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.506946    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36c5fcb6-02c3-43da-affa-4aaea3d1767e-tmp\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.507162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.507132    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/427e95a8-c850-44bd-b203-06dc475f06b2-agent-certs\") pod \"konnectivity-agent-l9dbk\" (UID: \"427e95a8-c850-44bd-b203-06dc475f06b2\") " pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:18.507561 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.507251    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36c5fcb6-02c3-43da-affa-4aaea3d1767e-etc-tuned\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.514639 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.514619    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpcdn\" (UniqueName: \"kubernetes.io/projected/36c5fcb6-02c3-43da-affa-4aaea3d1767e-kube-api-access-qpcdn\") pod \"tuned-dfnbg\" (UID: \"36c5fcb6-02c3-43da-affa-4aaea3d1767e\") " pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.514774 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.514680    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx8kf\" (UniqueName: \"kubernetes.io/projected/27497247-85c5-48cb-89f0-f7cef85b34e2-kube-api-access-wx8kf\") pod \"aws-ebs-csi-driver-node-nlb26\" (UID: \"27497247-85c5-48cb-89f0-f7cef85b34e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.514914 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.514898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzc2t\" (UniqueName: \"kubernetes.io/projected/d24ba7f2-ffe6-41f3-b180-409a5b377d9a-kube-api-access-pzc2t\") pod \"multus-q279n\" (UID: \"d24ba7f2-ffe6-41f3-b180-409a5b377d9a\") " pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.514953 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.514944    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmz72\" (UniqueName: \"kubernetes.io/projected/bda29dcc-2bcd-41cf-9222-9bdd6d736afa-kube-api-access-bmz72\") pod \"node-resolver-8f7cx\" (UID: \"bda29dcc-2bcd-41cf-9222-9bdd6d736afa\") " pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.603032 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.603009    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sc4zx"
Jul 15 18:51:18.605043 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.605022    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sckqh"
Jul 15 18:51:18.613166 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.613136    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:18.613225 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.613201    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c73127_918d_4b8b_93f8_d1cafcaced4b.slice/crio-661d19393b24a7672092abb598819d5c8e18dad8074da05470a8115635ba15b3 WatchSource:0}: Error finding container 661d19393b24a7672092abb598819d5c8e18dad8074da05470a8115635ba15b3: Status 404 returned error can't find the container with id 661d19393b24a7672092abb598819d5c8e18dad8074da05470a8115635ba15b3
Jul 15 18:51:18.615664 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.615615    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ec0d0f_67af_4da1_bc2a_7eca409852d0.slice/crio-a7e18e023867ae5878c78e24539a8e4aea779a4deb13a73e08de54b9cf3c10eb WatchSource:0}: Error finding container a7e18e023867ae5878c78e24539a8e4aea779a4deb13a73e08de54b9cf3c10eb: Status 404 returned error can't find the container with id a7e18e023867ae5878c78e24539a8e4aea779a4deb13a73e08de54b9cf3c10eb
Jul 15 18:51:18.618856 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.618666    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2xkdk"
Jul 15 18:51:18.625258 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.625226    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:18.625557 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.625530    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad7dc16_b990_45fc_a39b_1639612de7b3.slice/crio-ff77006ac6124e54c8335dfbfba9edeaf8865da62fa29e094fa0448436cc8b68 WatchSource:0}: Error finding container ff77006ac6124e54c8335dfbfba9edeaf8865da62fa29e094fa0448436cc8b68: Status 404 returned error can't find the container with id ff77006ac6124e54c8335dfbfba9edeaf8865da62fa29e094fa0448436cc8b68
Jul 15 18:51:18.628743 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.628699    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e2acdf_274f_4fd4_9322_47ac0c7cefa0.slice/crio-f1717b7c4745f35021283dde191fc91277b91561ed0d3c5efb24a53c102af73a WatchSource:0}: Error finding container f1717b7c4745f35021283dde191fc91277b91561ed0d3c5efb24a53c102af73a: Status 404 returned error can't find the container with id f1717b7c4745f35021283dde191fc91277b91561ed0d3c5efb24a53c102af73a
Jul 15 18:51:18.630250 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.630229    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfnbg"
Jul 15 18:51:18.634383 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.634342    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427e95a8_c850_44bd_b203_06dc475f06b2.slice/crio-d3609c62e995b4752700dbedab98d1494958bef5d658d8cecb913147640025b4 WatchSource:0}: Error finding container d3609c62e995b4752700dbedab98d1494958bef5d658d8cecb913147640025b4: Status 404 returned error can't find the container with id d3609c62e995b4752700dbedab98d1494958bef5d658d8cecb913147640025b4
Jul 15 18:51:18.638059 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.638034    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q279n"
Jul 15 18:51:18.638303 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.638253    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c5fcb6_02c3_43da_affa_4aaea3d1767e.slice/crio-3b3f934fb1f1b6a28f9a674b5d14253f2a3b13bc9cb8eccb5c26250e02265188 WatchSource:0}: Error finding container 3b3f934fb1f1b6a28f9a674b5d14253f2a3b13bc9cb8eccb5c26250e02265188: Status 404 returned error can't find the container with id 3b3f934fb1f1b6a28f9a674b5d14253f2a3b13bc9cb8eccb5c26250e02265188
Jul 15 18:51:18.642905 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.642887    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8f7cx"
Jul 15 18:51:18.647397 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.647382    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26"
Jul 15 18:51:18.647485 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.647460    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24ba7f2_ffe6_41f3_b180_409a5b377d9a.slice/crio-7396655451c8dda107b73bfea5de7e705a80355589f48e7cb1f745aa9bbc3bdd WatchSource:0}: Error finding container 7396655451c8dda107b73bfea5de7e705a80355589f48e7cb1f745aa9bbc3bdd: Status 404 returned error can't find the container with id 7396655451c8dda107b73bfea5de7e705a80355589f48e7cb1f745aa9bbc3bdd
Jul 15 18:51:18.651500 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.651476    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda29dcc_2bcd_41cf_9222_9bdd6d736afa.slice/crio-93e3e92cdbe29de2caac027fa38b4801bf132ec41a9f629d6a623bd668847609 WatchSource:0}: Error finding container 93e3e92cdbe29de2caac027fa38b4801bf132ec41a9f629d6a623bd668847609: Status 404 returned error can't find the container with id 93e3e92cdbe29de2caac027fa38b4801bf132ec41a9f629d6a623bd668847609
Jul 15 18:51:18.656237 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:18.656219    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27497247_85c5_48cb_89f0_f7cef85b34e2.slice/crio-26aa0cdd98550f12ada96a8222b217a080bbf68657583125d6bf5fdde017a9e3 WatchSource:0}: Error finding container 26aa0cdd98550f12ada96a8222b217a080bbf68657583125d6bf5fdde017a9e3: Status 404 returned error can't find the container with id 26aa0cdd98550f12ada96a8222b217a080bbf68657583125d6bf5fdde017a9e3
Jul 15 18:51:18.684588 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.684537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8f7cx" event={"ID":"bda29dcc-2bcd-41cf-9222-9bdd6d736afa","Type":"ContainerStarted","Data":"93e3e92cdbe29de2caac027fa38b4801bf132ec41a9f629d6a623bd668847609"}
Jul 15 18:51:18.685786 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.685764    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfnbg" event={"ID":"36c5fcb6-02c3-43da-affa-4aaea3d1767e","Type":"ContainerStarted","Data":"3b3f934fb1f1b6a28f9a674b5d14253f2a3b13bc9cb8eccb5c26250e02265188"}
Jul 15 18:51:18.687016 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.686994    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerStarted","Data":"ff77006ac6124e54c8335dfbfba9edeaf8865da62fa29e094fa0448436cc8b68"}
Jul 15 18:51:18.687925 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.687904    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sckqh" event={"ID":"f2ec0d0f-67af-4da1-bc2a-7eca409852d0","Type":"ContainerStarted","Data":"a7e18e023867ae5878c78e24539a8e4aea779a4deb13a73e08de54b9cf3c10eb"}
Jul 15 18:51:18.689082 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.689062    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal" event={"ID":"4a4630631040b00b5b7262f1ad99b11e","Type":"ContainerStarted","Data":"ab3f95ce6b7e0cdbf07eff4c9c67068ffda8086362b51b7547daa887c518abc6"}
Jul 15 18:51:18.690091 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.690072    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal" event={"ID":"27d6e657e0fc42c84018a1763a94d169","Type":"ContainerStarted","Data":"989d9418eb937ac1fa7f6fdc2a715cd7d62ced3dd80db521c4de38a22781e93d"}
Jul 15 18:51:18.690990 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.690970    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26" event={"ID":"27497247-85c5-48cb-89f0-f7cef85b34e2","Type":"ContainerStarted","Data":"26aa0cdd98550f12ada96a8222b217a080bbf68657583125d6bf5fdde017a9e3"}
Jul 15 18:51:18.691963 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.691944    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q279n" event={"ID":"d24ba7f2-ffe6-41f3-b180-409a5b377d9a","Type":"ContainerStarted","Data":"7396655451c8dda107b73bfea5de7e705a80355589f48e7cb1f745aa9bbc3bdd"}
Jul 15 18:51:18.692943 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.692925    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l9dbk" event={"ID":"427e95a8-c850-44bd-b203-06dc475f06b2","Type":"ContainerStarted","Data":"d3609c62e995b4752700dbedab98d1494958bef5d658d8cecb913147640025b4"}
Jul 15 18:51:18.694139 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.694117    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2xkdk" event={"ID":"19e2acdf-274f-4fd4-9322-47ac0c7cefa0","Type":"ContainerStarted","Data":"f1717b7c4745f35021283dde191fc91277b91561ed0d3c5efb24a53c102af73a"}
Jul 15 18:51:18.695269 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.695248    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sc4zx" event={"ID":"29c73127-918d-4b8b-93f8-d1cafcaced4b","Type":"ContainerStarted","Data":"661d19393b24a7672092abb598819d5c8e18dad8074da05470a8115635ba15b3"}
Jul 15 18:51:18.907890 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:18.907769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:18.908047 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.907991    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:18.908120 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:18.908070    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs podName:a29b97d4-7ee7-4343-9fc5-a1d7b355d8af nodeName:}" failed. No retries permitted until 2026-07-15 18:51:19.908049613 +0000 UTC m=+4.089822262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs") pod "network-metrics-daemon-jjh6s" (UID: "a29b97d4-7ee7-4343-9fc5-a1d7b355d8af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:19.008441 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:19.008401    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:19.008635 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:19.008505    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:19.008784 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:19.008656    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:19.008784 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:19.008672    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:51:19.008784 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:19.008690    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:51:19.008784 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:19.008702    2571 projected.go:196] Error preparing data for projected volume kube-api-access-mshc6 for pod openshift-network-diagnostics/network-check-target-zxt7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:19.008784 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:19.008730    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret podName:770ec833-12f2-442d-8108-0eeec52dea3a nodeName:}" failed. No retries permitted until 2026-07-15 18:51:20.008701428 +0000 UTC m=+4.190474077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret") pod "global-pull-secret-syncer-sgnm6" (UID: "770ec833-12f2-442d-8108-0eeec52dea3a") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:19.008784 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:19.008750    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6 podName:666c5065-674a-4251-aef5-78678916dcf0 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:20.00873935 +0000 UTC m=+4.190512003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mshc6" (UniqueName: "kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6") pod "network-check-target-zxt7k" (UID: "666c5065-674a-4251-aef5-78678916dcf0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:19.308386 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:19.308197    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 18:46:18 +0000 UTC" deadline="2027-12-14 01:00:58.000293817 +0000 UTC"
Jul 15 18:51:19.308386 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:19.308268    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12390h9m38.692030741s"
Jul 15 18:51:19.332873 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:19.332313    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:19.332873 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:19.332457    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:19.917072 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:19.917035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:19.917267 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:19.917186    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:19.917267 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:19.917248    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs podName:a29b97d4-7ee7-4343-9fc5-a1d7b355d8af nodeName:}" failed. No retries permitted until 2026-07-15 18:51:21.917227613 +0000 UTC m=+6.099000268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs") pod "network-metrics-daemon-jjh6s" (UID: "a29b97d4-7ee7-4343-9fc5-a1d7b355d8af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:20.018374 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:20.018321    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:20.018589 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:20.018392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:20.018737 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:20.018682    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:51:20.018737 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:20.018711    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:51:20.018737 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:20.018726    2571 projected.go:196] Error preparing data for projected volume kube-api-access-mshc6 for pod openshift-network-diagnostics/network-check-target-zxt7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:20.018907 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:20.018814    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6 podName:666c5065-674a-4251-aef5-78678916dcf0 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.018792443 +0000 UTC m=+6.200565096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mshc6" (UniqueName: "kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6") pod "network-check-target-zxt7k" (UID: "666c5065-674a-4251-aef5-78678916dcf0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:20.019251 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:20.019235    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:20.019350 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:20.019289    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret podName:770ec833-12f2-442d-8108-0eeec52dea3a nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.019272933 +0000 UTC m=+6.201045587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret") pod "global-pull-secret-syncer-sgnm6" (UID: "770ec833-12f2-442d-8108-0eeec52dea3a") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:20.308702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:20.308607    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 18:46:18 +0000 UTC" deadline="2028-03-04 11:07:54.45884469 +0000 UTC"
Jul 15 18:51:20.308702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:20.308651    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14344h16m34.150197903s"
Jul 15 18:51:20.334604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:20.333900    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:20.334604 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:20.334031    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:20.334604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:20.334450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:20.334604 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:20.334546    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:21.332477 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:21.332441    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:21.332922 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:21.332595    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:21.936813 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:21.936774    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:21.937023 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:21.936923    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:21.937023 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:21.936986    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs podName:a29b97d4-7ee7-4343-9fc5-a1d7b355d8af nodeName:}" failed. No retries permitted until 2026-07-15 18:51:25.936966886 +0000 UTC m=+10.118739549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs") pod "network-metrics-daemon-jjh6s" (UID: "a29b97d4-7ee7-4343-9fc5-a1d7b355d8af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:22.037300 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:22.037247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:22.037473 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:22.037332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:22.037556 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:22.037482    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:51:22.037556 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:22.037506    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:51:22.037556 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:22.037521    2571 projected.go:196] Error preparing data for projected volume kube-api-access-mshc6 for pod openshift-network-diagnostics/network-check-target-zxt7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:22.037707 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:22.037622    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6 podName:666c5065-674a-4251-aef5-78678916dcf0 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:26.037562265 +0000 UTC m=+10.219334939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mshc6" (UniqueName: "kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6") pod "network-check-target-zxt7k" (UID: "666c5065-674a-4251-aef5-78678916dcf0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:22.038120 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:22.038100    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:22.038196 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:22.038161    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret podName:770ec833-12f2-442d-8108-0eeec52dea3a nodeName:}" failed. No retries permitted until 2026-07-15 18:51:26.038146011 +0000 UTC m=+10.219918676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret") pod "global-pull-secret-syncer-sgnm6" (UID: "770ec833-12f2-442d-8108-0eeec52dea3a") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:22.332669 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:22.331934    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:22.332669 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:22.332126    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:22.332669 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:22.332246    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:22.332669 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:22.332372    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:23.331736 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:23.331697    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:23.331903 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:23.331840    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:24.331767 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:24.331732    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:24.332269 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:24.331844    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:24.332269 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:24.331906    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:24.332269 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:24.332047    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:25.332196 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:25.332166    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:25.332655 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:25.332315    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:25.970877 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:25.970836    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:25.971072 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:25.971002    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:25.971072 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:25.971063    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs podName:a29b97d4-7ee7-4343-9fc5-a1d7b355d8af nodeName:}" failed. No retries permitted until 2026-07-15 18:51:33.971042627 +0000 UTC m=+18.152815294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs") pod "network-metrics-daemon-jjh6s" (UID: "a29b97d4-7ee7-4343-9fc5-a1d7b355d8af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:26.071345 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:26.071310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:26.071511 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:26.071377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:26.071511 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:26.071488    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:26.071511 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:26.071504    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:51:26.071661 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:26.071519    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:51:26.071661 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:26.071531    2571 projected.go:196] Error preparing data for projected volume kube-api-access-mshc6 for pod openshift-network-diagnostics/network-check-target-zxt7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:26.071661 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:26.071562    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret podName:770ec833-12f2-442d-8108-0eeec52dea3a nodeName:}" failed. No retries permitted until 2026-07-15 18:51:34.071542688 +0000 UTC m=+18.253315393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret") pod "global-pull-secret-syncer-sgnm6" (UID: "770ec833-12f2-442d-8108-0eeec52dea3a") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:26.071661 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:26.071581    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6 podName:666c5065-674a-4251-aef5-78678916dcf0 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:34.071572334 +0000 UTC m=+18.253344987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mshc6" (UniqueName: "kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6") pod "network-check-target-zxt7k" (UID: "666c5065-674a-4251-aef5-78678916dcf0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:26.333995 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:26.333263    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:26.333995 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:26.333388    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:26.333995 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:26.333742    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:26.333995 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:26.333842    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:27.331891 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:27.331667    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:27.332100 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:27.332020    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:28.331849 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:28.331811    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:28.331849 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:28.331848    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:28.332379 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:28.331944    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:28.332379 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:28.332106    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:29.332555 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:29.332520    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:29.332970 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:29.332670    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:30.331927 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:30.331884    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:30.332094 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:30.332006    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:30.332171 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:30.332097    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:30.332227 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:30.332207    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:31.331596 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:31.331565    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:31.332034 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:31.331690    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:32.332358 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:32.332317    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:32.332358 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:32.332356    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:32.332853 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:32.332452    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:32.332853 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:32.332544    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:33.331897 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:33.331864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:33.332064 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:33.331996    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:34.033703 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:34.033675    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:34.034053 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.033775    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:34.034053 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.033824    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs podName:a29b97d4-7ee7-4343-9fc5-a1d7b355d8af nodeName:}" failed. No retries permitted until 2026-07-15 18:51:50.033807504 +0000 UTC m=+34.215580152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs") pod "network-metrics-daemon-jjh6s" (UID: "a29b97d4-7ee7-4343-9fc5-a1d7b355d8af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:34.134329 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:34.134236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:34.134485 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:34.134426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:34.134485 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.134438    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:51:34.134595 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.134504    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:34.134595 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.134564    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret podName:770ec833-12f2-442d-8108-0eeec52dea3a nodeName:}" failed. No retries permitted until 2026-07-15 18:51:50.134545758 +0000 UTC m=+34.316318411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret") pod "global-pull-secret-syncer-sgnm6" (UID: "770ec833-12f2-442d-8108-0eeec52dea3a") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:34.134595 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.134508    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:51:34.134732 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.134602    2571 projected.go:196] Error preparing data for projected volume kube-api-access-mshc6 for pod openshift-network-diagnostics/network-check-target-zxt7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:34.134732 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.134661    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6 podName:666c5065-674a-4251-aef5-78678916dcf0 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:50.134646416 +0000 UTC m=+34.316419078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mshc6" (UniqueName: "kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6") pod "network-check-target-zxt7k" (UID: "666c5065-674a-4251-aef5-78678916dcf0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:34.335071 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:34.335044    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:34.335250 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.335161    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:34.335387 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:34.335364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:34.335532 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:34.335463    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:35.331758 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:35.331724    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:35.332203 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:35.331839    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:36.333429 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:36.333390    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:36.333852 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:36.333503    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:36.333852 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:36.333541    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:36.333852 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:36.333616    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:37.331524 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:37.331494    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:37.331707 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:37.331610    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:38.335314 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.333451    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:38.335314 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:38.333749    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:38.335314 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.333545    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:38.335314 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:38.333984    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:38.747378 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.747140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26" event={"ID":"27497247-85c5-48cb-89f0-f7cef85b34e2","Type":"ContainerStarted","Data":"7be5a28c5f88db240e4487a644ef8c99dd067061e2fabb5fb9a2bcc403c0aeab"}
Jul 15 18:51:38.748461 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.748439    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q279n" event={"ID":"d24ba7f2-ffe6-41f3-b180-409a5b377d9a","Type":"ContainerStarted","Data":"0cc074d52f5e28f061432572d48ff5b1c9e5d9995b423ec3fd47fd928c536339"}
Jul 15 18:51:38.749772 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.749747    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l9dbk" event={"ID":"427e95a8-c850-44bd-b203-06dc475f06b2","Type":"ContainerStarted","Data":"3023cdf65f0095b307f3c1dfa16f0a8f3aa0d4351edf25993c8fd300c7b7e3ee"}
Jul 15 18:51:38.751106 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.751081    2571 generic.go:356] "Generic (PLEG): container finished" podID="29c73127-918d-4b8b-93f8-d1cafcaced4b" containerID="a18fba4c60ed6dd7f384be0ab44156df4db015619ecf872cc8d224b505bacbaa" exitCode=0
Jul 15 18:51:38.751183 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.751109    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sc4zx" event={"ID":"29c73127-918d-4b8b-93f8-d1cafcaced4b","Type":"ContainerDied","Data":"a18fba4c60ed6dd7f384be0ab44156df4db015619ecf872cc8d224b505bacbaa"}
Jul 15 18:51:38.752675 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.752649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8f7cx" event={"ID":"bda29dcc-2bcd-41cf-9222-9bdd6d736afa","Type":"ContainerStarted","Data":"c0bfeee49e688a77d7d9fc77702b6b6526206071ad9ce9191a28e9fcb7d26184"}
Jul 15 18:51:38.754053 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.754012    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfnbg" event={"ID":"36c5fcb6-02c3-43da-affa-4aaea3d1767e","Type":"ContainerStarted","Data":"8a400e75b1c6f01c270e3dcc5a0f0968a5deeac427382fcac09237b6c450b134"}
Jul 15 18:51:38.755952 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.755935    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 18:51:38.756233 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.756217    2571 generic.go:356] "Generic (PLEG): container finished" podID="7ad7dc16-b990-45fc-a39b-1639612de7b3" containerID="9521519d7813f0be7bd1d857f3f420146a5b4a2698fdfa10d1645778577ffd3e" exitCode=1
Jul 15 18:51:38.756301 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.756272    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerStarted","Data":"62f96032e40d24753722782a294ce9264567cd55530fe53e726634d0e3374248"}
Jul 15 18:51:38.756499 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.756333    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerStarted","Data":"44d57a868b79686b6818bbc67635f10028c1c528141dea4b207d8ccac38fd190"}
Jul 15 18:51:38.756499 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.756364    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerDied","Data":"9521519d7813f0be7bd1d857f3f420146a5b4a2698fdfa10d1645778577ffd3e"}
Jul 15 18:51:38.756499 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.756397    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerStarted","Data":"552d4ccd8da3ab0886cd37abbda722e34727f2f3c076c8dd80bbd9fbd9a86579"}
Jul 15 18:51:38.757462 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.757444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sckqh" event={"ID":"f2ec0d0f-67af-4da1-bc2a-7eca409852d0","Type":"ContainerStarted","Data":"27f6e119215aadfee5ed67a473b296fcda6937a0052a838049d0d5e0c63e221e"}
Jul 15 18:51:38.758975 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.758954    2571 generic.go:356] "Generic (PLEG): container finished" podID="4a4630631040b00b5b7262f1ad99b11e" containerID="6ca7a9f5ffa102ffc330c83d39ebd952de94be1e047c27105e75fb37ab7b718c" exitCode=0
Jul 15 18:51:38.759065 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.759033    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal" event={"ID":"4a4630631040b00b5b7262f1ad99b11e","Type":"ContainerDied","Data":"6ca7a9f5ffa102ffc330c83d39ebd952de94be1e047c27105e75fb37ab7b718c"}
Jul 15 18:51:38.760248 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.760232    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal" event={"ID":"27d6e657e0fc42c84018a1763a94d169","Type":"ContainerStarted","Data":"66c31f08912f11bab09198e3b93fdd6faac92e00a0d3fa05f6e40dee549f7551"}
Jul 15 18:51:38.765848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.765811    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q279n" podStartSLOduration=2.345035731 podStartE2EDuration="21.765799861s" totalImagesPullingTime="19.42076413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:38.765611399 +0000 UTC m=+22.947384068" watchObservedRunningTime="2026-07-15 18:51:38.765799861 +0000 UTC m=+22.947572537"
Jul 15 18:51:38.798142 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.798112    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l9dbk" podStartSLOduration=2.401164657 podStartE2EDuration="21.798100648s" totalImagesPullingTime="19.396935991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:38.797703711 +0000 UTC m=+22.979476380" watchObservedRunningTime="2026-07-15 18:51:38.798100648 +0000 UTC m=+22.979873318"
Jul 15 18:51:38.825492 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.825459    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8f7cx" podStartSLOduration=2.459403232 podStartE2EDuration="21.82544839s" totalImagesPullingTime="19.366045158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:38.825241556 +0000 UTC m=+23.007014226" watchObservedRunningTime="2026-07-15 18:51:38.82544839 +0000 UTC m=+23.007221059"
Jul 15 18:51:38.839064 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.839016    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-233.ec2.internal" podStartSLOduration=20.839005167 podStartE2EDuration="20.839005167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:38.838933023 +0000 UTC m=+23.020705691" watchObservedRunningTime="2026-07-15 18:51:38.839005167 +0000 UTC m=+23.020777837"
Jul 15 18:51:38.857421 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.857377    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sckqh" podStartSLOduration=3.443798144 podStartE2EDuration="22.857360502s" totalImagesPullingTime="19.413562358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:38.856791093 +0000 UTC m=+23.038563967" watchObservedRunningTime="2026-07-15 18:51:38.857360502 +0000 UTC m=+23.039133173"
Jul 15 18:51:38.874028 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:38.873993    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dfnbg" podStartSLOduration=2.478755403 podStartE2EDuration="21.873981563s" totalImagesPullingTime="19.39522616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:38.873624677 +0000 UTC m=+23.055397347" watchObservedRunningTime="2026-07-15 18:51:38.873981563 +0000 UTC m=+23.055754232"
Jul 15 18:51:39.331978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:39.331932    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:39.332153 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:39.332057    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:39.673603 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:39.673577    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 18:51:39.764805 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:39.764773    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2xkdk" event={"ID":"19e2acdf-274f-4fd4-9322-47ac0c7cefa0","Type":"ContainerStarted","Data":"6055d6f2cd913633975d322b7256a3afdbcb5b12a18d2ea923b1053c6d41434d"}
Jul 15 18:51:39.768014 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:39.767990    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 18:51:39.768442 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:39.768414    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerStarted","Data":"591c2ed5117bc7cc3ff528dd099e1e7ae57fc3adf0278e3c9bb429bd2c0d140f"}
Jul 15 18:51:39.768597 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:39.768492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerStarted","Data":"2615f9dcb86d26264175745748a6adedca484f3747b436969010ca7c1f011f29"}
Jul 15 18:51:39.770369 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:39.770315    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal" event={"ID":"4a4630631040b00b5b7262f1ad99b11e","Type":"ContainerStarted","Data":"1497d26d38c6a5f15fea8e56f682f8d5ab489ef8efa050d99ab4a733e3f1d48e"}
Jul 15 18:51:39.772239 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:39.772213    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26" event={"ID":"27497247-85c5-48cb-89f0-f7cef85b34e2","Type":"ContainerStarted","Data":"e8b5b45a155d4578599d677d408657f500a9916d497cc4c6fd57663fc9688576"}
Jul 15 18:51:39.784186 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:39.784141    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2xkdk" podStartSLOduration=3.3822738230000002 podStartE2EDuration="22.784127178s" totalImagesPullingTime="19.401853355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:39.783615842 +0000 UTC m=+23.965388510" watchObservedRunningTime="2026-07-15 18:51:39.784127178 +0000 UTC m=+23.965899847"
Jul 15 18:51:40.311524 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:40.311395    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T18:51:39.673597979Z","UUID":"6f7d9ed7-ee20-4d09-ba90-20a85f183a67","Handler":null,"Name":"","Endpoint":""}
Jul 15 18:51:40.313580 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:40.313552    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 18:51:40.313722 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:40.313609    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 18:51:40.331879 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:40.331724    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:40.331879 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:40.331725    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:40.331879 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:40.331851    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:40.332112 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:40.331909    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:41.331978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:41.331778    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:41.332379 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:41.332084    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:42.331666 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:42.331627    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:42.331899 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:42.331627    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:42.331899 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:42.331746    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:42.331899 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:42.331829    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:43.332355 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.332325    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:43.332948 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:43.332440    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:43.662261 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.662180    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:43.662831 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.662812    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:43.677024 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.676986    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-233.ec2.internal" podStartSLOduration=25.676973255 podStartE2EDuration="25.676973255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:39.799304442 +0000 UTC m=+23.981077111" watchObservedRunningTime="2026-07-15 18:51:43.676973255 +0000 UTC m=+27.858745919"
Jul 15 18:51:43.782986 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.782961    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 18:51:43.783390 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.783362    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerStarted","Data":"6bb7e7214c26b399f69e7786c37c31dfeaad3c1116d3c9fd779b993b1a3e9577"}
Jul 15 18:51:43.785148 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.785122    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26" event={"ID":"27497247-85c5-48cb-89f0-f7cef85b34e2","Type":"ContainerStarted","Data":"b9c5cbeb5674bb680f48fb3e350aeda515d21d404051abc0f841a8581d96129d"}
Jul 15 18:51:43.786788 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.786764    2571 generic.go:356] "Generic (PLEG): container finished" podID="29c73127-918d-4b8b-93f8-d1cafcaced4b" containerID="82e07d872dda2e6bdb3780357709b48ab4bcbf3d5822c30611b614ac5b34524b" exitCode=0
Jul 15 18:51:43.786879 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.786845    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sc4zx" event={"ID":"29c73127-918d-4b8b-93f8-d1cafcaced4b","Type":"ContainerDied","Data":"82e07d872dda2e6bdb3780357709b48ab4bcbf3d5822c30611b614ac5b34524b"}
Jul 15 18:51:43.787103 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.787090    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:43.787832 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.787521    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l9dbk"
Jul 15 18:51:43.822360 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:43.822303    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlb26" podStartSLOduration=3.163833067 podStartE2EDuration="26.822273265s" totalImagesPullingTime="23.658440198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:43.801351982 +0000 UTC m=+27.983124651" watchObservedRunningTime="2026-07-15 18:51:43.822273265 +0000 UTC m=+28.004045935"
Jul 15 18:51:44.332064 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:44.332033    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:44.332212 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:44.332067    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:44.332212 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:44.332153    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:44.332316 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:44.332244    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:45.332464 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:45.332301    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:45.332910 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:45.332546    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:45.792527 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:45.792442    2571 generic.go:356] "Generic (PLEG): container finished" podID="29c73127-918d-4b8b-93f8-d1cafcaced4b" containerID="a139692ae63dd7933f46df3d3ba87828dd508211dbe94f52c1c9f3fb3757c633" exitCode=0
Jul 15 18:51:45.792684 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:45.792529    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sc4zx" event={"ID":"29c73127-918d-4b8b-93f8-d1cafcaced4b","Type":"ContainerDied","Data":"a139692ae63dd7933f46df3d3ba87828dd508211dbe94f52c1c9f3fb3757c633"}
Jul 15 18:51:45.795920 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:45.795903    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 18:51:45.796256 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:45.796235    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerStarted","Data":"6ef0430f9a72df4b4c35c263cd1cb67646127c758bb51ebc9d2835c37e047ab1"}
Jul 15 18:51:45.796830 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:45.796815    2571 scope.go:117] "RemoveContainer" containerID="9521519d7813f0be7bd1d857f3f420146a5b4a2698fdfa10d1645778577ffd3e"
Jul 15 18:51:46.332891 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.332861    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:46.333363 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:46.332962    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:46.333363 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.333011    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:46.333363 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:46.333109    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:46.802067 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.802046    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 18:51:46.802427 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.802404    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" event={"ID":"7ad7dc16-b990-45fc-a39b-1639612de7b3","Type":"ContainerStarted","Data":"4de60c5949c46461944e4653a1c05870aad179946212667a497770d33815134d"}
Jul 15 18:51:46.802702 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.802681    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:46.802774 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.802761    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:46.802834 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.802812    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:46.818190 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.818167    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:46.818559 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.818487    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:51:46.837347 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:46.837309    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn" podStartSLOduration=11.241369883 podStartE2EDuration="30.837275738s" totalImagesPullingTime="19.595905855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:46.83679307 +0000 UTC m=+31.018565739" watchObservedRunningTime="2026-07-15 18:51:46.837275738 +0000 UTC m=+31.019048407"
Jul 15 18:51:47.091424 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:47.091154    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxt7k"]
Jul 15 18:51:47.091572 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:47.091531    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:47.091658 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:47.091635    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:47.094411 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:47.094381    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sgnm6"]
Jul 15 18:51:47.094557 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:47.094496    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:47.094624 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:47.094604    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:47.095040 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:47.095018    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jjh6s"]
Jul 15 18:51:47.095159 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:47.095097    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:47.095214 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:47.095191    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:47.806647 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:47.806617    2571 generic.go:356] "Generic (PLEG): container finished" podID="29c73127-918d-4b8b-93f8-d1cafcaced4b" containerID="bbe1319b23fa6575c78beab78fedc88e4a7b9f5627271e0d8ae8662a85b0eb43" exitCode=0
Jul 15 18:51:47.807134 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:47.806701    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sc4zx" event={"ID":"29c73127-918d-4b8b-93f8-d1cafcaced4b","Type":"ContainerDied","Data":"bbe1319b23fa6575c78beab78fedc88e4a7b9f5627271e0d8ae8662a85b0eb43"}
Jul 15 18:51:48.331606 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:48.331573    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:48.331834 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:48.331579    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:48.331834 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:48.331724    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:48.331834 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:48.331782    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:49.332386 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:49.332357    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:49.332921 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:49.332472    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxt7k" podUID="666c5065-674a-4251-aef5-78678916dcf0"
Jul 15 18:51:50.050808 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.050770    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:50.051056 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.050922    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:50.051056 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.050985    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs podName:a29b97d4-7ee7-4343-9fc5-a1d7b355d8af nodeName:}" failed. No retries permitted until 2026-07-15 18:52:22.050968594 +0000 UTC m=+66.232741246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs") pod "network-metrics-daemon-jjh6s" (UID: "a29b97d4-7ee7-4343-9fc5-a1d7b355d8af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:50.151602 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.151561    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:50.151787 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.151719    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:50.151787 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.151723    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:50.151904 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.151796    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret podName:770ec833-12f2-442d-8108-0eeec52dea3a nodeName:}" failed. No retries permitted until 2026-07-15 18:52:22.15177453 +0000 UTC m=+66.333547193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret") pod "global-pull-secret-syncer-sgnm6" (UID: "770ec833-12f2-442d-8108-0eeec52dea3a") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:50.151904 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.151875    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:51:50.151904 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.151891    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:51:50.152040 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.151921    2571 projected.go:196] Error preparing data for projected volume kube-api-access-mshc6 for pod openshift-network-diagnostics/network-check-target-zxt7k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:50.152040 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.152003    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6 podName:666c5065-674a-4251-aef5-78678916dcf0 nodeName:}" failed. No retries permitted until 2026-07-15 18:52:22.1519865 +0000 UTC m=+66.333759160 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mshc6" (UniqueName: "kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6") pod "network-check-target-zxt7k" (UID: "666c5065-674a-4251-aef5-78678916dcf0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:50.332389 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.332359    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:50.332807 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.332360    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:50.332807 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.332472    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sgnm6" podUID="770ec833-12f2-442d-8108-0eeec52dea3a"
Jul 15 18:51:50.332807 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.332581    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jjh6s" podUID="a29b97d4-7ee7-4343-9fc5-a1d7b355d8af"
Jul 15 18:51:50.617583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.617551    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-233.ec2.internal" event="NodeReady"
Jul 15 18:51:50.617727 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.617714    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 18:51:50.702138 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.702105    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dms9z"]
Jul 15 18:51:50.721233 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.721182    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7ldd8"]
Jul 15 18:51:50.721427 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.721348    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.728060 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.727910    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-dms9z\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="8908c39a-e77d-4ffb-9a4c-20861d71dc39" pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.728060 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.728018    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret"
Jul 15 18:51:50.728060 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.728018    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 15 18:51:50.733782 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.733756    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-hvwrn\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hvwrn\"" type="*v1.Secret"
Jul 15 18:51:50.734350 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.734316    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap"
Jul 15 18:51:50.734454 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.734353    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 15 18:51:50.737161 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.737138    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:50.743337 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.743298    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 15 18:51:50.743456 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.743368    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-jj7q8\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jj7q8\"" type="*v1.Secret"
Jul 15 18:51:50.743456 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.743377    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 15 18:51:50.743456 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.743425    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-dms9z\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="8908c39a-e77d-4ffb-9a4c-20861d71dc39" pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.743667 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.743466    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"canary-serving-cert\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret"
Jul 15 18:51:50.744661 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.744638    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dms9z"]
Jul 15 18:51:50.746019 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:50.745988    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"ingress-canary-7ldd8\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="3a038d65-4618-4f97-889f-009deb195006" pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:50.749332 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.749261    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l66rv"]
Jul 15 18:51:50.754694 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.754674    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8908c39a-e77d-4ffb-9a4c-20861d71dc39-data-volume\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.754790 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.754700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.754790 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.754724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jcx8\" (UniqueName: \"kubernetes.io/projected/3a038d65-4618-4f97-889f-009deb195006-kube-api-access-9jcx8\") pod \"ingress-canary-7ldd8\" (UID: \"3a038d65-4618-4f97-889f-009deb195006\") " pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:50.754790 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.754743    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8908c39a-e77d-4ffb-9a4c-20861d71dc39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.754923 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.754818    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x44h\" (UniqueName: \"kubernetes.io/projected/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-api-access-6x44h\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.754923 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.754869    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8908c39a-e77d-4ffb-9a4c-20861d71dc39-crio-socket\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.754923 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.754883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a038d65-4618-4f97-889f-009deb195006-cert\") pod \"ingress-canary-7ldd8\" (UID: \"3a038d65-4618-4f97-889f-009deb195006\") " pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:50.771604 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.771580    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7ldd8"]
Jul 15 18:51:50.771716 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.771692    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.777520 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.777496    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l66rv"]
Jul 15 18:51:50.780189 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.780172    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mxlws\""
Jul 15 18:51:50.780302 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.780172    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 18:51:50.780302 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.780178    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 18:51:50.856198 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856109    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5grgb\" (UniqueName: \"kubernetes.io/projected/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-kube-api-access-5grgb\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.856198 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856153    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8908c39a-e77d-4ffb-9a4c-20861d71dc39-data-volume\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.856198 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856181    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.856478 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856224    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcx8\" (UniqueName: \"kubernetes.io/projected/3a038d65-4618-4f97-889f-009deb195006-kube-api-access-9jcx8\") pod \"ingress-canary-7ldd8\" (UID: \"3a038d65-4618-4f97-889f-009deb195006\") " pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:50.856478 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8908c39a-e77d-4ffb-9a4c-20861d71dc39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.856478 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856295    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-config-volume\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.856478 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x44h\" (UniqueName: \"kubernetes.io/projected/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-api-access-6x44h\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.856478 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-tmp-dir\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.856478 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856388    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-metrics-tls\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.856478 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856412    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8908c39a-e77d-4ffb-9a4c-20861d71dc39-crio-socket\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.856478 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a038d65-4618-4f97-889f-009deb195006-cert\") pod \"ingress-canary-7ldd8\" (UID: \"3a038d65-4618-4f97-889f-009deb195006\") " pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:50.856832 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856499    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8908c39a-e77d-4ffb-9a4c-20861d71dc39-data-volume\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.856832 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.856735    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8908c39a-e77d-4ffb-9a4c-20861d71dc39-crio-socket\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:50.957774 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.957731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-config-volume\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.957774 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.957794    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-tmp-dir\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.958030 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.957843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-metrics-tls\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.958030 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.957900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5grgb\" (UniqueName: \"kubernetes.io/projected/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-kube-api-access-5grgb\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.958408 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.958371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-tmp-dir\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.958509 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.958464    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-config-volume\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.963017 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.962993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-metrics-tls\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:50.972451 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:50.972432    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5grgb\" (UniqueName: \"kubernetes.io/projected/8e2bc8cd-8875-4c41-abaf-f3260f3a96be-kube-api-access-5grgb\") pod \"dns-default-l66rv\" (UID: \"8e2bc8cd-8875-4c41-abaf-f3260f3a96be\") " pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:51.082493 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.082456    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:51.332063 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.332027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:51:51.336154 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.336126    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rz9k9\""
Jul 15 18:51:51.336642 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.336174    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 18:51:51.336642 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.336295    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 18:51:51.693931 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.693680    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 18:51:51.748053 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.748016    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hvwrn\""
Jul 15 18:51:51.752495 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.752465    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 18:51:51.759657 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.759629    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a038d65-4618-4f97-889f-009deb195006-cert\") pod \"ingress-canary-7ldd8\" (UID: \"3a038d65-4618-4f97-889f-009deb195006\") " pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:51.856548 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.856514    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition
Jul 15 18:51:51.856729 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.856524    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition
Jul 15 18:51:51.856729 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.856616    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-rbac-proxy-cm podName:8908c39a-e77d-4ffb-9a4c-20861d71dc39 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:52.356593019 +0000 UTC m=+36.538365707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dms9z" (UID: "8908c39a-e77d-4ffb-9a4c-20861d71dc39") : failed to sync configmap cache: timed out waiting for the condition
Jul 15 18:51:51.856729 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.856701    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8908c39a-e77d-4ffb-9a4c-20861d71dc39-insights-runtime-extractor-tls podName:8908c39a-e77d-4ffb-9a4c-20861d71dc39 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:52.356681021 +0000 UTC m=+36.538453682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8908c39a-e77d-4ffb-9a4c-20861d71dc39-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dms9z" (UID: "8908c39a-e77d-4ffb-9a4c-20861d71dc39") : failed to sync secret cache: timed out waiting for the condition
Jul 15 18:51:51.875710 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.875680    2571 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 15 18:51:51.875853 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.875719    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6x44h for pod openshift-insights/insights-runtime-extractor-dms9z: failed to sync configmap cache: timed out waiting for the condition
Jul 15 18:51:51.875853 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.875771    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-api-access-6x44h podName:8908c39a-e77d-4ffb-9a4c-20861d71dc39 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:52.375751366 +0000 UTC m=+36.557524014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6x44h" (UniqueName: "kubernetes.io/projected/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-api-access-6x44h") pod "insights-runtime-extractor-dms9z" (UID: "8908c39a-e77d-4ffb-9a4c-20861d71dc39") : failed to sync configmap cache: timed out waiting for the condition
Jul 15 18:51:51.884890 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.884866    2571 projected.go:291] Couldn't get configMap openshift-ingress-canary/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 15 18:51:51.951966 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.951899    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 18:51:51.958541 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.958524    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 18:51:51.959383 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:51.959371    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 18:51:51.965339 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.965324    2571 projected.go:196] Error preparing data for projected volume kube-api-access-9jcx8 for pod openshift-ingress-canary/ingress-canary-7ldd8: failed to sync configmap cache: timed out waiting for the condition
Jul 15 18:51:51.965429 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:51.965419    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a038d65-4618-4f97-889f-009deb195006-kube-api-access-9jcx8 podName:3a038d65-4618-4f97-889f-009deb195006 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:52.465400802 +0000 UTC m=+36.647173453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9jcx8" (UniqueName: "kubernetes.io/projected/3a038d65-4618-4f97-889f-009deb195006-kube-api-access-9jcx8") pod "ingress-canary-7ldd8" (UID: "3a038d65-4618-4f97-889f-009deb195006") : failed to sync configmap cache: timed out waiting for the condition
Jul 15 18:51:52.018021 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.017995    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jj7q8\""
Jul 15 18:51:52.029247 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.029216    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 18:51:52.146874 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.146844    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l66rv"]
Jul 15 18:51:52.213822 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:52.213728    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2bc8cd_8875_4c41_abaf_f3260f3a96be.slice/crio-ac875803fbdc5748562b0ac997ab0b5b432561f32b5be6a365d3d65c9f9584d9 WatchSource:0}: Error finding container ac875803fbdc5748562b0ac997ab0b5b432561f32b5be6a365d3d65c9f9584d9: Status 404 returned error can't find the container with id ac875803fbdc5748562b0ac997ab0b5b432561f32b5be6a365d3d65c9f9584d9
Jul 15 18:51:52.252810 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.252790    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 18:51:52.332555 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.332530    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:51:52.332688 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.332665    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:51:52.335733 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.335548    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5nvc9\""
Jul 15 18:51:52.335733 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.335651    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 18:51:52.335733 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.335720    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 18:51:52.371749 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.371722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:52.372119 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.371778    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8908c39a-e77d-4ffb-9a4c-20861d71dc39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:52.372456 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.372431    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:52.374839 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.374817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8908c39a-e77d-4ffb-9a4c-20861d71dc39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:52.473226 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.473130    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcx8\" (UniqueName: \"kubernetes.io/projected/3a038d65-4618-4f97-889f-009deb195006-kube-api-access-9jcx8\") pod \"ingress-canary-7ldd8\" (UID: \"3a038d65-4618-4f97-889f-009deb195006\") " pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:52.473226 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.473187    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x44h\" (UniqueName: \"kubernetes.io/projected/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-api-access-6x44h\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:52.475477 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.475451    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x44h\" (UniqueName: \"kubernetes.io/projected/8908c39a-e77d-4ffb-9a4c-20861d71dc39-kube-api-access-6x44h\") pod \"insights-runtime-extractor-dms9z\" (UID: \"8908c39a-e77d-4ffb-9a4c-20861d71dc39\") " pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:52.475608 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.475591    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jcx8\" (UniqueName: \"kubernetes.io/projected/3a038d65-4618-4f97-889f-009deb195006-kube-api-access-9jcx8\") pod \"ingress-canary-7ldd8\" (UID: \"3a038d65-4618-4f97-889f-009deb195006\") " pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:52.531413 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.531380    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dms9z"
Jul 15 18:51:52.548118 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.548089    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7ldd8"
Jul 15 18:51:52.548330 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.548297    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65887c7789-cwdp5"]
Jul 15 18:51:52.576986 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.576962    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65887c7789-cwdp5"]
Jul 15 18:51:52.577086 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.577055    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.580126 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.579943    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5h69\""
Jul 15 18:51:52.580126 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.579960    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 18:51:52.580126 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.579944    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 18:51:52.580371 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.580188    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 18:51:52.580371 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.580235    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 18:51:52.580371 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.580271    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 18:51:52.580560 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.580533    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 18:51:52.580669 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.580541    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 18:51:52.586909 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.586889    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 18:51:52.675065 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.674882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-service-ca\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.675205 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.675101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-serving-cert\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.675205 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.675126    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-oauth-config\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.675205 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.675141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-config\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.675205 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.675162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-trusted-ca-bundle\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.675205 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.675194    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j58h9\" (UniqueName: \"kubernetes.io/projected/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-kube-api-access-j58h9\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.675448 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.675260    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-oauth-serving-cert\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.683511 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.683475    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dms9z"]
Jul 15 18:51:52.686778 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:52.686753    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8908c39a_e77d_4ffb_9a4c_20861d71dc39.slice/crio-4eae6c17cfb10379549d0ee429a67c1e9c82a9c9eeab0db5904c4ce0b91b1f53 WatchSource:0}: Error finding container 4eae6c17cfb10379549d0ee429a67c1e9c82a9c9eeab0db5904c4ce0b91b1f53: Status 404 returned error can't find the container with id 4eae6c17cfb10379549d0ee429a67c1e9c82a9c9eeab0db5904c4ce0b91b1f53
Jul 15 18:51:52.701175 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.701140    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7ldd8"]
Jul 15 18:51:52.704845 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:52.704807    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a038d65_4618_4f97_889f_009deb195006.slice/crio-f7958617bb11d3c15086096607b67c2ddba72718db729c0baf42743ce864482b WatchSource:0}: Error finding container f7958617bb11d3c15086096607b67c2ddba72718db729c0baf42743ce864482b: Status 404 returned error can't find the container with id f7958617bb11d3c15086096607b67c2ddba72718db729c0baf42743ce864482b
Jul 15 18:51:52.776023 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.775941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-oauth-serving-cert\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.776023 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.775998    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-service-ca\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.776197 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.776035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-serving-cert\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.776197 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.776050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-oauth-config\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.776197 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.776065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-config\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.776197 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.776079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-trusted-ca-bundle\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.776197 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.776096    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j58h9\" (UniqueName: \"kubernetes.io/projected/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-kube-api-access-j58h9\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.777096 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.777060    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-oauth-serving-cert\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.777096 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.777065    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-config\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.777312 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.777068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-service-ca\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.777361 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.777346    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-trusted-ca-bundle\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.780347 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.779557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-oauth-config\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.780347 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.780107    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-serving-cert\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.785253 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.785229    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j58h9\" (UniqueName: \"kubernetes.io/projected/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-kube-api-access-j58h9\") pod \"console-65887c7789-cwdp5\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") " pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:52.820864 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.820829    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l66rv" event={"ID":"8e2bc8cd-8875-4c41-abaf-f3260f3a96be","Type":"ContainerStarted","Data":"ac875803fbdc5748562b0ac997ab0b5b432561f32b5be6a365d3d65c9f9584d9"}
Jul 15 18:51:52.822151 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.822118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dms9z" event={"ID":"8908c39a-e77d-4ffb-9a4c-20861d71dc39","Type":"ContainerStarted","Data":"4eae6c17cfb10379549d0ee429a67c1e9c82a9c9eeab0db5904c4ce0b91b1f53"}
Jul 15 18:51:52.825139 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.825117    2571 generic.go:356] "Generic (PLEG): container finished" podID="29c73127-918d-4b8b-93f8-d1cafcaced4b" containerID="8e7cba583f77c1e3c5c44fee5b71328b4881acc8d1348d21f026ec8e1f0a118e" exitCode=0
Jul 15 18:51:52.825296 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.825146    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sc4zx" event={"ID":"29c73127-918d-4b8b-93f8-d1cafcaced4b","Type":"ContainerDied","Data":"8e7cba583f77c1e3c5c44fee5b71328b4881acc8d1348d21f026ec8e1f0a118e"}
Jul 15 18:51:52.826643 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.826620    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7ldd8" event={"ID":"3a038d65-4618-4f97-889f-009deb195006","Type":"ContainerStarted","Data":"f7958617bb11d3c15086096607b67c2ddba72718db729c0baf42743ce864482b"}
Jul 15 18:51:52.889382 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:52.889344    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:51:53.092876 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:53.092842    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65887c7789-cwdp5"]
Jul 15 18:51:53.096010 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:51:53.095981    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bdf1b2_0b3b_4628_bf73_eb6e1223f998.slice/crio-4790ba13d60d2717c3f48799134a4133a608ba3df28f5b0c3ff97f318114f580 WatchSource:0}: Error finding container 4790ba13d60d2717c3f48799134a4133a608ba3df28f5b0c3ff97f318114f580: Status 404 returned error can't find the container with id 4790ba13d60d2717c3f48799134a4133a608ba3df28f5b0c3ff97f318114f580
Jul 15 18:51:53.834704 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:53.834614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65887c7789-cwdp5" event={"ID":"13bdf1b2-0b3b-4628-bf73-eb6e1223f998","Type":"ContainerStarted","Data":"4790ba13d60d2717c3f48799134a4133a608ba3df28f5b0c3ff97f318114f580"}
Jul 15 18:51:53.841305 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:53.841259    2571 generic.go:356] "Generic (PLEG): container finished" podID="29c73127-918d-4b8b-93f8-d1cafcaced4b" containerID="293f5fea59ae4797573fe78074941c7bc67e5445b54a38bedd99dc71c220db90" exitCode=0
Jul 15 18:51:53.841427 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:53.841321    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sc4zx" event={"ID":"29c73127-918d-4b8b-93f8-d1cafcaced4b","Type":"ContainerDied","Data":"293f5fea59ae4797573fe78074941c7bc67e5445b54a38bedd99dc71c220db90"}
Jul 15 18:51:54.084124 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.084057    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"]
Jul 15 18:51:54.098490 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.098425    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"]
Jul 15 18:51:54.098622 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.098532    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"
Jul 15 18:51:54.101340 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.101313    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 18:51:54.101340 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.101333    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xxzxp\""
Jul 15 18:51:54.193669 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.193631    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f24e5c7-3af1-4207-9716-800dc82fb233-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x69gv\" (UID: \"7f24e5c7-3af1-4207-9716-800dc82fb233\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"
Jul 15 18:51:54.294370 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.294335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f24e5c7-3af1-4207-9716-800dc82fb233-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x69gv\" (UID: \"7f24e5c7-3af1-4207-9716-800dc82fb233\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"
Jul 15 18:51:54.294605 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:54.294547    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 18:51:54.294685 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:51:54.294666    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f24e5c7-3af1-4207-9716-800dc82fb233-tls-certificates podName:7f24e5c7-3af1-4207-9716-800dc82fb233 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:54.794645084 +0000 UTC m=+38.976417755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7f24e5c7-3af1-4207-9716-800dc82fb233-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-x69gv" (UID: "7f24e5c7-3af1-4207-9716-800dc82fb233") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 18:51:54.799852 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.799454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f24e5c7-3af1-4207-9716-800dc82fb233-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x69gv\" (UID: \"7f24e5c7-3af1-4207-9716-800dc82fb233\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"
Jul 15 18:51:54.802900 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.802872    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f24e5c7-3af1-4207-9716-800dc82fb233-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x69gv\" (UID: \"7f24e5c7-3af1-4207-9716-800dc82fb233\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"
Jul 15 18:51:54.849087 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.848944    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sc4zx" event={"ID":"29c73127-918d-4b8b-93f8-d1cafcaced4b","Type":"ContainerStarted","Data":"d3dc430e7e2ade3093215f9f2905479c67e27bca92b944975711d8652c4511b5"}
Jul 15 18:51:54.852093 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.852034    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l66rv" event={"ID":"8e2bc8cd-8875-4c41-abaf-f3260f3a96be","Type":"ContainerStarted","Data":"9b662cba4004477c069208653292fc24241cea3c884253ecb2ef237b4d307ad4"}
Jul 15 18:51:54.852093 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.852088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l66rv" event={"ID":"8e2bc8cd-8875-4c41-abaf-f3260f3a96be","Type":"ContainerStarted","Data":"1edae0b4c198514489a73f0156eca4ca91c8ddb18d8d6be158b110355d4a2ccf"}
Jul 15 18:51:54.856591 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.856481    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l66rv"
Jul 15 18:51:54.876446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.876393    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sc4zx" podStartSLOduration=9.045395482 podStartE2EDuration="38.876376362s" totalImagesPullingTime="29.83098088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:54.875547399 +0000 UTC m=+39.057320079" watchObservedRunningTime="2026-07-15 18:51:54.876376362 +0000 UTC m=+39.058149031"
Jul 15 18:51:54.892867 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:54.892809    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l66rv" podStartSLOduration=2.611885284 podStartE2EDuration="4.892788431s" totalImagesPullingTime="2.280903147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:54.891687474 +0000 UTC m=+39.073460141" watchObservedRunningTime="2026-07-15 18:51:54.892788431 +0000 UTC m=+39.074561095"
Jul 15 18:51:55.011886 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:51:55.011700    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"
Jul 15 18:52:00.861105 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:00.861081    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"]
Jul 15 18:52:00.865373 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:00.865318    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f24e5c7_3af1_4207_9716_800dc82fb233.slice/crio-0ea2ab3562260e11d95117d83db239de20aa0dc55a06084388324cf3ce91ec72 WatchSource:0}: Error finding container 0ea2ab3562260e11d95117d83db239de20aa0dc55a06084388324cf3ce91ec72: Status 404 returned error can't find the container with id 0ea2ab3562260e11d95117d83db239de20aa0dc55a06084388324cf3ce91ec72
Jul 15 18:52:01.872848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:01.872806    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dms9z" event={"ID":"8908c39a-e77d-4ffb-9a4c-20861d71dc39","Type":"ContainerStarted","Data":"2e711dfcc7ce9ab63e55f71ab041ec2a8896e3e32b736e60382b60526b8f88fd"}
Jul 15 18:52:01.874615 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:01.874582    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7ldd8" event={"ID":"3a038d65-4618-4f97-889f-009deb195006","Type":"ContainerStarted","Data":"9f319a5f55a8707c13037cac1506548cdf2c62f1737dc4f5f51ebcac92bfe6c4"}
Jul 15 18:52:01.875925 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:01.875897    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv" event={"ID":"7f24e5c7-3af1-4207-9716-800dc82fb233","Type":"ContainerStarted","Data":"0ea2ab3562260e11d95117d83db239de20aa0dc55a06084388324cf3ce91ec72"}
Jul 15 18:52:01.877588 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:01.877562    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65887c7789-cwdp5" event={"ID":"13bdf1b2-0b3b-4628-bf73-eb6e1223f998","Type":"ContainerStarted","Data":"7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921"}
Jul 15 18:52:01.893298 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:01.893230    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7ldd8" podStartSLOduration=3.863199242 podStartE2EDuration="11.89321267s" totalImagesPullingTime="8.030013428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:01.892157861 +0000 UTC m=+46.073930545" watchObservedRunningTime="2026-07-15 18:52:01.89321267 +0000 UTC m=+46.074985341"
Jul 15 18:52:02.883550 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:02.883465    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv" event={"ID":"7f24e5c7-3af1-4207-9716-800dc82fb233","Type":"ContainerStarted","Data":"907fcac498b1ed7ee69134bac08c8bd0314d54fb21e2f67abf296a4e23a08bdb"}
Jul 15 18:52:02.890072 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:02.890046    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:52:02.890210 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:02.890088    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:52:02.891636 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:02.891602    2571 patch_prober.go:28] interesting pod/console-65887c7789-cwdp5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 15 18:52:02.891742 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:02.891659    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65887c7789-cwdp5" podUID="13bdf1b2-0b3b-4628-bf73-eb6e1223f998" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 15 18:52:02.898792 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:02.898752    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65887c7789-cwdp5" podStartSLOduration=3.233781979 podStartE2EDuration="10.898736545s" totalImagesPullingTime="7.664954566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:01.910828352 +0000 UTC m=+46.092601024" watchObservedRunningTime="2026-07-15 18:52:02.898736545 +0000 UTC m=+47.080509240"
Jul 15 18:52:02.898903 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:02.898841    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv" podStartSLOduration=7.156457983 podStartE2EDuration="8.898837017s" totalImagesPullingTime="1.742379034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:02.898313226 +0000 UTC m=+47.080085896" watchObservedRunningTime="2026-07-15 18:52:02.898837017 +0000 UTC m=+47.080609688"
Jul 15 18:52:03.894570 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:03.894535    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"
Jul 15 18:52:03.899249 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:03.899228    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x69gv"
Jul 15 18:52:05.859614 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:05.859585    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l66rv"
Jul 15 18:52:05.901885 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:05.901856    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dms9z" event={"ID":"8908c39a-e77d-4ffb-9a4c-20861d71dc39","Type":"ContainerStarted","Data":"9f8d2fa8809ea50fe1fe7ee6fb7f8a994c7d403c357aa9bfe5e8bcd702f087a3"}
Jul 15 18:52:09.916584 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:09.916550    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dms9z" event={"ID":"8908c39a-e77d-4ffb-9a4c-20861d71dc39","Type":"ContainerStarted","Data":"6e2babf4ee1d63003c5f1e3dad6f4bec60a8cefacf3a66ce237ac8da229566bc"}
Jul 15 18:52:12.893736 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:12.893703    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:52:12.897414 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:12.897388    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:52:12.912125 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:12.912077    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dms9z" podStartSLOduration=6.869371802 podStartE2EDuration="22.912062568s" totalImagesPullingTime="16.042690766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:09.933589893 +0000 UTC m=+54.115362582" watchObservedRunningTime="2026-07-15 18:52:12.912062568 +0000 UTC m=+57.093835237"
Jul 15 18:52:14.683943 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.683910    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-bl898"]
Jul 15 18:52:14.714143 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.714114    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4sdqn"]
Jul 15 18:52:14.714324 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.714247    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.719375 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.719353    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 18:52:14.719816 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.719793    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 18:52:14.720827 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.720810    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rvnn7\""
Jul 15 18:52:14.721171 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.721137    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 18:52:14.721272 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.721177    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 18:52:14.721272 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.721229    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 18:52:14.721411 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.721401    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 18:52:14.727740 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.727721    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-bl898"]
Jul 15 18:52:14.727828 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.727811    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.730173 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.730154    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ls8b7\""
Jul 15 18:52:14.730433 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.730417    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 18:52:14.730500 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.730417    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 18:52:14.730578 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.730561    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 18:52:14.852821 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.852787    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-textfile\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.852821 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.852820    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-tls\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.853007 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.852843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-accelerators-collector-config\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.853007 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.852920    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.853007 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.852951    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19889de1-41fa-427f-b542-e330fdc5090e-root\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.853007 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.852968    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwh5k\" (UniqueName: \"kubernetes.io/projected/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-api-access-dwh5k\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.853007 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.852985    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-wtmp\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.853007 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.853002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19889de1-41fa-427f-b542-e330fdc5090e-metrics-client-ca\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.853187 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.853072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.853187 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.853112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwl5\" (UniqueName: \"kubernetes.io/projected/19889de1-41fa-427f-b542-e330fdc5090e-kube-api-access-kkwl5\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.853187 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.853135    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.853187 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.853150    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19889de1-41fa-427f-b542-e330fdc5090e-sys\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.853187 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.853186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.853375 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.853201    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.853375 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.853242    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.953790 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.953706    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.953790 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.953741    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19889de1-41fa-427f-b542-e330fdc5090e-root\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.953790 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.953763    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwh5k\" (UniqueName: \"kubernetes.io/projected/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-api-access-dwh5k\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.953790 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.953787    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-wtmp\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.953834    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19889de1-41fa-427f-b542-e330fdc5090e-root\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.953887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19889de1-41fa-427f-b542-e330fdc5090e-metrics-client-ca\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.953905    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-wtmp\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.953957    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.954168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954002    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwl5\" (UniqueName: \"kubernetes.io/projected/19889de1-41fa-427f-b542-e330fdc5090e-kube-api-access-kkwl5\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.954168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954061    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19889de1-41fa-427f-b542-e330fdc5090e-sys\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19889de1-41fa-427f-b542-e330fdc5090e-sys\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954168    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.954632 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954194    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.954632 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954224    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954632 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954407    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.954632 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954464    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-textfile\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954632 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954490    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-tls\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954632 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954525    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-accelerators-collector-config\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954632 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19889de1-41fa-427f-b542-e330fdc5090e-metrics-client-ca\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954952 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954798    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-textfile\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.954952 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954863    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.954952 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.954887    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.955094 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.955027    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-accelerators-collector-config\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.956909 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.956883    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-tls\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.956909 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.956900    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19889de1-41fa-427f-b542-e330fdc5090e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:14.957039 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.956940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.957039 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.956978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.964143 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.964117    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwh5k\" (UniqueName: \"kubernetes.io/projected/21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb-kube-api-access-dwh5k\") pod \"kube-state-metrics-785778ff74-bl898\" (UID: \"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:14.964476 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:14.964455    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwl5\" (UniqueName: \"kubernetes.io/projected/19889de1-41fa-427f-b542-e330fdc5090e-kube-api-access-kkwl5\") pod \"node-exporter-4sdqn\" (UID: \"19889de1-41fa-427f-b542-e330fdc5090e\") " pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:15.022549 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.022520    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898"
Jul 15 18:52:15.036178 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.036151    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4sdqn"
Jul 15 18:52:15.045994 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:15.045968    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19889de1_41fa_427f_b542_e330fdc5090e.slice/crio-ae0c604e65f5df1670e7b789a7ed5b0050139b996baad0f2cbdc134f652bdd08 WatchSource:0}: Error finding container ae0c604e65f5df1670e7b789a7ed5b0050139b996baad0f2cbdc134f652bdd08: Status 404 returned error can't find the container with id ae0c604e65f5df1670e7b789a7ed5b0050139b996baad0f2cbdc134f652bdd08
Jul 15 18:52:15.146231 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.146192    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-bl898"]
Jul 15 18:52:15.150592 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:15.150566    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f058ef_b9ed_4ba2_a73e_4b9ca2ceadeb.slice/crio-d100c7c57f3cdfa5ffe066cd3d7f737dee735f96245f379868b53a6a56627605 WatchSource:0}: Error finding container d100c7c57f3cdfa5ffe066cd3d7f737dee735f96245f379868b53a6a56627605: Status 404 returned error can't find the container with id d100c7c57f3cdfa5ffe066cd3d7f737dee735f96245f379868b53a6a56627605
Jul 15 18:52:15.525529 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.525493    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 18:52:15.529036 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.529013    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.531712 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.531676    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 18:52:15.531712 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.531708    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 18:52:15.531897 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.531718    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 18:52:15.531897 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.531723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 18:52:15.531897 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.531681    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 18:52:15.532099 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.532086    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 18:52:15.532155 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.532112    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 18:52:15.532227 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.532212    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v5gzx\""
Jul 15 18:52:15.532306 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.532252    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 18:52:15.532306 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.532260    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 18:52:15.545352 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.545332    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 18:52:15.660651 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa298d10-3a9b-444a-9d61-8774f20d764d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.660848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660668    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa298d10-3a9b-444a-9d61-8774f20d764d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.660848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660691    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa298d10-3a9b-444a-9d61-8774f20d764d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.660848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.660848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660754    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa298d10-3a9b-444a-9d61-8774f20d764d-config-out\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.660848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660778    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.660848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.661155 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660879    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.661155 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660929    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa298d10-3a9b-444a-9d61-8774f20d764d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.661155 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4vqt\" (UniqueName: \"kubernetes.io/projected/fa298d10-3a9b-444a-9d61-8774f20d764d-kube-api-access-z4vqt\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.661155 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.660995    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.661155 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.661017    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-web-config\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.661155 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.661037    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.762251 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762212    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.762731 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762260    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa298d10-3a9b-444a-9d61-8774f20d764d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.762731 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4vqt\" (UniqueName: \"kubernetes.io/projected/fa298d10-3a9b-444a-9d61-8774f20d764d-kube-api-access-z4vqt\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.762731 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.762731 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-web-config\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.762731 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.762731 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa298d10-3a9b-444a-9d61-8774f20d764d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.762731 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762715    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa298d10-3a9b-444a-9d61-8774f20d764d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.763107 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa298d10-3a9b-444a-9d61-8774f20d764d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.763107 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa298d10-3a9b-444a-9d61-8774f20d764d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.763107 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:52:15.762847    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa298d10-3a9b-444a-9d61-8774f20d764d-alertmanager-trusted-ca-bundle podName:fa298d10-3a9b-444a-9d61-8774f20d764d nodeName:}" failed. No retries permitted until 2026-07-15 18:52:16.262825028 +0000 UTC m=+60.444597679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/fa298d10-3a9b-444a-9d61-8774f20d764d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "fa298d10-3a9b-444a-9d61-8774f20d764d") : configmap references non-existent config key: ca-bundle.crt
Jul 15 18:52:15.763107 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762885    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.763107 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762922    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa298d10-3a9b-444a-9d61-8774f20d764d-config-out\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.763107 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.763107 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.762987    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.763593 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.763569    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa298d10-3a9b-444a-9d61-8774f20d764d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.765338 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.765311    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.765928 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.765905    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.766045 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.765926    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.766106 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.766073    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-web-config\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.766547 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.766528    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa298d10-3a9b-444a-9d61-8774f20d764d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.766780 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.766763    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.766879 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.766861    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa298d10-3a9b-444a-9d61-8774f20d764d-config-out\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.766953 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.766933    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.767594 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.767577    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa298d10-3a9b-444a-9d61-8774f20d764d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.770879 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.770856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4vqt\" (UniqueName: \"kubernetes.io/projected/fa298d10-3a9b-444a-9d61-8774f20d764d-kube-api-access-z4vqt\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:15.937992 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.937948    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898" event={"ID":"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb","Type":"ContainerStarted","Data":"d100c7c57f3cdfa5ffe066cd3d7f737dee735f96245f379868b53a6a56627605"}
Jul 15 18:52:15.939320 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:15.939275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4sdqn" event={"ID":"19889de1-41fa-427f-b542-e330fdc5090e","Type":"ContainerStarted","Data":"ae0c604e65f5df1670e7b789a7ed5b0050139b996baad0f2cbdc134f652bdd08"}
Jul 15 18:52:16.268493 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:16.268397    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa298d10-3a9b-444a-9d61-8774f20d764d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:16.269253 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:16.269226    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa298d10-3a9b-444a-9d61-8774f20d764d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa298d10-3a9b-444a-9d61-8774f20d764d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:16.441757 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:16.441721    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v5gzx\""
Jul 15 18:52:16.449419 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:16.449389    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:52:16.646740 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:16.644425    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 18:52:16.883712 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:16.883677    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa298d10_3a9b_444a_9d61_8774f20d764d.slice/crio-42ee2d09e99eb5485ca594dd3fbcc25d746b70df3ef9542acc7502b9dc163929 WatchSource:0}: Error finding container 42ee2d09e99eb5485ca594dd3fbcc25d746b70df3ef9542acc7502b9dc163929: Status 404 returned error can't find the container with id 42ee2d09e99eb5485ca594dd3fbcc25d746b70df3ef9542acc7502b9dc163929
Jul 15 18:52:16.943742 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:16.943712    2571 generic.go:356] "Generic (PLEG): container finished" podID="19889de1-41fa-427f-b542-e330fdc5090e" containerID="aa11dd003c8c60143ca87e064781cdc9abe5956e9a454624d0d0ed4b3f957cb6" exitCode=0
Jul 15 18:52:16.943866 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:16.943810    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4sdqn" event={"ID":"19889de1-41fa-427f-b542-e330fdc5090e","Type":"ContainerDied","Data":"aa11dd003c8c60143ca87e064781cdc9abe5956e9a454624d0d0ed4b3f957cb6"}
Jul 15 18:52:16.945148 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:16.945121    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa298d10-3a9b-444a-9d61-8774f20d764d","Type":"ContainerStarted","Data":"42ee2d09e99eb5485ca594dd3fbcc25d746b70df3ef9542acc7502b9dc163929"}
Jul 15 18:52:17.546873 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.546836    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5955df595c-cp9qk"]
Jul 15 18:52:17.549969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.549942    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.552773 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.552745    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-62v7s\""
Jul 15 18:52:17.553051 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.552745    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 18:52:17.553051 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.552752    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 18:52:17.553217 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.553074    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 18:52:17.553217 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.553175    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3d9qe51khca1p\""
Jul 15 18:52:17.554031 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.554012    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 18:52:17.554164 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.554091    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 18:52:17.563680 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.563660    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5955df595c-cp9qk"]
Jul 15 18:52:17.678839 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.678797    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-tls\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.678839 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.678836    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-grpc-tls\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.679046 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.678914    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.679046 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.679008    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.679046 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.679037    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7b4f414-50a3-480a-a93c-45adc8f73305-metrics-client-ca\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.679135 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.679063    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.679135 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.679094    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7dxk\" (UniqueName: \"kubernetes.io/projected/c7b4f414-50a3-480a-a93c-45adc8f73305-kube-api-access-v7dxk\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.679196 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.679146    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.780593 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.780555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.780763 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.780658    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.780763 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.780694    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7b4f414-50a3-480a-a93c-45adc8f73305-metrics-client-ca\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.780763 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.780732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.780889 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.780761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7dxk\" (UniqueName: \"kubernetes.io/projected/c7b4f414-50a3-480a-a93c-45adc8f73305-kube-api-access-v7dxk\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.780889 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.780792    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.780889 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.780826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-tls\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.780889 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.780843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-grpc-tls\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.781896 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.781863    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7b4f414-50a3-480a-a93c-45adc8f73305-metrics-client-ca\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.783798 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.783716    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.783798 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.783751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-grpc-tls\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.783798 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.783757    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-tls\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.784655 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.784616    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.784787 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.784767    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.784958 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.784937    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7b4f414-50a3-480a-a93c-45adc8f73305-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.789621 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.789591    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7dxk\" (UniqueName: \"kubernetes.io/projected/c7b4f414-50a3-480a-a93c-45adc8f73305-kube-api-access-v7dxk\") pod \"thanos-querier-5955df595c-cp9qk\" (UID: \"c7b4f414-50a3-480a-a93c-45adc8f73305\") " pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.861984 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.861956    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:17.951731 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.951693    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898" event={"ID":"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb","Type":"ContainerStarted","Data":"0f5f4ac9ded0c34fc11f757be7819c68be94eb922b958bc4e00321310d631d3a"}
Jul 15 18:52:17.952194 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.951764    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898" event={"ID":"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb","Type":"ContainerStarted","Data":"4d825586d5c0d973d8af868f36efa1fc3c7da775eaed3f39cac5d1f2caf99f02"}
Jul 15 18:52:17.952194 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.951826    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898" event={"ID":"21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb","Type":"ContainerStarted","Data":"8b7ac51be891a13245cf0c1b6ede966a87421eb2a447c3866ed9424fb696e853"}
Jul 15 18:52:17.954016 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.953992    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4sdqn" event={"ID":"19889de1-41fa-427f-b542-e330fdc5090e","Type":"ContainerStarted","Data":"3b8a7a245e47b5ee16f956618ec25892a960ddc36b8214409181f0e60bfd0632"}
Jul 15 18:52:17.954157 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.954031    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4sdqn" event={"ID":"19889de1-41fa-427f-b542-e330fdc5090e","Type":"ContainerStarted","Data":"e8dcc04a5ce619cfc6175eb3c9f5b313bc71a62accddeda38e7b3d2d03371bc0"}
Jul 15 18:52:17.972355 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.972312    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-bl898" podStartSLOduration=2.215295192 podStartE2EDuration="3.972277417s" totalImagesPullingTime="1.756982225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:17.97071874 +0000 UTC m=+62.152491420" watchObservedRunningTime="2026-07-15 18:52:17.972277417 +0000 UTC m=+62.154050088"
Jul 15 18:52:17.989936 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:17.989886    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4sdqn" podStartSLOduration=2.998826342 podStartE2EDuration="3.989867436s" totalImagesPullingTime="928.885315ms" totalInitContainerRuntime="62.155779ms" isStatefulPod=true podCreationTimestamp="2026-07-15 18:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:17.988798485 +0000 UTC m=+62.170571156" watchObservedRunningTime="2026-07-15 18:52:17.989867436 +0000 UTC m=+62.171640105"
Jul 15 18:52:18.194570 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.194538    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5955df595c-cp9qk"]
Jul 15 18:52:18.244987 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:18.244953    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b4f414_50a3_480a_a93c_45adc8f73305.slice/crio-e4677e7d53d66f3faf735e19f291394044ba79ddc75e373d76b91941f144661b WatchSource:0}: Error finding container e4677e7d53d66f3faf735e19f291394044ba79ddc75e373d76b91941f144661b: Status 404 returned error can't find the container with id e4677e7d53d66f3faf735e19f291394044ba79ddc75e373d76b91941f144661b
Jul 15 18:52:18.820676 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.820644    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6gmn"
Jul 15 18:52:18.904517 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.904483    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b574d89d9-q4nhx"]
Jul 15 18:52:18.906807 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.906786    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:18.909587 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.909549    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 18:52:18.909712 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.909601    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-apd9os3ri7ro\""
Jul 15 18:52:18.909712 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.909604    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 18:52:18.909712 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.909634    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 18:52:18.909712 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.909559    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 18:52:18.909712 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.909705    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cxkcj\""
Jul 15 18:52:18.917472 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.917446    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b574d89d9-q4nhx"]
Jul 15 18:52:18.958837 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.958805    2571 generic.go:356] "Generic (PLEG): container finished" podID="fa298d10-3a9b-444a-9d61-8774f20d764d" containerID="e5a539758e238d8af561827830410ba23642130f246772f07a7993c6ba6aa6de" exitCode=0
Jul 15 18:52:18.959236 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.958849    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa298d10-3a9b-444a-9d61-8774f20d764d","Type":"ContainerDied","Data":"e5a539758e238d8af561827830410ba23642130f246772f07a7993c6ba6aa6de"}
Jul 15 18:52:18.960196 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.960171    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk" event={"ID":"c7b4f414-50a3-480a-a93c-45adc8f73305","Type":"ContainerStarted","Data":"e4677e7d53d66f3faf735e19f291394044ba79ddc75e373d76b91941f144661b"}
Jul 15 18:52:18.990786 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.990753    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42899\" (UniqueName: \"kubernetes.io/projected/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-kube-api-access-42899\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:18.990786 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.990786    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:18.990921 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.990807    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-client-ca-bundle\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:18.990921 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.990897    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-audit-log\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:18.991035 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.991018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-metrics-server-audit-profiles\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:18.991069 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.991048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-secret-metrics-server-tls\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:18.991110 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:18.991085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-secret-metrics-server-client-certs\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.092509 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.092430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-secret-metrics-server-client-certs\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.092684 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.092616    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42899\" (UniqueName: \"kubernetes.io/projected/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-kube-api-access-42899\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.092684 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.092648    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.092799 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.092706    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-client-ca-bundle\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.093123 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.093095    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-audit-log\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.093689 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.093370    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-metrics-server-audit-profiles\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.093689 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.093435    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-secret-metrics-server-tls\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.093689 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.093513    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-audit-log\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.093878 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.093797    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.094313 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.094274    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-metrics-server-audit-profiles\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.095105 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.095085    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-secret-metrics-server-client-certs\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.095589 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.095569    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-client-ca-bundle\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.095669 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.095600    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-secret-metrics-server-tls\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.101896 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.101873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42899\" (UniqueName: \"kubernetes.io/projected/d07bad1c-c9a0-4c3a-99cd-a56ea597f779-kube-api-access-42899\") pod \"metrics-server-7b574d89d9-q4nhx\" (UID: \"d07bad1c-c9a0-4c3a-99cd-a56ea597f779\") " pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.215263 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.215222    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:19.278090 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.278059    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"]
Jul 15 18:52:19.280481 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.280461    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:19.284299 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.283218    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kmtwf\""
Jul 15 18:52:19.284299 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.283517    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 18:52:19.285804 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.285771    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-95585f764-vtwqj"]
Jul 15 18:52:19.287626 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.287609    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.290395 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.290375    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"]
Jul 15 18:52:19.298325 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.298302    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95585f764-vtwqj"]
Jul 15 18:52:19.354610 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.354583    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b574d89d9-q4nhx"]
Jul 15 18:52:19.357481 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:19.357447    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07bad1c_c9a0_4c3a_99cd_a56ea597f779.slice/crio-cafe69cba98122c9c7647868d014443c410ab8543c10b36f53126260adbeb5a0 WatchSource:0}: Error finding container cafe69cba98122c9c7647868d014443c410ab8543c10b36f53126260adbeb5a0: Status 404 returned error can't find the container with id cafe69cba98122c9c7647868d014443c410ab8543c10b36f53126260adbeb5a0
Jul 15 18:52:19.396454 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.396411    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbf7l\" (UniqueName: \"kubernetes.io/projected/efda30d4-4dc9-41d2-a13b-dbb605101ea5-kube-api-access-hbf7l\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.396582 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.396473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad119ff4-df1b-4027-8ae3-407b8fd15ecd-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-g8fdf\" (UID: \"ad119ff4-df1b-4027-8ae3-407b8fd15ecd\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:19.396582 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.396549    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-trusted-ca-bundle\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.396582 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.396578    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-service-ca\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.396916 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.396882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-config\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.397011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.396931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-oauth-serving-cert\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.397011 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.396978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-serving-cert\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.397111 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.397024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-oauth-config\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.397111 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.397091    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmnm5\" (UniqueName: \"kubernetes.io/projected/ad119ff4-df1b-4027-8ae3-407b8fd15ecd-kube-api-access-fmnm5\") pod \"monitoring-plugin-5f68df7f58-g8fdf\" (UID: \"ad119ff4-df1b-4027-8ae3-407b8fd15ecd\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:19.497719 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.497685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbf7l\" (UniqueName: \"kubernetes.io/projected/efda30d4-4dc9-41d2-a13b-dbb605101ea5-kube-api-access-hbf7l\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.497898 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.497734    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad119ff4-df1b-4027-8ae3-407b8fd15ecd-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-g8fdf\" (UID: \"ad119ff4-df1b-4027-8ae3-407b8fd15ecd\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:19.497898 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.497776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-trusted-ca-bundle\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.497898 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.497803    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-service-ca\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.497898 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.497847    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-config\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.497898 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.497871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-oauth-serving-cert\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.498147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.497915    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-serving-cert\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.498147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.497970    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-oauth-config\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.498147 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.498005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmnm5\" (UniqueName: \"kubernetes.io/projected/ad119ff4-df1b-4027-8ae3-407b8fd15ecd-kube-api-access-fmnm5\") pod \"monitoring-plugin-5f68df7f58-g8fdf\" (UID: \"ad119ff4-df1b-4027-8ae3-407b8fd15ecd\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:19.498797 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.498773    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-trusted-ca-bundle\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.499004 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.498984    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-service-ca\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.499067 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.499008    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-oauth-serving-cert\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.499412 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.499390    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-config\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.500985 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.500959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-serving-cert\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.501086 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.501048    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad119ff4-df1b-4027-8ae3-407b8fd15ecd-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-g8fdf\" (UID: \"ad119ff4-df1b-4027-8ae3-407b8fd15ecd\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:19.501356 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.501339    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-oauth-config\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.507298 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.507261    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmnm5\" (UniqueName: \"kubernetes.io/projected/ad119ff4-df1b-4027-8ae3-407b8fd15ecd-kube-api-access-fmnm5\") pod \"monitoring-plugin-5f68df7f58-g8fdf\" (UID: \"ad119ff4-df1b-4027-8ae3-407b8fd15ecd\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:19.507298 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.507274    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbf7l\" (UniqueName: \"kubernetes.io/projected/efda30d4-4dc9-41d2-a13b-dbb605101ea5-kube-api-access-hbf7l\") pod \"console-95585f764-vtwqj\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") " pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.591376 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.591339    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:19.599404 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.599248    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:19.748067 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.748033    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"]
Jul 15 18:52:19.752098 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:19.752071    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad119ff4_df1b_4027_8ae3_407b8fd15ecd.slice/crio-169e21d6c25fa882d566e8a712565d4676172a6129d140684882ad4054d00eb9 WatchSource:0}: Error finding container 169e21d6c25fa882d566e8a712565d4676172a6129d140684882ad4054d00eb9: Status 404 returned error can't find the container with id 169e21d6c25fa882d566e8a712565d4676172a6129d140684882ad4054d00eb9
Jul 15 18:52:19.768961 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.768921    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95585f764-vtwqj"]
Jul 15 18:52:19.771909 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:19.771840    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefda30d4_4dc9_41d2_a13b_dbb605101ea5.slice/crio-5d07fd30ce1393c7fdf0d3a42be6a78fb4e0332afdd09d1b2ab0f66e7989e699 WatchSource:0}: Error finding container 5d07fd30ce1393c7fdf0d3a42be6a78fb4e0332afdd09d1b2ab0f66e7989e699: Status 404 returned error can't find the container with id 5d07fd30ce1393c7fdf0d3a42be6a78fb4e0332afdd09d1b2ab0f66e7989e699
Jul 15 18:52:19.970492 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.970394    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx" event={"ID":"d07bad1c-c9a0-4c3a-99cd-a56ea597f779","Type":"ContainerStarted","Data":"cafe69cba98122c9c7647868d014443c410ab8543c10b36f53126260adbeb5a0"}
Jul 15 18:52:19.972325 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.972274    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95585f764-vtwqj" event={"ID":"efda30d4-4dc9-41d2-a13b-dbb605101ea5","Type":"ContainerStarted","Data":"d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41"}
Jul 15 18:52:19.972447 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.972346    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95585f764-vtwqj" event={"ID":"efda30d4-4dc9-41d2-a13b-dbb605101ea5","Type":"ContainerStarted","Data":"5d07fd30ce1393c7fdf0d3a42be6a78fb4e0332afdd09d1b2ab0f66e7989e699"}
Jul 15 18:52:19.973850 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.973823    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf" event={"ID":"ad119ff4-df1b-4027-8ae3-407b8fd15ecd","Type":"ContainerStarted","Data":"169e21d6c25fa882d566e8a712565d4676172a6129d140684882ad4054d00eb9"}
Jul 15 18:52:19.989327 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:19.989254    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-95585f764-vtwqj" podStartSLOduration=0.989237157 podStartE2EDuration="989.237157ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:19.98880255 +0000 UTC m=+64.170575220" watchObservedRunningTime="2026-07-15 18:52:19.989237157 +0000 UTC m=+64.171009825"
Jul 15 18:52:20.938814 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.938784    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 18:52:20.943192 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.943165    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:20.946065 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.946018    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 18:52:20.946065 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.946039    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 18:52:20.946316 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.946143    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 18:52:20.946443 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.946418    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 18:52:20.947274 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.947226    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cmvnh0t0p45ni\""
Jul 15 18:52:20.947377 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.947233    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 18:52:20.947503 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.947483    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 18:52:20.947677 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.947655    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 18:52:20.947987 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.947970    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 18:52:20.948073 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.948048    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 18:52:20.948140 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.948054    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 18:52:20.948199 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.948158    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 18:52:20.948334 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.948316    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 18:52:20.948408 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.948314    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j2hbg\""
Jul 15 18:52:20.948467 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.948408    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 18:52:20.950001 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.949984    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 18:52:20.959232 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:20.959212    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 18:52:21.113709 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.113677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114099 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.113735    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114099 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.113763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114099 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.113843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114099 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.113953    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-config\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114099 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.113982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114099 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114082    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc3a3213-e98c-45eb-9647-d6abd4165d7a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114433 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114433 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114205    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114433 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114433 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114357    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114433 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc3a3213-e98c-45eb-9647-d6abd4165d7a-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114676 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114469    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114676 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114676 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114576    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114676 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114613    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114676 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114637    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114676 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114663    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114904 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.114904 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.114739    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hmqs\" (UniqueName: \"kubernetes.io/projected/fc3a3213-e98c-45eb-9647-d6abd4165d7a-kube-api-access-4hmqs\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216346 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-config\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216346 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216571 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216371    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc3a3213-e98c-45eb-9647-d6abd4165d7a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216571 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216571 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216571 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216451    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216571 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216493    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216571 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc3a3213-e98c-45eb-9647-d6abd4165d7a-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216571 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216557    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216584    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216667    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216689    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216759    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hmqs\" (UniqueName: \"kubernetes.io/projected/fc3a3213-e98c-45eb-9647-d6abd4165d7a-kube-api-access-4hmqs\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216816    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216847    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.216901 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216875    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.217400 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.216904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.217400 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.217239    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.217635 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.217612    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.219656 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.217965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.219656 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.218052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.219656 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.218065    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.219656 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.219536    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc3a3213-e98c-45eb-9647-d6abd4165d7a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.220535 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.220513    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-config\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.221014 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.220795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.221014 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.220967    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.221442 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.221415    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.221533 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.221500    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc3a3213-e98c-45eb-9647-d6abd4165d7a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.222116 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.222091    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.222654 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.222636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc3a3213-e98c-45eb-9647-d6abd4165d7a-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.223268 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.223244    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.223462 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.223445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.223527 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.223484    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.223580 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.223561    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.224403 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.224384    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.224722 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.224700    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc3a3213-e98c-45eb-9647-d6abd4165d7a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.228473 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.228450    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hmqs\" (UniqueName: \"kubernetes.io/projected/fc3a3213-e98c-45eb-9647-d6abd4165d7a-kube-api-access-4hmqs\") pod \"prometheus-k8s-0\" (UID: \"fc3a3213-e98c-45eb-9647-d6abd4165d7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.255002 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.254972    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:21.667488 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.666036    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 18:52:21.672303 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:21.672230    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3a3213_e98c_45eb_9647_d6abd4165d7a.slice/crio-4805576af53d5c2425a5a6cf25e076c6df4cbb3a61e780f7414524292598a65a WatchSource:0}: Error finding container 4805576af53d5c2425a5a6cf25e076c6df4cbb3a61e780f7414524292598a65a: Status 404 returned error can't find the container with id 4805576af53d5c2425a5a6cf25e076c6df4cbb3a61e780f7414524292598a65a
Jul 15 18:52:21.986609 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.986516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa298d10-3a9b-444a-9d61-8774f20d764d","Type":"ContainerStarted","Data":"808bc0d792ba409b8b184fe69a178b2aaef46216008e1418615eb28e6b37a9f3"}
Jul 15 18:52:21.986609 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.986604    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa298d10-3a9b-444a-9d61-8774f20d764d","Type":"ContainerStarted","Data":"380f3a84597ca3b27a36339d8087c3b0cd6c3b442bc657b016cc0eb09acd4f63"}
Jul 15 18:52:21.986815 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.986650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa298d10-3a9b-444a-9d61-8774f20d764d","Type":"ContainerStarted","Data":"7d6cc6c9d42b329bbbe75c10906999c78546c430a83f7684274c500cbc052d1c"}
Jul 15 18:52:21.986815 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.986690    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa298d10-3a9b-444a-9d61-8774f20d764d","Type":"ContainerStarted","Data":"b8756e202c80ec360c3e9b30f6b3821a9f674b0a57c78f7c2ea5a31af2470180"}
Jul 15 18:52:21.988894 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.988864    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk" event={"ID":"c7b4f414-50a3-480a-a93c-45adc8f73305","Type":"ContainerStarted","Data":"b6ba55017408fa3e4a4b1f384f425f7185be0536d7b7243b41f692172820617a"}
Jul 15 18:52:21.989009 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.988939    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk" event={"ID":"c7b4f414-50a3-480a-a93c-45adc8f73305","Type":"ContainerStarted","Data":"4c47c9b10c8c98c68d2e55133322c45af31fac4373a506954cd7245d37d14c32"}
Jul 15 18:52:21.989009 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.988982    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk" event={"ID":"c7b4f414-50a3-480a-a93c-45adc8f73305","Type":"ContainerStarted","Data":"d49d81e0d57c504131dfc765ec971b6332aae1981faed323af006556f0de9c35"}
Jul 15 18:52:21.990792 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.990766    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx" event={"ID":"d07bad1c-c9a0-4c3a-99cd-a56ea597f779","Type":"ContainerStarted","Data":"5c61e4d045d033c5e31e3f528be073c882054dfda837b3b9bc10dd1f941a6329"}
Jul 15 18:52:21.992456 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.992431    2571 generic.go:356] "Generic (PLEG): container finished" podID="fc3a3213-e98c-45eb-9647-d6abd4165d7a" containerID="55639208ac0b2710344197b5f77ea4ab0e2e90ed6ab5616e920719c6ffcb983d" exitCode=0
Jul 15 18:52:21.992566 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.992513    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc3a3213-e98c-45eb-9647-d6abd4165d7a","Type":"ContainerDied","Data":"55639208ac0b2710344197b5f77ea4ab0e2e90ed6ab5616e920719c6ffcb983d"}
Jul 15 18:52:21.992632 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:21.992585    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc3a3213-e98c-45eb-9647-d6abd4165d7a","Type":"ContainerStarted","Data":"4805576af53d5c2425a5a6cf25e076c6df4cbb3a61e780f7414524292598a65a"}
Jul 15 18:52:22.011954 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.011908    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx" podStartSLOduration=1.894250593 podStartE2EDuration="4.011893984s" totalImagesPullingTime="2.117643391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:22.01147755 +0000 UTC m=+66.193250218" watchObservedRunningTime="2026-07-15 18:52:22.011893984 +0000 UTC m=+66.193666631"
Jul 15 18:52:22.127741 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.127704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:52:22.131991 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.131964    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 18:52:22.141911 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.141874    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a29b97d4-7ee7-4343-9fc5-a1d7b355d8af-metrics-certs\") pod \"network-metrics-daemon-jjh6s\" (UID: \"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af\") " pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:52:22.229337 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.229192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:52:22.229337 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.229297    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:52:22.232309 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.232187    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 18:52:22.232309 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.232200    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 18:52:22.242605 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.242437    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 18:52:22.242984 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.242959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/770ec833-12f2-442d-8108-0eeec52dea3a-original-pull-secret\") pod \"global-pull-secret-syncer-sgnm6\" (UID: \"770ec833-12f2-442d-8108-0eeec52dea3a\") " pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:52:22.253112 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.253088    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mshc6\" (UniqueName: \"kubernetes.io/projected/666c5065-674a-4251-aef5-78678916dcf0-kube-api-access-mshc6\") pod \"network-check-target-zxt7k\" (UID: \"666c5065-674a-4251-aef5-78678916dcf0\") " pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:52:22.343042 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.343008    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sgnm6"
Jul 15 18:52:22.350475 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.350450    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5nvc9\""
Jul 15 18:52:22.357678 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.357653    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jjh6s"
Jul 15 18:52:22.500426 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.500100    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sgnm6"]
Jul 15 18:52:22.514939 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.514831    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jjh6s"]
Jul 15 18:52:22.545828 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.545589    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rz9k9\""
Jul 15 18:52:22.553316 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.553053    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:52:22.625357 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:22.625325    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod770ec833_12f2_442d_8108_0eeec52dea3a.slice/crio-22ca8f6e65431a7d83dd3bc342322653c3a1614c1a986d7f085759e3439db324 WatchSource:0}: Error finding container 22ca8f6e65431a7d83dd3bc342322653c3a1614c1a986d7f085759e3439db324: Status 404 returned error can't find the container with id 22ca8f6e65431a7d83dd3bc342322653c3a1614c1a986d7f085759e3439db324
Jul 15 18:52:22.626666 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:22.626642    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29b97d4_7ee7_4343_9fc5_a1d7b355d8af.slice/crio-ba4d15f6fa7cb082ad1e3345fc9e5dcde24bd60178ca91fd5a6a4604b697a4a6 WatchSource:0}: Error finding container ba4d15f6fa7cb082ad1e3345fc9e5dcde24bd60178ca91fd5a6a4604b697a4a6: Status 404 returned error can't find the container with id ba4d15f6fa7cb082ad1e3345fc9e5dcde24bd60178ca91fd5a6a4604b697a4a6
Jul 15 18:52:22.778010 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:22.777981    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxt7k"]
Jul 15 18:52:22.782051 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:52:22.782023    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666c5065_674a_4251_aef5_78678916dcf0.slice/crio-91ad2e96a0714b4922cd644e0fed8db9cb2046edc7ed109f492cc857b1cfca64 WatchSource:0}: Error finding container 91ad2e96a0714b4922cd644e0fed8db9cb2046edc7ed109f492cc857b1cfca64: Status 404 returned error can't find the container with id 91ad2e96a0714b4922cd644e0fed8db9cb2046edc7ed109f492cc857b1cfca64
Jul 15 18:52:23.001590 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.001544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk" event={"ID":"c7b4f414-50a3-480a-a93c-45adc8f73305","Type":"ContainerStarted","Data":"5d415cb4991d5fdd8f145ebc33202e9ca4e22d68446af30c838a421b1b863bdb"}
Jul 15 18:52:23.001590 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.001631    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk" event={"ID":"c7b4f414-50a3-480a-a93c-45adc8f73305","Type":"ContainerStarted","Data":"0fadfe1bdc499a53631b009eb5bf9d424b8f94002aa697e92ba2e314a3bee68b"}
Jul 15 18:52:23.002030 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.001673    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk" event={"ID":"c7b4f414-50a3-480a-a93c-45adc8f73305","Type":"ContainerStarted","Data":"9f54c8749d27f6e422557e71984914f64e3a138597ba5d010bb40726e1a4fc17"}
Jul 15 18:52:23.002030 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.001913    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:23.003742 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.003682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jjh6s" event={"ID":"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af","Type":"ContainerStarted","Data":"ba4d15f6fa7cb082ad1e3345fc9e5dcde24bd60178ca91fd5a6a4604b697a4a6"}
Jul 15 18:52:23.005236 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.005165    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sgnm6" event={"ID":"770ec833-12f2-442d-8108-0eeec52dea3a","Type":"ContainerStarted","Data":"22ca8f6e65431a7d83dd3bc342322653c3a1614c1a986d7f085759e3439db324"}
Jul 15 18:52:23.007076 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.007012    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf" event={"ID":"ad119ff4-df1b-4027-8ae3-407b8fd15ecd","Type":"ContainerStarted","Data":"b436a50450d4dbfe799d068f89387af6cc6015dea2893802643e0fab8da94c37"}
Jul 15 18:52:23.007174 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.007153    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:23.008808 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.008784    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxt7k" event={"ID":"666c5065-674a-4251-aef5-78678916dcf0","Type":"ContainerStarted","Data":"91ad2e96a0714b4922cd644e0fed8db9cb2046edc7ed109f492cc857b1cfca64"}
Jul 15 18:52:23.013369 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.013250    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa298d10-3a9b-444a-9d61-8774f20d764d","Type":"ContainerStarted","Data":"6fd777f6555436343fda752c550b4d16a856e21404e00843d3fdbc1cd00ce701"}
Jul 15 18:52:23.013464 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.013440    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf"
Jul 15 18:52:23.013519 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.013468    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa298d10-3a9b-444a-9d61-8774f20d764d","Type":"ContainerStarted","Data":"6fc0af69d09118a1733e2b72c1de8c1ffc860884eb9c74e414e84d5a3670b0ee"}
Jul 15 18:52:23.027552 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.027383    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk" podStartSLOduration=1.884795674 podStartE2EDuration="6.027364901s" totalImagesPullingTime="4.142569227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:52:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:23.026230929 +0000 UTC m=+67.208003604" watchObservedRunningTime="2026-07-15 18:52:23.027364901 +0000 UTC m=+67.209137573"
Jul 15 18:52:23.043690 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.043640    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g8fdf" podStartSLOduration=1.566510117 podStartE2EDuration="4.043620397s" totalImagesPullingTime="2.47711028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:23.042365946 +0000 UTC m=+67.224138617" watchObservedRunningTime="2026-07-15 18:52:23.043620397 +0000 UTC m=+67.225393067"
Jul 15 18:52:23.068969 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:23.068916    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.929758744 podStartE2EDuration="8.06889603s" totalImagesPullingTime="4.124708674s" totalInitContainerRuntime="14.428612ms" isStatefulPod=false podCreationTimestamp="2026-07-15 18:52:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:23.067242807 +0000 UTC m=+67.249015499" watchObservedRunningTime="2026-07-15 18:52:23.06889603 +0000 UTC m=+67.250668698"
Jul 15 18:52:24.022219 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:24.022026    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jjh6s" event={"ID":"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af","Type":"ContainerStarted","Data":"deda38a7591ce3579804e937287dec8cd3fc3f906ef03d11af2fd2cc101ebae2"}
Jul 15 18:52:24.022219 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:24.022087    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jjh6s" event={"ID":"a29b97d4-7ee7-4343-9fc5-a1d7b355d8af","Type":"ContainerStarted","Data":"99a0f6a09f37f05da9c74ee2734e5549011a4921e08b11aaadf57b351b215cc0"}
Jul 15 18:52:24.042518 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:24.042226    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jjh6s" podStartSLOduration=67.084925912 podStartE2EDuration="1m8.042203829s" totalImagesPullingTime="957.277917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:24.040377878 +0000 UTC m=+68.222150547" watchObservedRunningTime="2026-07-15 18:52:24.042203829 +0000 UTC m=+68.223976500"
Jul 15 18:52:29.027777 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:29.027749    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5955df595c-cp9qk"
Jul 15 18:52:29.599634 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:29.599604    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:29.599740 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:29.599710    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:29.604557 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:29.604536    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:30.050059 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.049969    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc3a3213-e98c-45eb-9647-d6abd4165d7a","Type":"ContainerStarted","Data":"3abcf71fc117a25661a522039306721b94cc9e070e0e1d19c74d9d13674f97c8"}
Jul 15 18:52:30.050059 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.050050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc3a3213-e98c-45eb-9647-d6abd4165d7a","Type":"ContainerStarted","Data":"d1f31b1149579217c76d85c4977a2054a227d7f080f1e2154ecd20062fc30ea8"}
Jul 15 18:52:30.050589 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.050082    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc3a3213-e98c-45eb-9647-d6abd4165d7a","Type":"ContainerStarted","Data":"3ec945cb2ab1a980f6f37d1d88b6fd8c026bc0af42f1088a50d13bd489b0d84b"}
Jul 15 18:52:30.050589 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.050117    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc3a3213-e98c-45eb-9647-d6abd4165d7a","Type":"ContainerStarted","Data":"3202bbc8a8ab14d7d2a450bd9d4a4f053d96c8eacc4b854cc380f328ee113adb"}
Jul 15 18:52:30.050589 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.050155    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc3a3213-e98c-45eb-9647-d6abd4165d7a","Type":"ContainerStarted","Data":"f24e7a4e4b488b962b8fc575a7a0efeb689f16432af36a269f733cd0b997cac4"}
Jul 15 18:52:30.050589 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.050191    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc3a3213-e98c-45eb-9647-d6abd4165d7a","Type":"ContainerStarted","Data":"e4f0715144339615d71166769241eb8605c1ee756cd7f700d30c532da0c2e7ad"}
Jul 15 18:52:30.051547 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.051515    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sgnm6" event={"ID":"770ec833-12f2-442d-8108-0eeec52dea3a","Type":"ContainerStarted","Data":"8dc6390d0b3bab31b5cbff132cffa0b332df83851298c25bbfb30caf6cd515bb"}
Jul 15 18:52:30.055423 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.055390    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxt7k" event={"ID":"666c5065-674a-4251-aef5-78678916dcf0","Type":"ContainerStarted","Data":"cc1269621c7d7f09fb5f12baf1c6a29e929bdca96f0089493792154d4d97f43b"}
Jul 15 18:52:30.055594 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.055576    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:52:30.059175 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.059155    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:52:30.078832 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.078759    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.96060227 podStartE2EDuration="10.078738397s" totalImagesPullingTime="7.084153858s" totalInitContainerRuntime="33.982269ms" isStatefulPod=false podCreationTimestamp="2026-07-15 18:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:30.07773076 +0000 UTC m=+74.259503431" watchObservedRunningTime="2026-07-15 18:52:30.078738397 +0000 UTC m=+74.260511067"
Jul 15 18:52:30.097656 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.097606    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sgnm6" podStartSLOduration=66.637035717 podStartE2EDuration="1m13.097588383s" totalImagesPullingTime="6.460552666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:30.09747429 +0000 UTC m=+74.279246961" watchObservedRunningTime="2026-07-15 18:52:30.097588383 +0000 UTC m=+74.279361056"
Jul 15 18:52:30.113204 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.113153    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zxt7k" podStartSLOduration=67.811289269 podStartE2EDuration="1m14.113143206s" totalImagesPullingTime="6.301853937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:30.112256774 +0000 UTC m=+74.294029443" watchObservedRunningTime="2026-07-15 18:52:30.113143206 +0000 UTC m=+74.294915873"
Jul 15 18:52:30.156178 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:30.156145    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65887c7789-cwdp5"]
Jul 15 18:52:31.255942 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:31.255906    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:52:39.216094 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:39.215975    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:39.216094 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:39.216039    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:55.176467 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:55.176407    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65887c7789-cwdp5" podUID="13bdf1b2-0b3b-4628-bf73-eb6e1223f998" containerName="console" containerID="cri-o://7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921" gracePeriod=15
Jul 15 18:52:55.961989 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:55.961955    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:52:56.030045 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030013    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-oauth-serving-cert\") pod \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") "
Jul 15 18:52:56.030179 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030063    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-service-ca\") pod \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") "
Jul 15 18:52:56.030179 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030084    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-oauth-config\") pod \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") "
Jul 15 18:52:56.030179 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030106    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-trusted-ca-bundle\") pod \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") "
Jul 15 18:52:56.030179 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030151    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-serving-cert\") pod \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") "
Jul 15 18:52:56.030409 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030188    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-config\") pod \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") "
Jul 15 18:52:56.030409 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030210    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j58h9\" (UniqueName: \"kubernetes.io/projected/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-kube-api-access-j58h9\") pod \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\" (UID: \"13bdf1b2-0b3b-4628-bf73-eb6e1223f998\") "
Jul 15 18:52:56.030509 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030469    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "13bdf1b2-0b3b-4628-bf73-eb6e1223f998" (UID: "13bdf1b2-0b3b-4628-bf73-eb6e1223f998"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:52:56.030568 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030499    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-service-ca" (OuterVolumeSpecName: "service-ca") pod "13bdf1b2-0b3b-4628-bf73-eb6e1223f998" (UID: "13bdf1b2-0b3b-4628-bf73-eb6e1223f998"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:52:56.030664 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "13bdf1b2-0b3b-4628-bf73-eb6e1223f998" (UID: "13bdf1b2-0b3b-4628-bf73-eb6e1223f998"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:52:56.030794 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.030764    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-config" (OuterVolumeSpecName: "console-config") pod "13bdf1b2-0b3b-4628-bf73-eb6e1223f998" (UID: "13bdf1b2-0b3b-4628-bf73-eb6e1223f998"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:52:56.032583 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.032560    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "13bdf1b2-0b3b-4628-bf73-eb6e1223f998" (UID: "13bdf1b2-0b3b-4628-bf73-eb6e1223f998"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:52:56.032667 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.032567    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-kube-api-access-j58h9" (OuterVolumeSpecName: "kube-api-access-j58h9") pod "13bdf1b2-0b3b-4628-bf73-eb6e1223f998" (UID: "13bdf1b2-0b3b-4628-bf73-eb6e1223f998"). InnerVolumeSpecName "kube-api-access-j58h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:52:56.032667 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.032615    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "13bdf1b2-0b3b-4628-bf73-eb6e1223f998" (UID: "13bdf1b2-0b3b-4628-bf73-eb6e1223f998"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:52:56.131216 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.131173    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-serving-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:52:56.131216 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.131209    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-config\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:52:56.131216 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.131219    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j58h9\" (UniqueName: \"kubernetes.io/projected/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-kube-api-access-j58h9\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:52:56.131465 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.131229    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-oauth-serving-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:52:56.131465 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.131238    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:52:56.131465 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.131247    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-console-oauth-config\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:52:56.131465 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.131255    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13bdf1b2-0b3b-4628-bf73-eb6e1223f998-trusted-ca-bundle\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:52:56.170251 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.170220    2571 generic.go:356] "Generic (PLEG): container finished" podID="13bdf1b2-0b3b-4628-bf73-eb6e1223f998" containerID="7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921" exitCode=0
Jul 15 18:52:56.170442 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.170270    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65887c7789-cwdp5"
Jul 15 18:52:56.170442 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.170310    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65887c7789-cwdp5" event={"ID":"13bdf1b2-0b3b-4628-bf73-eb6e1223f998","Type":"ContainerDied","Data":"7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921"}
Jul 15 18:52:56.170442 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.170363    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65887c7789-cwdp5" event={"ID":"13bdf1b2-0b3b-4628-bf73-eb6e1223f998","Type":"ContainerDied","Data":"4790ba13d60d2717c3f48799134a4133a608ba3df28f5b0c3ff97f318114f580"}
Jul 15 18:52:56.170442 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.170383    2571 scope.go:117] "RemoveContainer" containerID="7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921"
Jul 15 18:52:56.192395 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.192129    2571 scope.go:117] "RemoveContainer" containerID="7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921"
Jul 15 18:52:56.192765 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:52:56.192739    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921\": container with ID starting with 7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921 not found: ID does not exist" containerID="7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921"
Jul 15 18:52:56.192826 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.192774    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921"} err="failed to get container status \"7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921\": rpc error: code = NotFound desc = could not find container \"7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921\": container with ID starting with 7043ca3ab17634777bdfb90b7284a22ff08aaddaaa3cea3d3fa753b0ac261921 not found: ID does not exist"
Jul 15 18:52:56.195577 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.195550    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65887c7789-cwdp5"]
Jul 15 18:52:56.201963 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.201934    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65887c7789-cwdp5"]
Jul 15 18:52:56.338043 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:56.338006    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13bdf1b2-0b3b-4628-bf73-eb6e1223f998" path="/var/lib/kubelet/pods/13bdf1b2-0b3b-4628-bf73-eb6e1223f998/volumes"
Jul 15 18:52:59.221549 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:59.221520    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:52:59.225254 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:52:59.225231    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b574d89d9-q4nhx"
Jul 15 18:53:01.062244 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:53:01.062206    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zxt7k"
Jul 15 18:53:21.255685 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:53:21.255653    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:53:21.274683 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:53:21.274654    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:53:21.290752 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:53:21.290726    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:54:06.032837 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:06.032799    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95585f764-vtwqj"]
Jul 15 18:54:31.058520 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.058461    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-95585f764-vtwqj" podUID="efda30d4-4dc9-41d2-a13b-dbb605101ea5" containerName="console" containerID="cri-o://d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41" gracePeriod=15
Jul 15 18:54:31.296520 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.296496    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:54:31.414625 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.414587    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-service-ca\") pod \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") "
Jul 15 18:54:31.414816 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.414641    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-oauth-serving-cert\") pod \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") "
Jul 15 18:54:31.414816 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.414684    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-trusted-ca-bundle\") pod \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") "
Jul 15 18:54:31.414816 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.414713    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-config\") pod \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") "
Jul 15 18:54:31.414816 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.414738    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbf7l\" (UniqueName: \"kubernetes.io/projected/efda30d4-4dc9-41d2-a13b-dbb605101ea5-kube-api-access-hbf7l\") pod \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") "
Jul 15 18:54:31.414816 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.414769    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-serving-cert\") pod \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") "
Jul 15 18:54:31.415071 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.414822    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-oauth-config\") pod \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\" (UID: \"efda30d4-4dc9-41d2-a13b-dbb605101ea5\") "
Jul 15 18:54:31.415167 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.415028    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-service-ca" (OuterVolumeSpecName: "service-ca") pod "efda30d4-4dc9-41d2-a13b-dbb605101ea5" (UID: "efda30d4-4dc9-41d2-a13b-dbb605101ea5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:54:31.415167 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.415151    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "efda30d4-4dc9-41d2-a13b-dbb605101ea5" (UID: "efda30d4-4dc9-41d2-a13b-dbb605101ea5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:54:31.415167 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.415111    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "efda30d4-4dc9-41d2-a13b-dbb605101ea5" (UID: "efda30d4-4dc9-41d2-a13b-dbb605101ea5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:54:31.415367 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.415224    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-config" (OuterVolumeSpecName: "console-config") pod "efda30d4-4dc9-41d2-a13b-dbb605101ea5" (UID: "efda30d4-4dc9-41d2-a13b-dbb605101ea5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:54:31.417075 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.417045    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "efda30d4-4dc9-41d2-a13b-dbb605101ea5" (UID: "efda30d4-4dc9-41d2-a13b-dbb605101ea5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:54:31.417164 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.417071    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efda30d4-4dc9-41d2-a13b-dbb605101ea5-kube-api-access-hbf7l" (OuterVolumeSpecName: "kube-api-access-hbf7l") pod "efda30d4-4dc9-41d2-a13b-dbb605101ea5" (UID: "efda30d4-4dc9-41d2-a13b-dbb605101ea5"). InnerVolumeSpecName "kube-api-access-hbf7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:54:31.417164 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.417112    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "efda30d4-4dc9-41d2-a13b-dbb605101ea5" (UID: "efda30d4-4dc9-41d2-a13b-dbb605101ea5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:54:31.515782 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.515745    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-trusted-ca-bundle\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:54:31.515782 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.515775    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-config\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:54:31.515782 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.515785    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbf7l\" (UniqueName: \"kubernetes.io/projected/efda30d4-4dc9-41d2-a13b-dbb605101ea5-kube-api-access-hbf7l\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:54:31.516009 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.515796    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-serving-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:54:31.516009 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.515804    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efda30d4-4dc9-41d2-a13b-dbb605101ea5-console-oauth-config\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:54:31.516009 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.515812    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:54:31.516009 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.515821    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efda30d4-4dc9-41d2-a13b-dbb605101ea5-oauth-serving-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:54:31.531526 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.531495    2571 generic.go:356] "Generic (PLEG): container finished" podID="efda30d4-4dc9-41d2-a13b-dbb605101ea5" containerID="d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41" exitCode=0
Jul 15 18:54:31.531687 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.531536    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95585f764-vtwqj"
Jul 15 18:54:31.531687 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.531582    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95585f764-vtwqj" event={"ID":"efda30d4-4dc9-41d2-a13b-dbb605101ea5","Type":"ContainerDied","Data":"d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41"}
Jul 15 18:54:31.531687 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.531637    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95585f764-vtwqj" event={"ID":"efda30d4-4dc9-41d2-a13b-dbb605101ea5","Type":"ContainerDied","Data":"5d07fd30ce1393c7fdf0d3a42be6a78fb4e0332afdd09d1b2ab0f66e7989e699"}
Jul 15 18:54:31.531687 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.531664    2571 scope.go:117] "RemoveContainer" containerID="d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41"
Jul 15 18:54:31.539873 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.539856    2571 scope.go:117] "RemoveContainer" containerID="d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41"
Jul 15 18:54:31.540102 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:54:31.540081    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41\": container with ID starting with d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41 not found: ID does not exist" containerID="d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41"
Jul 15 18:54:31.540199 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.540105    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41"} err="failed to get container status \"d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41\": rpc error: code = NotFound desc = could not find container \"d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41\": container with ID starting with d93d80358950af4e9a84b1d97bdcc28a2763fecd195e8e5c6d100aa435efce41 not found: ID does not exist"
Jul 15 18:54:31.553950 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.553919    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95585f764-vtwqj"]
Jul 15 18:54:31.556728 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:31.556705    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-95585f764-vtwqj"]
Jul 15 18:54:32.336656 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:54:32.336616    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efda30d4-4dc9-41d2-a13b-dbb605101ea5" path="/var/lib/kubelet/pods/efda30d4-4dc9-41d2-a13b-dbb605101ea5/volumes"
Jul 15 18:55:48.971068 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.970986    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6dvvp"]
Jul 15 18:55:48.971629 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.971428    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13bdf1b2-0b3b-4628-bf73-eb6e1223f998" containerName="console"
Jul 15 18:55:48.971629 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.971446    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="13bdf1b2-0b3b-4628-bf73-eb6e1223f998" containerName="console"
Jul 15 18:55:48.971629 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.971478    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efda30d4-4dc9-41d2-a13b-dbb605101ea5" containerName="console"
Jul 15 18:55:48.971629 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.971485    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="efda30d4-4dc9-41d2-a13b-dbb605101ea5" containerName="console"
Jul 15 18:55:48.971629 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.971554    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="13bdf1b2-0b3b-4628-bf73-eb6e1223f998" containerName="console"
Jul 15 18:55:48.971629 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.971571    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="efda30d4-4dc9-41d2-a13b-dbb605101ea5" containerName="console"
Jul 15 18:55:48.973613 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.973594    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6dvvp"
Jul 15 18:55:48.976903 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.976885    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 18:55:48.977139 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.977123    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-65lcf\""
Jul 15 18:55:48.978134 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.978121    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 18:55:48.999649 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:48.999624    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6dvvp"]
Jul 15 18:55:49.038139 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:49.038115    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ctq6\" (UniqueName: \"kubernetes.io/projected/590afe25-abbb-4f66-b163-857119f348cd-kube-api-access-9ctq6\") pod \"cert-manager-55b4d954d5-6dvvp\" (UID: \"590afe25-abbb-4f66-b163-857119f348cd\") " pod="cert-manager/cert-manager-55b4d954d5-6dvvp"
Jul 15 18:55:49.038256 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:49.038185    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/590afe25-abbb-4f66-b163-857119f348cd-bound-sa-token\") pod \"cert-manager-55b4d954d5-6dvvp\" (UID: \"590afe25-abbb-4f66-b163-857119f348cd\") " pod="cert-manager/cert-manager-55b4d954d5-6dvvp"
Jul 15 18:55:49.139002 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:49.138972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ctq6\" (UniqueName: \"kubernetes.io/projected/590afe25-abbb-4f66-b163-857119f348cd-kube-api-access-9ctq6\") pod \"cert-manager-55b4d954d5-6dvvp\" (UID: \"590afe25-abbb-4f66-b163-857119f348cd\") " pod="cert-manager/cert-manager-55b4d954d5-6dvvp"
Jul 15 18:55:49.139151 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:49.139052    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/590afe25-abbb-4f66-b163-857119f348cd-bound-sa-token\") pod \"cert-manager-55b4d954d5-6dvvp\" (UID: \"590afe25-abbb-4f66-b163-857119f348cd\") " pod="cert-manager/cert-manager-55b4d954d5-6dvvp"
Jul 15 18:55:49.157739 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:49.157713    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ctq6\" (UniqueName: \"kubernetes.io/projected/590afe25-abbb-4f66-b163-857119f348cd-kube-api-access-9ctq6\") pod \"cert-manager-55b4d954d5-6dvvp\" (UID: \"590afe25-abbb-4f66-b163-857119f348cd\") " pod="cert-manager/cert-manager-55b4d954d5-6dvvp"
Jul 15 18:55:49.157836 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:49.157717    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/590afe25-abbb-4f66-b163-857119f348cd-bound-sa-token\") pod \"cert-manager-55b4d954d5-6dvvp\" (UID: \"590afe25-abbb-4f66-b163-857119f348cd\") " pod="cert-manager/cert-manager-55b4d954d5-6dvvp"
Jul 15 18:55:49.292574 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:49.292494    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6dvvp"
Jul 15 18:55:49.426124 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:49.426025    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6dvvp"]
Jul 15 18:55:49.428628 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:55:49.428599    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod590afe25_abbb_4f66_b163_857119f348cd.slice/crio-9dfd694519329803e6a3d1cccf12cf3334d29b6595c913f7e27c7ba8db7efc3a WatchSource:0}: Error finding container 9dfd694519329803e6a3d1cccf12cf3334d29b6595c913f7e27c7ba8db7efc3a: Status 404 returned error can't find the container with id 9dfd694519329803e6a3d1cccf12cf3334d29b6595c913f7e27c7ba8db7efc3a
Jul 15 18:55:49.826998 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:49.826963    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6dvvp" event={"ID":"590afe25-abbb-4f66-b163-857119f348cd","Type":"ContainerStarted","Data":"9dfd694519329803e6a3d1cccf12cf3334d29b6595c913f7e27c7ba8db7efc3a"}
Jul 15 18:55:52.045387 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.045352    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"]
Jul 15 18:55:52.048250 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.048222    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"
Jul 15 18:55:52.052232 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.052211    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 18:55:52.052453 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.052433    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:55:52.053680 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.053662    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7vpb2\""
Jul 15 18:55:52.073242 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.073157    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"]
Jul 15 18:55:52.167703 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.167669    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f75fc\" (UniqueName: \"kubernetes.io/projected/2fa7a1d4-463a-41cd-835a-69bd24426176-kube-api-access-f75fc\") pod \"openshift-lws-operator-fd8ccff4c-tbsb4\" (UID: \"2fa7a1d4-463a-41cd-835a-69bd24426176\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"
Jul 15 18:55:52.167857 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.167718    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fa7a1d4-463a-41cd-835a-69bd24426176-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tbsb4\" (UID: \"2fa7a1d4-463a-41cd-835a-69bd24426176\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"
Jul 15 18:55:52.269108 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.269072    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f75fc\" (UniqueName: \"kubernetes.io/projected/2fa7a1d4-463a-41cd-835a-69bd24426176-kube-api-access-f75fc\") pod \"openshift-lws-operator-fd8ccff4c-tbsb4\" (UID: \"2fa7a1d4-463a-41cd-835a-69bd24426176\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"
Jul 15 18:55:52.269242 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.269131    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fa7a1d4-463a-41cd-835a-69bd24426176-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tbsb4\" (UID: \"2fa7a1d4-463a-41cd-835a-69bd24426176\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"
Jul 15 18:55:52.269556 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.269535    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fa7a1d4-463a-41cd-835a-69bd24426176-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tbsb4\" (UID: \"2fa7a1d4-463a-41cd-835a-69bd24426176\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"
Jul 15 18:55:52.292162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.292139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f75fc\" (UniqueName: \"kubernetes.io/projected/2fa7a1d4-463a-41cd-835a-69bd24426176-kube-api-access-f75fc\") pod \"openshift-lws-operator-fd8ccff4c-tbsb4\" (UID: \"2fa7a1d4-463a-41cd-835a-69bd24426176\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"
Jul 15 18:55:52.358934 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.358901    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"
Jul 15 18:55:52.497663 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.497632    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4"]
Jul 15 18:55:52.502916 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:55:52.502892    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fa7a1d4_463a_41cd_835a_69bd24426176.slice/crio-2b699f94e140999937de8d643748330de3eba59adc494e41633e64c1fd9a9aa5 WatchSource:0}: Error finding container 2b699f94e140999937de8d643748330de3eba59adc494e41633e64c1fd9a9aa5: Status 404 returned error can't find the container with id 2b699f94e140999937de8d643748330de3eba59adc494e41633e64c1fd9a9aa5
Jul 15 18:55:52.842552 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.842513    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6dvvp" event={"ID":"590afe25-abbb-4f66-b163-857119f348cd","Type":"ContainerStarted","Data":"ccd12d9e2f2c4541b9a2216cfffaa2b20be79b7e045b862e5406a1639002419a"}
Jul 15 18:55:52.843830 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.843802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4" event={"ID":"2fa7a1d4-463a-41cd-835a-69bd24426176","Type":"ContainerStarted","Data":"2b699f94e140999937de8d643748330de3eba59adc494e41633e64c1fd9a9aa5"}
Jul 15 18:55:52.869518 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:52.869468    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6dvvp" podStartSLOduration=2.102425595 podStartE2EDuration="4.869450034s" totalImagesPullingTime="2.767024439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:55:52.868482955 +0000 UTC m=+277.050255624" watchObservedRunningTime="2026-07-15 18:55:52.869450034 +0000 UTC m=+277.051222705"
Jul 15 18:55:55.858911 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:55.858876    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4" event={"ID":"2fa7a1d4-463a-41cd-835a-69bd24426176","Type":"ContainerStarted","Data":"0a1725a9a7f60cbc2706ff951dd4e8bf9d4965f1ad6524fccfb2479ec6af903c"}
Jul 15 18:55:55.881359 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:55:55.881272    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbsb4" podStartSLOduration=1.424924455 podStartE2EDuration="3.881248988s" totalImagesPullingTime="2.456324533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:55:55.878541804 +0000 UTC m=+280.060314474" watchObservedRunningTime="2026-07-15 18:55:55.881248988 +0000 UTC m=+280.063021656"
Jul 15 18:56:15.843856 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.843824    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"]
Jul 15 18:56:15.900485 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.900446    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"]
Jul 15 18:56:15.900637 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.900548    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:15.904375 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.904346    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 18:56:15.904375 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.904355    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 18:56:15.904920 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.904903    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ssvhg\""
Jul 15 18:56:15.904978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.904962    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 18:56:15.905150 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.905137    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 18:56:15.967936 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.967895    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:15.967936 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.967941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m2mw\" (UniqueName: \"kubernetes.io/projected/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-kube-api-access-4m2mw\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:15.968141 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.967964    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-manifests\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:15.968141 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.968020    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-tmp\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:15.968141 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:15.968071    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.068743 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.068703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.068743 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.068746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m2mw\" (UniqueName: \"kubernetes.io/projected/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-kube-api-access-4m2mw\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.068939 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.068778    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-manifests\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.068939 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.068804    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-tmp\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.068939 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.068839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.069230 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.069197    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-manifests\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.071177 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.071152    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-tmp\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.071323 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.071228    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.071323 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.071277    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.113819 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.113748    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m2mw\" (UniqueName: \"kubernetes.io/projected/e815ea84-51c8-4fe4-8f6b-5e1ac8970f76-kube-api-access-4m2mw\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-lg8n8\" (UID: \"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.168217 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.168192    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 18:56:16.171532 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.171506    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 18:56:16.173875 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.173851    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 18:56:16.213458 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.213422    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ssvhg\""
Jul 15 18:56:16.221330 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.221267    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:16.392532 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.392488    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"]
Jul 15 18:56:16.394707 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:56:16.394683    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode815ea84_51c8_4fe4_8f6b_5e1ac8970f76.slice/crio-7cdedccd4c92a5b904e8892239c81a370f7d91a96d19caaa04c976fbeee5b922 WatchSource:0}: Error finding container 7cdedccd4c92a5b904e8892239c81a370f7d91a96d19caaa04c976fbeee5b922: Status 404 returned error can't find the container with id 7cdedccd4c92a5b904e8892239c81a370f7d91a96d19caaa04c976fbeee5b922
Jul 15 18:56:16.941408 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:16.941367    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8" event={"ID":"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76","Type":"ContainerStarted","Data":"7cdedccd4c92a5b904e8892239c81a370f7d91a96d19caaa04c976fbeee5b922"}
Jul 15 18:56:19.959046 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:19.959010    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8" event={"ID":"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76","Type":"ContainerStarted","Data":"eb327bccdc4e855561e08f6cbb507105db5d634791be1fe36a616f391a5ceaa5"}
Jul 15 18:56:20.965020 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:20.964980    2571 generic.go:356] "Generic (PLEG): container finished" podID="e815ea84-51c8-4fe4-8f6b-5e1ac8970f76" containerID="eb327bccdc4e855561e08f6cbb507105db5d634791be1fe36a616f391a5ceaa5" exitCode=0
Jul 15 18:56:20.965488 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:20.965062    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8" event={"ID":"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76","Type":"ContainerDied","Data":"eb327bccdc4e855561e08f6cbb507105db5d634791be1fe36a616f391a5ceaa5"}
Jul 15 18:56:20.965600 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:20.965585    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:56:21.971597 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:21.971560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8" event={"ID":"e815ea84-51c8-4fe4-8f6b-5e1ac8970f76","Type":"ContainerStarted","Data":"f598b12ff823effda07042e23783b3de5357bf4cc36491b073c5a67db7a0dcd6"}
Jul 15 18:56:21.971974 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:21.971668    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:32.978957 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:32.978924    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8"
Jul 15 18:56:33.011750 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:33.011704    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-lg8n8" podStartSLOduration=13.62548664 podStartE2EDuration="18.011689669s" totalImagesPullingTime="3.315242439s" totalInitContainerRuntime="1.07096059s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:22.006719716 +0000 UTC m=+306.188492384" watchObservedRunningTime="2026-07-15 18:56:33.011689669 +0000 UTC m=+317.193462337"
Jul 15 18:56:36.159635 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.159601    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"]
Jul 15 18:56:36.171590 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.171561    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.180813 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.180787    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 18:56:36.181077 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.181056    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gbq4l\""
Jul 15 18:56:36.181169 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.181057    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 18:56:36.181863 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.181843    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 18:56:36.183096 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.183077    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 18:56:36.192295 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.192255    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"]
Jul 15 18:56:36.243570 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.243547    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5013abd-f4a5-4a01-8ec9-c669f898cdcd-tmp\") pod \"kube-auth-proxy-7cbd849f4d-qthtj\" (UID: \"f5013abd-f4a5-4a01-8ec9-c669f898cdcd\") " pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.243690 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.243586    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4lxv\" (UniqueName: \"kubernetes.io/projected/f5013abd-f4a5-4a01-8ec9-c669f898cdcd-kube-api-access-j4lxv\") pod \"kube-auth-proxy-7cbd849f4d-qthtj\" (UID: \"f5013abd-f4a5-4a01-8ec9-c669f898cdcd\") " pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.243690 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.243654    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5013abd-f4a5-4a01-8ec9-c669f898cdcd-tls-certs\") pod \"kube-auth-proxy-7cbd849f4d-qthtj\" (UID: \"f5013abd-f4a5-4a01-8ec9-c669f898cdcd\") " pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.344382 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.344353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5013abd-f4a5-4a01-8ec9-c669f898cdcd-tls-certs\") pod \"kube-auth-proxy-7cbd849f4d-qthtj\" (UID: \"f5013abd-f4a5-4a01-8ec9-c669f898cdcd\") " pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.344521 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.344394    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5013abd-f4a5-4a01-8ec9-c669f898cdcd-tmp\") pod \"kube-auth-proxy-7cbd849f4d-qthtj\" (UID: \"f5013abd-f4a5-4a01-8ec9-c669f898cdcd\") " pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.344521 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.344484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4lxv\" (UniqueName: \"kubernetes.io/projected/f5013abd-f4a5-4a01-8ec9-c669f898cdcd-kube-api-access-j4lxv\") pod \"kube-auth-proxy-7cbd849f4d-qthtj\" (UID: \"f5013abd-f4a5-4a01-8ec9-c669f898cdcd\") " pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.346444 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.346420    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5013abd-f4a5-4a01-8ec9-c669f898cdcd-tmp\") pod \"kube-auth-proxy-7cbd849f4d-qthtj\" (UID: \"f5013abd-f4a5-4a01-8ec9-c669f898cdcd\") " pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.346701 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.346685    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5013abd-f4a5-4a01-8ec9-c669f898cdcd-tls-certs\") pod \"kube-auth-proxy-7cbd849f4d-qthtj\" (UID: \"f5013abd-f4a5-4a01-8ec9-c669f898cdcd\") " pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.360116 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.360090    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4lxv\" (UniqueName: \"kubernetes.io/projected/f5013abd-f4a5-4a01-8ec9-c669f898cdcd-kube-api-access-j4lxv\") pod \"kube-auth-proxy-7cbd849f4d-qthtj\" (UID: \"f5013abd-f4a5-4a01-8ec9-c669f898cdcd\") " pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.480324 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.480242    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"
Jul 15 18:56:36.660040 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:36.660018    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj"]
Jul 15 18:56:36.662482 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:56:36.662456    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5013abd_f4a5_4a01_8ec9_c669f898cdcd.slice/crio-668f5daf98edced042470c2c372d378197c69715b960aae8df68119f9c831b6c WatchSource:0}: Error finding container 668f5daf98edced042470c2c372d378197c69715b960aae8df68119f9c831b6c: Status 404 returned error can't find the container with id 668f5daf98edced042470c2c372d378197c69715b960aae8df68119f9c831b6c
Jul 15 18:56:37.034372 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:37.034338    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj" event={"ID":"f5013abd-f4a5-4a01-8ec9-c669f898cdcd","Type":"ContainerStarted","Data":"668f5daf98edced042470c2c372d378197c69715b960aae8df68119f9c831b6c"}
Jul 15 18:56:40.050036 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:40.049942    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj" event={"ID":"f5013abd-f4a5-4a01-8ec9-c669f898cdcd","Type":"ContainerStarted","Data":"aafd996d2b33d18dd11b5badaa253c8a4e8a295f1dae6c93a3ee9ab86a391c1c"}
Jul 15 18:56:40.070448 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:40.070399    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cbd849f4d-qthtj" podStartSLOduration=1.131083 podStartE2EDuration="4.070383222s" totalImagesPullingTime="2.939300222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:40.069112276 +0000 UTC m=+324.250884946" watchObservedRunningTime="2026-07-15 18:56:40.070383222 +0000 UTC m=+324.252155893"
Jul 15 18:56:43.423259 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.423225    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"]
Jul 15 18:56:43.426555 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.426536    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.430094 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.430070    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s6m8z\""
Jul 15 18:56:43.430189 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.430095    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 18:56:43.453565 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.453535    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"]
Jul 15 18:56:43.507829 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.507798    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.507978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.507857    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.507978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.507885    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.507978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.507905    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.507978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.507928    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.507978 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.507973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzjd\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-kube-api-access-gzzjd\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.508146 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.508017    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.508146 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.508044    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.508146 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.508058    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.568504 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.568469    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"]
Jul 15 18:56:43.571781 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.571765    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.603297 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.603259    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"]
Jul 15 18:56:43.608609 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.608587    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.608721 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.608619    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.608721 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.608647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzjd\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-kube-api-access-gzzjd\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.608827 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.608776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.608870 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.608836    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.608916 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.608867    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.608966 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.608913    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.608966 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.608951    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.609065 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.609008    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.609065 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.609039    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.609159 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.609076    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.609246 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.609223    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.609389 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.609370    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.609601 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.609585    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.611128 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.611107    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.611212 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.611198    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.624412 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.624382    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.624519 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.624455    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzjd\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-kube-api-access-gzzjd\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-f952d\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.710591 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.710508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.710591 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.710551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.710758 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.710619    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.710758 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.710666    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.710758 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.710739    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.710758 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.710756    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7gs8\" (UniqueName: \"kubernetes.io/projected/8cd0793f-32a0-4e44-8782-86b6f80aa768-kube-api-access-w7gs8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.710875 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.710785    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.710875 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.710808    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cd0793f-32a0-4e44-8782-86b6f80aa768-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.710875 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.710824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.736616 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.736584    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:43.812339 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.812483 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7gs8\" (UniqueName: \"kubernetes.io/projected/8cd0793f-32a0-4e44-8782-86b6f80aa768-kube-api-access-w7gs8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.812483 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.812483 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812412    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cd0793f-32a0-4e44-8782-86b6f80aa768-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.812483 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812437    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.812605 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812493    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.812720 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812695    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.812770 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.812920 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812818    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.812920 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.812760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.813141 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.813104    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.813141 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.813125    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.813359 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.813340    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.813415 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.813341    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cd0793f-32a0-4e44-8782-86b6f80aa768-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.814652 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.814634    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.815212 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.815194    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.820593 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.820498    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cd0793f-32a0-4e44-8782-86b6f80aa768-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.820923 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.820864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7gs8\" (UniqueName: \"kubernetes.io/projected/8cd0793f-32a0-4e44-8782-86b6f80aa768-kube-api-access-w7gs8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48z8vs\" (UID: \"8cd0793f-32a0-4e44-8782-86b6f80aa768\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:43.874353 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.874328    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"]
Jul 15 18:56:43.876213 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:56:43.876181    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30a344c_30ea_402c_b1d7_fda8bfecd5f1.slice/crio-2b8e45efb43bc542e697d8ae5a5db209a798559da95b42771bbca3eef914977f WatchSource:0}: Error finding container 2b8e45efb43bc542e697d8ae5a5db209a798559da95b42771bbca3eef914977f: Status 404 returned error can't find the container with id 2b8e45efb43bc542e697d8ae5a5db209a798559da95b42771bbca3eef914977f
Jul 15 18:56:43.880774 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:43.880757    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:44.025321 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:44.025184    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"]
Jul 15 18:56:44.032015 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:56:44.031988    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd0793f_32a0_4e44_8782_86b6f80aa768.slice/crio-eeb2fd159f36f01d2da9be58d0c62f66511bfd2c3f5d9004f0f1aa6dd3fbb66f WatchSource:0}: Error finding container eeb2fd159f36f01d2da9be58d0c62f66511bfd2c3f5d9004f0f1aa6dd3fbb66f: Status 404 returned error can't find the container with id eeb2fd159f36f01d2da9be58d0c62f66511bfd2c3f5d9004f0f1aa6dd3fbb66f
Jul 15 18:56:44.070141 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:44.070106    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs" event={"ID":"8cd0793f-32a0-4e44-8782-86b6f80aa768","Type":"ContainerStarted","Data":"eeb2fd159f36f01d2da9be58d0c62f66511bfd2c3f5d9004f0f1aa6dd3fbb66f"}
Jul 15 18:56:44.071408 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:44.071383    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d" event={"ID":"f30a344c-30ea-402c-b1d7-fda8bfecd5f1","Type":"ContainerStarted","Data":"2b8e45efb43bc542e697d8ae5a5db209a798559da95b42771bbca3eef914977f"}
Jul 15 18:56:46.144859 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.144679    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"]
Jul 15 18:56:46.149852 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.149825    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.152758 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.152738    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 18:56:46.153078 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.153049    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 18:56:46.153369 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.153349    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 18:56:46.153465 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.153353    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vbjzr\""
Jul 15 18:56:46.167432 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.167404    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"]
Jul 15 18:56:46.236333 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.236297    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.236494 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.236347    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5b283e-68aa-4d14-8665-8f8f0353d34f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.236494 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.236415    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.236494 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.236436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.236494 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.236459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac5b283e-68aa-4d14-8665-8f8f0353d34f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.236646 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.236533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.236646 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.236588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkx2q\" (UniqueName: \"kubernetes.io/projected/ac5b283e-68aa-4d14-8665-8f8f0353d34f-kube-api-access-qkx2q\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.337732 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.337701    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.337732 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.337732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.337956 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.337754    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac5b283e-68aa-4d14-8665-8f8f0353d34f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.337956 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.337793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.337956 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.337828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkx2q\" (UniqueName: \"kubernetes.io/projected/ac5b283e-68aa-4d14-8665-8f8f0353d34f-kube-api-access-qkx2q\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.337956 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.337907    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.338503 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.337931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5b283e-68aa-4d14-8665-8f8f0353d34f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.338741 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.338664    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.340581 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.340557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5b283e-68aa-4d14-8665-8f8f0353d34f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.340678 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.340618    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.340734 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.340696    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.340791 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.340761    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac5b283e-68aa-4d14-8665-8f8f0353d34f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.352295 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.352254    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkx2q\" (UniqueName: \"kubernetes.io/projected/ac5b283e-68aa-4d14-8665-8f8f0353d34f-kube-api-access-qkx2q\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.352466 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.352449    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5b283e-68aa-4d14-8665-8f8f0353d34f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ldb6d\" (UID: \"ac5b283e-68aa-4d14-8665-8f8f0353d34f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.462773 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.462693    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:46.754194 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.754148    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:56:46.754370 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.754261    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:56:46.754370 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.754336    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:56:46.760838 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.760807    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:56:46.760931 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.760882    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:56:46.760931 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.760922    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:56:46.817057 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:46.816993    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"]
Jul 15 18:56:46.830351 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:56:46.830326    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5b283e_68aa_4d14_8665_8f8f0353d34f.slice/crio-a2811c9abd3fe502a47a24a6e0dd12d1bf1d9b34c478dbabecb7a442124e4779 WatchSource:0}: Error finding container a2811c9abd3fe502a47a24a6e0dd12d1bf1d9b34c478dbabecb7a442124e4779: Status 404 returned error can't find the container with id a2811c9abd3fe502a47a24a6e0dd12d1bf1d9b34c478dbabecb7a442124e4779
Jul 15 18:56:47.091002 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.090959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs" event={"ID":"8cd0793f-32a0-4e44-8782-86b6f80aa768","Type":"ContainerStarted","Data":"3072d9dfd6e657ca36e39230ce7b04145f56617c67f8beb33c5b3d24fe690ebb"}
Jul 15 18:56:47.093478 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.093452    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d" event={"ID":"f30a344c-30ea-402c-b1d7-fda8bfecd5f1","Type":"ContainerStarted","Data":"b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc"}
Jul 15 18:56:47.094768 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.094744    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d" event={"ID":"ac5b283e-68aa-4d14-8665-8f8f0353d34f","Type":"ContainerStarted","Data":"a2811c9abd3fe502a47a24a6e0dd12d1bf1d9b34c478dbabecb7a442124e4779"}
Jul 15 18:56:47.181848 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.181757    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs" podStartSLOduration=1.462358517 podStartE2EDuration="4.181735726s" totalImagesPullingTime="2.719377209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:47.176185027 +0000 UTC m=+331.357957698" watchObservedRunningTime="2026-07-15 18:56:47.181735726 +0000 UTC m=+331.363508400"
Jul 15 18:56:47.211034 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.210962    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d" podStartSLOduration=1.328610622 podStartE2EDuration="4.210942045s" totalImagesPullingTime="2.882331423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:47.209227391 +0000 UTC m=+331.391000064" watchObservedRunningTime="2026-07-15 18:56:47.210942045 +0000 UTC m=+331.392714707"
Jul 15 18:56:47.737508 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.737468    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:47.738677 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.738652    2571 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-f952d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Jul 15 18:56:47.738809 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.738704    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d" podUID="f30a344c-30ea-402c-b1d7-fda8bfecd5f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Jul 15 18:56:47.881338 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.881252    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:47.887231 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.887200    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:47.971154 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.971119    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"]
Jul 15 18:56:47.974926 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.974902    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:47.978663 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.978486    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zvghv\""
Jul 15 18:56:47.978663 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.978594    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 18:56:47.990839 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:47.990787    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"]
Jul 15 18:56:48.055594 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.055554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x29t\" (UniqueName: \"kubernetes.io/projected/bff758f2-65ad-4bb5-bf70-cf5c0696ae2b-kube-api-access-6x29t\") pod \"kserve-controller-manager-d6f4b65b8-6sp5x\" (UID: \"bff758f2-65ad-4bb5-bf70-cf5c0696ae2b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:48.055743 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.055723    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bff758f2-65ad-4bb5-bf70-cf5c0696ae2b-cert\") pod \"kserve-controller-manager-d6f4b65b8-6sp5x\" (UID: \"bff758f2-65ad-4bb5-bf70-cf5c0696ae2b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:48.099826 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.099799    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:48.101130 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.101104    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48z8vs"
Jul 15 18:56:48.156914 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.156879    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bff758f2-65ad-4bb5-bf70-cf5c0696ae2b-cert\") pod \"kserve-controller-manager-d6f4b65b8-6sp5x\" (UID: \"bff758f2-65ad-4bb5-bf70-cf5c0696ae2b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:48.157086 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.156953    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x29t\" (UniqueName: \"kubernetes.io/projected/bff758f2-65ad-4bb5-bf70-cf5c0696ae2b-kube-api-access-6x29t\") pod \"kserve-controller-manager-d6f4b65b8-6sp5x\" (UID: \"bff758f2-65ad-4bb5-bf70-cf5c0696ae2b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:48.157086 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:56:48.157049    2571 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 15 18:56:48.157204 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:56:48.157130    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bff758f2-65ad-4bb5-bf70-cf5c0696ae2b-cert podName:bff758f2-65ad-4bb5-bf70-cf5c0696ae2b nodeName:}" failed. No retries permitted until 2026-07-15 18:56:48.657106082 +0000 UTC m=+332.838878752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bff758f2-65ad-4bb5-bf70-cf5c0696ae2b-cert") pod "kserve-controller-manager-d6f4b65b8-6sp5x" (UID: "bff758f2-65ad-4bb5-bf70-cf5c0696ae2b") : secret "kserve-webhook-server-cert" not found
Jul 15 18:56:48.166658 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.166628    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"]
Jul 15 18:56:48.173523 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.173488    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x29t\" (UniqueName: \"kubernetes.io/projected/bff758f2-65ad-4bb5-bf70-cf5c0696ae2b-kube-api-access-6x29t\") pod \"kserve-controller-manager-d6f4b65b8-6sp5x\" (UID: \"bff758f2-65ad-4bb5-bf70-cf5c0696ae2b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:48.662066 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.662027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bff758f2-65ad-4bb5-bf70-cf5c0696ae2b-cert\") pod \"kserve-controller-manager-d6f4b65b8-6sp5x\" (UID: \"bff758f2-65ad-4bb5-bf70-cf5c0696ae2b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:48.664844 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.664817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bff758f2-65ad-4bb5-bf70-cf5c0696ae2b-cert\") pod \"kserve-controller-manager-d6f4b65b8-6sp5x\" (UID: \"bff758f2-65ad-4bb5-bf70-cf5c0696ae2b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:48.738016 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.737974    2571 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-f952d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Jul 15 18:56:48.738174 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.738044    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d" podUID="f30a344c-30ea-402c-b1d7-fda8bfecd5f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Jul 15 18:56:48.888589 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.888558    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:48.994560 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.994525    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:56:48.994659 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:48.994607    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:56:49.037408 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:49.037381    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"]
Jul 15 18:56:49.040117 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:56:49.040088    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff758f2_65ad_4bb5_bf70_cf5c0696ae2b.slice/crio-a441d41cefa78b566fd1985282b1cc4d2309181339f184a60af5365fc291188a WatchSource:0}: Error finding container a441d41cefa78b566fd1985282b1cc4d2309181339f184a60af5365fc291188a: Status 404 returned error can't find the container with id a441d41cefa78b566fd1985282b1cc4d2309181339f184a60af5365fc291188a
Jul 15 18:56:49.106200 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:49.106169    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d" event={"ID":"ac5b283e-68aa-4d14-8665-8f8f0353d34f","Type":"ContainerStarted","Data":"017f511ee1da3652d4fcce7e1507ac74a4f0ff35229dfcb2033870616344b9b4"}
Jul 15 18:56:49.107335 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:49.107309    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x" event={"ID":"bff758f2-65ad-4bb5-bf70-cf5c0696ae2b","Type":"ContainerStarted","Data":"a441d41cefa78b566fd1985282b1cc4d2309181339f184a60af5365fc291188a"}
Jul 15 18:56:49.737695 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:49.737657    2571 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-f952d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Jul 15 18:56:49.738080 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:49.737716    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d" podUID="f30a344c-30ea-402c-b1d7-fda8bfecd5f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Jul 15 18:56:50.111449 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:50.111408    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d" podUID="f30a344c-30ea-402c-b1d7-fda8bfecd5f1" containerName="istio-proxy" containerID="cri-o://b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc" gracePeriod=30
Jul 15 18:56:50.112071 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:50.111845    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:50.113733 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:50.113714    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d"
Jul 15 18:56:50.200826 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:50.200772    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldb6d" podStartSLOduration=2.039338177 podStartE2EDuration="4.20075563s" totalImagesPullingTime="2.161417453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:50.198970702 +0000 UTC m=+334.380743392" watchObservedRunningTime="2026-07-15 18:56:50.20075563 +0000 UTC m=+334.382528298"
Jul 15 18:56:52.123396 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:52.123360    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x" event={"ID":"bff758f2-65ad-4bb5-bf70-cf5c0696ae2b","Type":"ContainerStarted","Data":"92633f933105a4d91f5e65108d3ad3167c53959e97e8bf876513866d775aed56"}
Jul 15 18:56:52.123755 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:52.123532    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:56:52.144771 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:52.144725    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x" podStartSLOduration=2.583413998 podStartE2EDuration="5.14470865s" totalImagesPullingTime="2.561294652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:52.142740075 +0000 UTC m=+336.324512744" watchObservedRunningTime="2026-07-15 18:56:52.14470865 +0000 UTC m=+336.326481336"
Jul 15 18:56:55.354616 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.354591    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:55.525106 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525021    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-certs\") pod \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") "
Jul 15 18:56:55.525106 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525061    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istiod-ca-cert\") pod \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") "
Jul 15 18:56:55.525106 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525084    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-podinfo\") pod \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") "
Jul 15 18:56:55.525387 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525112    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-token\") pod \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") "
Jul 15 18:56:55.525387 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525132    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-data\") pod \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") "
Jul 15 18:56:55.525387 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525166    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-envoy\") pod \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") "
Jul 15 18:56:55.525387 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525199    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzzjd\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-kube-api-access-gzzjd\") pod \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") "
Jul 15 18:56:55.525387 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525225    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-socket\") pod \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") "
Jul 15 18:56:55.525387 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525341    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-credential-socket\") pod \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\" (UID: \"f30a344c-30ea-402c-b1d7-fda8bfecd5f1\") "
Jul 15 18:56:55.525630 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525422    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f30a344c-30ea-402c-b1d7-fda8bfecd5f1" (UID: "f30a344c-30ea-402c-b1d7-fda8bfecd5f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.525630 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525501    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f30a344c-30ea-402c-b1d7-fda8bfecd5f1" (UID: "f30a344c-30ea-402c-b1d7-fda8bfecd5f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:56:55.525630 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525538    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "f30a344c-30ea-402c-b1d7-fda8bfecd5f1" (UID: "f30a344c-30ea-402c-b1d7-fda8bfecd5f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.525630 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525559    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f30a344c-30ea-402c-b1d7-fda8bfecd5f1" (UID: "f30a344c-30ea-402c-b1d7-fda8bfecd5f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.525822 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525682    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.525822 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525703    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.525822 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525719    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.525822 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525732    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.525985 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.525964    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f30a344c-30ea-402c-b1d7-fda8bfecd5f1" (UID: "f30a344c-30ea-402c-b1d7-fda8bfecd5f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.527446 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.527420    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "f30a344c-30ea-402c-b1d7-fda8bfecd5f1" (UID: "f30a344c-30ea-402c-b1d7-fda8bfecd5f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:55.527613 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.527589    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-kube-api-access-gzzjd" (OuterVolumeSpecName: "kube-api-access-gzzjd") pod "f30a344c-30ea-402c-b1d7-fda8bfecd5f1" (UID: "f30a344c-30ea-402c-b1d7-fda8bfecd5f1"). InnerVolumeSpecName "kube-api-access-gzzjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:55.527798 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.527778    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f30a344c-30ea-402c-b1d7-fda8bfecd5f1" (UID: "f30a344c-30ea-402c-b1d7-fda8bfecd5f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 18:56:55.527887 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.527808    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f30a344c-30ea-402c-b1d7-fda8bfecd5f1" (UID: "f30a344c-30ea-402c-b1d7-fda8bfecd5f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:55.626706 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.626661    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.626706 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.626700    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.626706 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.626709    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.626932 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.626717    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzzjd\" (UniqueName: \"kubernetes.io/projected/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-kube-api-access-gzzjd\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:56:55.626932 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:55.626741    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30a344c-30ea-402c-b1d7-fda8bfecd5f1-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:56:56.142972 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.142943    2571 generic.go:356] "Generic (PLEG): container finished" podID="f30a344c-30ea-402c-b1d7-fda8bfecd5f1" containerID="b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc" exitCode=0
Jul 15 18:56:56.143131 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.142986    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"
Jul 15 18:56:56.143131 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.143043    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d" event={"ID":"f30a344c-30ea-402c-b1d7-fda8bfecd5f1","Type":"ContainerDied","Data":"b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc"}
Jul 15 18:56:56.143131 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.143094    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d" event={"ID":"f30a344c-30ea-402c-b1d7-fda8bfecd5f1","Type":"ContainerDied","Data":"2b8e45efb43bc542e697d8ae5a5db209a798559da95b42771bbca3eef914977f"}
Jul 15 18:56:56.143131 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.143121    2571 scope.go:117] "RemoveContainer" containerID="b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc"
Jul 15 18:56:56.152085 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.152033    2571 scope.go:117] "RemoveContainer" containerID="b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc"
Jul 15 18:56:56.152301 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:56:56.152269    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc\": container with ID starting with b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc not found: ID does not exist" containerID="b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc"
Jul 15 18:56:56.152370 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.152310    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc"} err="failed to get container status \"b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc\": rpc error: code = NotFound desc = could not find container \"b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc\": container with ID starting with b599900df35d5b0a1d2f0e5271a07d8f705d8552fbc5caa21c90220144b380cc not found: ID does not exist"
Jul 15 18:56:56.164379 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.164359    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"]
Jul 15 18:56:56.171103 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.171084    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-f952d"]
Jul 15 18:56:56.337355 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:56:56.337325    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f30a344c-30ea-402c-b1d7-fda8bfecd5f1" path="/var/lib/kubelet/pods/f30a344c-30ea-402c-b1d7-fda8bfecd5f1/volumes"
Jul 15 18:57:23.134040 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:23.134007    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6sp5x"
Jul 15 18:57:37.077951 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.077914    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7x8q"]
Jul 15 18:57:37.078339 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.078243    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30a344c-30ea-402c-b1d7-fda8bfecd5f1" containerName="istio-proxy"
Jul 15 18:57:37.078339 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.078255    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30a344c-30ea-402c-b1d7-fda8bfecd5f1" containerName="istio-proxy"
Jul 15 18:57:37.078423 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.078342    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30a344c-30ea-402c-b1d7-fda8bfecd5f1" containerName="istio-proxy"
Jul 15 18:57:37.086356 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.086330    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q"
Jul 15 18:57:37.090830 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.090547    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 18:57:37.091716 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.091690    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 18:57:37.091835 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.091773    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-88srd\""
Jul 15 18:57:37.094637 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.094231    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7x8q"]
Jul 15 18:57:37.181990 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.181958    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvcxq\" (UniqueName: \"kubernetes.io/projected/05273c5b-067f-4fe7-bd81-d0957a5b45f8-kube-api-access-fvcxq\") pod \"kuadrant-operator-catalog-l7x8q\" (UID: \"05273c5b-067f-4fe7-bd81-d0957a5b45f8\") " pod="kuadrant-system/kuadrant-operator-catalog-l7x8q"
Jul 15 18:57:37.283067 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.283030    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvcxq\" (UniqueName: \"kubernetes.io/projected/05273c5b-067f-4fe7-bd81-d0957a5b45f8-kube-api-access-fvcxq\") pod \"kuadrant-operator-catalog-l7x8q\" (UID: \"05273c5b-067f-4fe7-bd81-d0957a5b45f8\") " pod="kuadrant-system/kuadrant-operator-catalog-l7x8q"
Jul 15 18:57:37.291813 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.291784    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvcxq\" (UniqueName: \"kubernetes.io/projected/05273c5b-067f-4fe7-bd81-d0957a5b45f8-kube-api-access-fvcxq\") pod \"kuadrant-operator-catalog-l7x8q\" (UID: \"05273c5b-067f-4fe7-bd81-d0957a5b45f8\") " pod="kuadrant-system/kuadrant-operator-catalog-l7x8q"
Jul 15 18:57:37.398045 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.397964    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q"
Jul 15 18:57:37.442374 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.442338    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7x8q"]
Jul 15 18:57:37.563162 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.563126    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7x8q"]
Jul 15 18:57:37.571160 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:57:37.571132    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05273c5b_067f_4fe7_bd81_d0957a5b45f8.slice/crio-91fd8cf3c9202d5b8a54829ba9acad6873f4a202295c699107f4cbeea4001777 WatchSource:0}: Error finding container 91fd8cf3c9202d5b8a54829ba9acad6873f4a202295c699107f4cbeea4001777: Status 404 returned error can't find the container with id 91fd8cf3c9202d5b8a54829ba9acad6873f4a202295c699107f4cbeea4001777
Jul 15 18:57:37.648490 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.648413    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sdwfw"]
Jul 15 18:57:37.651213 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.651195    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sdwfw"
Jul 15 18:57:37.660357 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.660333    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sdwfw"]
Jul 15 18:57:37.788088 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.788061    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5xxh\" (UniqueName: \"kubernetes.io/projected/dca295e6-7064-4f19-8248-4d11e8d77485-kube-api-access-q5xxh\") pod \"kuadrant-operator-catalog-sdwfw\" (UID: \"dca295e6-7064-4f19-8248-4d11e8d77485\") " pod="kuadrant-system/kuadrant-operator-catalog-sdwfw"
Jul 15 18:57:37.888852 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.888817    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5xxh\" (UniqueName: \"kubernetes.io/projected/dca295e6-7064-4f19-8248-4d11e8d77485-kube-api-access-q5xxh\") pod \"kuadrant-operator-catalog-sdwfw\" (UID: \"dca295e6-7064-4f19-8248-4d11e8d77485\") " pod="kuadrant-system/kuadrant-operator-catalog-sdwfw"
Jul 15 18:57:37.897164 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.897138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5xxh\" (UniqueName: \"kubernetes.io/projected/dca295e6-7064-4f19-8248-4d11e8d77485-kube-api-access-q5xxh\") pod \"kuadrant-operator-catalog-sdwfw\" (UID: \"dca295e6-7064-4f19-8248-4d11e8d77485\") " pod="kuadrant-system/kuadrant-operator-catalog-sdwfw"
Jul 15 18:57:37.961318 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:37.961212    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sdwfw"
Jul 15 18:57:38.100737 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:38.100709    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sdwfw"]
Jul 15 18:57:38.103850 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:57:38.103825    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca295e6_7064_4f19_8248_4d11e8d77485.slice/crio-25be396458bf3ce680bd8fc56668b44666f54cc8c51b12a940f68fb8975a2a54 WatchSource:0}: Error finding container 25be396458bf3ce680bd8fc56668b44666f54cc8c51b12a940f68fb8975a2a54: Status 404 returned error can't find the container with id 25be396458bf3ce680bd8fc56668b44666f54cc8c51b12a940f68fb8975a2a54
Jul 15 18:57:38.337194 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:38.337161    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sdwfw" event={"ID":"dca295e6-7064-4f19-8248-4d11e8d77485","Type":"ContainerStarted","Data":"25be396458bf3ce680bd8fc56668b44666f54cc8c51b12a940f68fb8975a2a54"}
Jul 15 18:57:38.337362 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:38.337209    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q" event={"ID":"05273c5b-067f-4fe7-bd81-d0957a5b45f8","Type":"ContainerStarted","Data":"91fd8cf3c9202d5b8a54829ba9acad6873f4a202295c699107f4cbeea4001777"}
Jul 15 18:57:40.344876 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:40.344830    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q" event={"ID":"05273c5b-067f-4fe7-bd81-d0957a5b45f8","Type":"ContainerStarted","Data":"df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640"}
Jul 15 18:57:40.344876 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:40.344868    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q" podUID="05273c5b-067f-4fe7-bd81-d0957a5b45f8" containerName="registry-server" containerID="cri-o://df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640" gracePeriod=2
Jul 15 18:57:40.346331 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:40.346306    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sdwfw" event={"ID":"dca295e6-7064-4f19-8248-4d11e8d77485","Type":"ContainerStarted","Data":"f1740f57193e154a4a625415352b7ce0253b1550bc7d4d61599a3ea87305bfd1"}
Jul 15 18:57:40.363394 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:40.363355    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q" podStartSLOduration=1.096662141 podStartE2EDuration="3.363342017s" totalImagesPullingTime="2.266679876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:57:40.360974209 +0000 UTC m=+384.542746905" watchObservedRunningTime="2026-07-15 18:57:40.363342017 +0000 UTC m=+384.545114687"
Jul 15 18:57:40.376356 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:40.376319    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sdwfw" podStartSLOduration=1.639761443 podStartE2EDuration="3.376305867s" totalImagesPullingTime="1.736544424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:57:40.37598022 +0000 UTC m=+384.557752927" watchObservedRunningTime="2026-07-15 18:57:40.376305867 +0000 UTC m=+384.558078536"
Jul 15 18:57:40.588175 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:40.588150    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q"
Jul 15 18:57:40.717566 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:40.717475    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvcxq\" (UniqueName: \"kubernetes.io/projected/05273c5b-067f-4fe7-bd81-d0957a5b45f8-kube-api-access-fvcxq\") pod \"05273c5b-067f-4fe7-bd81-d0957a5b45f8\" (UID: \"05273c5b-067f-4fe7-bd81-d0957a5b45f8\") "
Jul 15 18:57:40.719580 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:40.719557    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05273c5b-067f-4fe7-bd81-d0957a5b45f8-kube-api-access-fvcxq" (OuterVolumeSpecName: "kube-api-access-fvcxq") pod "05273c5b-067f-4fe7-bd81-d0957a5b45f8" (UID: "05273c5b-067f-4fe7-bd81-d0957a5b45f8"). InnerVolumeSpecName "kube-api-access-fvcxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:57:40.818077 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:40.818043    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvcxq\" (UniqueName: \"kubernetes.io/projected/05273c5b-067f-4fe7-bd81-d0957a5b45f8-kube-api-access-fvcxq\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:57:41.351926 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:41.351895    2571 generic.go:356] "Generic (PLEG): container finished" podID="05273c5b-067f-4fe7-bd81-d0957a5b45f8" containerID="df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640" exitCode=0
Jul 15 18:57:41.351926 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:41.351930    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q"
Jul 15 18:57:41.352390 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:41.351976    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q" event={"ID":"05273c5b-067f-4fe7-bd81-d0957a5b45f8","Type":"ContainerDied","Data":"df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640"}
Jul 15 18:57:41.352390 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:41.352022    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l7x8q" event={"ID":"05273c5b-067f-4fe7-bd81-d0957a5b45f8","Type":"ContainerDied","Data":"91fd8cf3c9202d5b8a54829ba9acad6873f4a202295c699107f4cbeea4001777"}
Jul 15 18:57:41.352390 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:41.352047    2571 scope.go:117] "RemoveContainer" containerID="df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640"
Jul 15 18:57:41.360387 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:41.360371    2571 scope.go:117] "RemoveContainer" containerID="df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640"
Jul 15 18:57:41.360631 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:57:41.360614    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640\": container with ID starting with df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640 not found: ID does not exist" containerID="df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640"
Jul 15 18:57:41.360695 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:41.360641    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640"} err="failed to get container status \"df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640\": rpc error: code = NotFound desc = could not find container \"df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640\": container with ID starting with df2555d9c95b837233b9c2f7391b000795f12dbd38abef4397a88ae259e89640 not found: ID does not exist"
Jul 15 18:57:41.373479 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:41.373432    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7x8q"]
Jul 15 18:57:41.379857 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:41.377780    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l7x8q"]
Jul 15 18:57:42.337605 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:42.337573    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05273c5b-067f-4fe7-bd81-d0957a5b45f8" path="/var/lib/kubelet/pods/05273c5b-067f-4fe7-bd81-d0957a5b45f8/volumes"
Jul 15 18:57:47.961462 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:47.961421    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sdwfw"
Jul 15 18:57:47.961880 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:47.961516    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sdwfw"
Jul 15 18:57:47.983937 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:47.983912    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sdwfw"
Jul 15 18:57:48.405331 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:57:48.405302    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sdwfw"
Jul 15 18:58:08.767783 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.767744    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"]
Jul 15 18:58:08.768178 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.768084    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05273c5b-067f-4fe7-bd81-d0957a5b45f8" containerName="registry-server"
Jul 15 18:58:08.768178 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.768094    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="05273c5b-067f-4fe7-bd81-d0957a5b45f8" containerName="registry-server"
Jul 15 18:58:08.768178 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.768151    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="05273c5b-067f-4fe7-bd81-d0957a5b45f8" containerName="registry-server"
Jul 15 18:58:08.776143 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.776120    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"
Jul 15 18:58:08.778988 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.778962    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wcjsz\""
Jul 15 18:58:08.779110 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.779065    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 18:58:08.787423 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.787401    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"]
Jul 15 18:58:08.870738 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.870711    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7vct\" (UniqueName: \"kubernetes.io/projected/063d99fe-4f12-4a02-b029-73789be0b1f9-kube-api-access-n7vct\") pod \"dns-operator-controller-manager-864dd78c4c-wpdvl\" (UID: \"063d99fe-4f12-4a02-b029-73789be0b1f9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"
Jul 15 18:58:08.971732 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.971706    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7vct\" (UniqueName: \"kubernetes.io/projected/063d99fe-4f12-4a02-b029-73789be0b1f9-kube-api-access-n7vct\") pod \"dns-operator-controller-manager-864dd78c4c-wpdvl\" (UID: \"063d99fe-4f12-4a02-b029-73789be0b1f9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"
Jul 15 18:58:08.989946 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:08.989921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7vct\" (UniqueName: \"kubernetes.io/projected/063d99fe-4f12-4a02-b029-73789be0b1f9-kube-api-access-n7vct\") pod \"dns-operator-controller-manager-864dd78c4c-wpdvl\" (UID: \"063d99fe-4f12-4a02-b029-73789be0b1f9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"
Jul 15 18:58:09.086139 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:09.086112    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"
Jul 15 18:58:09.214429 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:09.214367    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"]
Jul 15 18:58:09.217001 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:58:09.216972    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063d99fe_4f12_4a02_b029_73789be0b1f9.slice/crio-4b8ef4d1524845c6e40af7e2930d88bcc66315ba4fdc40a62a3659b681986890 WatchSource:0}: Error finding container 4b8ef4d1524845c6e40af7e2930d88bcc66315ba4fdc40a62a3659b681986890: Status 404 returned error can't find the container with id 4b8ef4d1524845c6e40af7e2930d88bcc66315ba4fdc40a62a3659b681986890
Jul 15 18:58:09.475033 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:09.474939    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl" event={"ID":"063d99fe-4f12-4a02-b029-73789be0b1f9","Type":"ContainerStarted","Data":"4b8ef4d1524845c6e40af7e2930d88bcc66315ba4fdc40a62a3659b681986890"}
Jul 15 18:58:12.192803 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.192768    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"]
Jul 15 18:58:12.196176 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.196155    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:12.198865 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.198846    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-slgb2\""
Jul 15 18:58:12.207179 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.207158    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"]
Jul 15 18:58:12.300728 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.300693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2fm8\" (UniqueName: \"kubernetes.io/projected/4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21-kube-api-access-s2fm8\") pod \"limitador-operator-controller-manager-859d7b78bd-cxp6z\" (UID: \"4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:12.402083 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.402056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2fm8\" (UniqueName: \"kubernetes.io/projected/4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21-kube-api-access-s2fm8\") pod \"limitador-operator-controller-manager-859d7b78bd-cxp6z\" (UID: \"4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:12.412716 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.412691    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2fm8\" (UniqueName: \"kubernetes.io/projected/4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21-kube-api-access-s2fm8\") pod \"limitador-operator-controller-manager-859d7b78bd-cxp6z\" (UID: \"4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:12.491100 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.491025    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl" event={"ID":"063d99fe-4f12-4a02-b029-73789be0b1f9","Type":"ContainerStarted","Data":"0c6b541710deb612e0a13718a1587fe3ab09af78c930dc6466bcc493108b6e5b"}
Jul 15 18:58:12.491100 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.491098    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"
Jul 15 18:58:12.506396 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.506367    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:12.527661 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.527620    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl" podStartSLOduration=2.129473184 podStartE2EDuration="4.527604134s" totalImagesPullingTime="2.39813095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:12.524932501 +0000 UTC m=+416.706705170" watchObservedRunningTime="2026-07-15 18:58:12.527604134 +0000 UTC m=+416.709376803"
Jul 15 18:58:12.641852 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:12.641828    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"]
Jul 15 18:58:12.644126 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:58:12.644091    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5944d1_54fd_40a5_bbd4_5cb79d8c7a21.slice/crio-05d0c9e72519b1622eafff05b8c40e3cfb88fc350eb619cab452c89af0c578be WatchSource:0}: Error finding container 05d0c9e72519b1622eafff05b8c40e3cfb88fc350eb619cab452c89af0c578be: Status 404 returned error can't find the container with id 05d0c9e72519b1622eafff05b8c40e3cfb88fc350eb619cab452c89af0c578be
Jul 15 18:58:13.496724 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:13.496689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z" event={"ID":"4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21","Type":"ContainerStarted","Data":"05d0c9e72519b1622eafff05b8c40e3cfb88fc350eb619cab452c89af0c578be"}
Jul 15 18:58:15.506733 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:15.506700    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z" event={"ID":"4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21","Type":"ContainerStarted","Data":"0d26223f9277f2234b89f44027f67f9df8d682bf82551d4c36f1fa5fb19f9b20"}
Jul 15 18:58:15.507097 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:15.506868    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:15.526199 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:15.526148    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z" podStartSLOduration=1.5112166999999999 podStartE2EDuration="3.526133225s" totalImagesPullingTime="2.014916525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:15.523592876 +0000 UTC m=+419.705365547" watchObservedRunningTime="2026-07-15 18:58:15.526133225 +0000 UTC m=+419.707905894"
Jul 15 18:58:17.257878 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.257826    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"]
Jul 15 18:58:17.262180 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.262162    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:17.273208 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.273187    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-glvv5\""
Jul 15 18:58:17.289907 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.289881    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"]
Jul 15 18:58:17.352430 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.352402    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" (UID: \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:17.352567 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.352522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp5f9\" (UniqueName: \"kubernetes.io/projected/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-kube-api-access-zp5f9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" (UID: \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:17.453970 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.453925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp5f9\" (UniqueName: \"kubernetes.io/projected/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-kube-api-access-zp5f9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" (UID: \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:17.453970 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.453972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" (UID: \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:17.454378 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.454362    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" (UID: \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:17.462316 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.462277    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp5f9\" (UniqueName: \"kubernetes.io/projected/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-kube-api-access-zp5f9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" (UID: \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:17.572207 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.572169    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:17.709838 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:17.709811    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"]
Jul 15 18:58:17.712825 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:58:17.712796    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac636e5a_8020_49fb_b5d1_3461fb0ca9f2.slice/crio-cc56d95cf62c9ab8839db6d4c332f786f7ee1d3f3870ab53af0fbfa684e632aa WatchSource:0}: Error finding container cc56d95cf62c9ab8839db6d4c332f786f7ee1d3f3870ab53af0fbfa684e632aa: Status 404 returned error can't find the container with id cc56d95cf62c9ab8839db6d4c332f786f7ee1d3f3870ab53af0fbfa684e632aa
Jul 15 18:58:18.522443 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:18.522406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc" event={"ID":"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2","Type":"ContainerStarted","Data":"cc56d95cf62c9ab8839db6d4c332f786f7ee1d3f3870ab53af0fbfa684e632aa"}
Jul 15 18:58:23.499530 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:23.499497    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpdvl"
Jul 15 18:58:24.554380 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:24.554341    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc" event={"ID":"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2","Type":"ContainerStarted","Data":"9cec7cf0dceda8635df047da293e2ce7be587b638a137644e819af73b8cb4373"}
Jul 15 18:58:24.554759 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:24.554472    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:24.575392 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:24.575344    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc" podStartSLOduration=1.46527686 podStartE2EDuration="7.575326986s" totalImagesPullingTime="6.110050126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:24.573181968 +0000 UTC m=+428.754954663" watchObservedRunningTime="2026-07-15 18:58:24.575326986 +0000 UTC m=+428.757099656"
Jul 15 18:58:26.513468 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:26.513434    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:35.561753 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:35.561720    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:36.686699 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:36.686661    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"]
Jul 15 18:58:36.692502 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:36.692479    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:36.704407 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:36.704380    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"]
Jul 15 18:58:36.717977 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:36.717951    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h7l8\" (UniqueName: \"kubernetes.io/projected/feec3520-c134-4d22-9807-099620f6c466-kube-api-access-4h7l8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" (UID: \"feec3520-c134-4d22-9807-099620f6c466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:36.718104 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:36.718054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feec3520-c134-4d22-9807-099620f6c466-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" (UID: \"feec3520-c134-4d22-9807-099620f6c466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:36.819048 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:36.819015    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h7l8\" (UniqueName: \"kubernetes.io/projected/feec3520-c134-4d22-9807-099620f6c466-kube-api-access-4h7l8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" (UID: \"feec3520-c134-4d22-9807-099620f6c466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:36.819223 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:36.819111    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feec3520-c134-4d22-9807-099620f6c466-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" (UID: \"feec3520-c134-4d22-9807-099620f6c466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:36.819613 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:36.819589    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feec3520-c134-4d22-9807-099620f6c466-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" (UID: \"feec3520-c134-4d22-9807-099620f6c466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:36.830357 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:36.830335    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h7l8\" (UniqueName: \"kubernetes.io/projected/feec3520-c134-4d22-9807-099620f6c466-kube-api-access-4h7l8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" (UID: \"feec3520-c134-4d22-9807-099620f6c466\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:37.003324 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.003218    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:37.159840 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.157221    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"]
Jul 15 18:58:37.433591 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.433554    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"]
Jul 15 18:58:37.443003 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.442970    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"]
Jul 15 18:58:37.456475 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.456445    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"]
Jul 15 18:58:37.456677 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.456631    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" containerName="manager" containerID="cri-o://9cec7cf0dceda8635df047da293e2ce7be587b638a137644e819af73b8cb4373" gracePeriod=2
Jul 15 18:58:37.461660 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.461635    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"]
Jul 15 18:58:37.462037 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.462022    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feec3520-c134-4d22-9807-099620f6c466" containerName="manager"
Jul 15 18:58:37.462084 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.462040    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="feec3520-c134-4d22-9807-099620f6c466" containerName="manager"
Jul 15 18:58:37.462118 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.462100    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="feec3520-c134-4d22-9807-099620f6c466" containerName="manager"
Jul 15 18:58:37.465627 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.465574    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:37.468517 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.468490    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"]
Jul 15 18:58:37.474529 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.474496    2571 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-9fthc\": pods \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:37.485948 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.485919    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"]
Jul 15 18:58:37.488142 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.488122    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"]
Jul 15 18:58:37.488356 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.488308    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" containerName="manager" containerID="cri-o://0d26223f9277f2234b89f44027f67f9df8d682bf82551d4c36f1fa5fb19f9b20" gracePeriod=2
Jul 15 18:58:37.494322 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.494276    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"]
Jul 15 18:58:37.525053 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.525009    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x55bn\" (UniqueName: \"kubernetes.io/projected/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-kube-api-access-x55bn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tbhfh\" (UID: \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:37.525445 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.525415    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tbhfh\" (UID: \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:37.527305 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.527253    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:37.529778 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.529745    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxp6z\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:37.532560 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.532524    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:37.540774 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.540749    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"]
Jul 15 18:58:37.541266 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.541239    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" containerName="manager"
Jul 15 18:58:37.541266 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.541266    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" containerName="manager"
Jul 15 18:58:37.541479 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.541327    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" containerName="manager"
Jul 15 18:58:37.541479 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.541336    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" containerName="manager"
Jul 15 18:58:37.541479 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.541429    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" containerName="manager"
Jul 15 18:58:37.541479 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.541447    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" containerName="manager"
Jul 15 18:58:37.544858 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.544839    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"
Jul 15 18:58:37.559181 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.559156    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"]
Jul 15 18:58:37.573913 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.573882    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:37.577985 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.577948    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxp6z\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:37.617544 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.617517    2571 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8" container="manager"
Jul 15 18:58:37.619506 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.619426    2571 generic.go:356] "Generic (PLEG): container finished" podID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" containerID="0d26223f9277f2234b89f44027f67f9df8d682bf82551d4c36f1fa5fb19f9b20" exitCode=0
Jul 15 18:58:37.619965 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.619929    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxp6z\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:37.621378 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.621346    2571 generic.go:356] "Generic (PLEG): container finished" podID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" containerID="9cec7cf0dceda8635df047da293e2ce7be587b638a137644e819af73b8cb4373" exitCode=0
Jul 15 18:58:37.623975 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.623944    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="feec3520-c134-4d22-9807-099620f6c466" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:37.625853 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.625831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6kq5\" (UniqueName: \"kubernetes.io/projected/03fb04ac-cf0f-44d4-9c3e-b720effac277-kube-api-access-l6kq5\") pod \"limitador-operator-controller-manager-859d7b78bd-gv466\" (UID: \"03fb04ac-cf0f-44d4-9c3e-b720effac277\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"
Jul 15 18:58:37.625939 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.625894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tbhfh\" (UID: \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:37.626008 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.625979    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x55bn\" (UniqueName: \"kubernetes.io/projected/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-kube-api-access-x55bn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tbhfh\" (UID: \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:37.626193 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.626160    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tbhfh\" (UID: \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:37.626193 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.626176    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:37.638456 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.638425    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x55bn\" (UniqueName: \"kubernetes.io/projected/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-kube-api-access-x55bn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tbhfh\" (UID: \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:37.720144 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.720119    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:37.724850 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.724820    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:37.727161 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.727138    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-extensions-socket-volume\") pod \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\" (UID: \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\") "
Jul 15 18:58:37.727301 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.727195    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp5f9\" (UniqueName: \"kubernetes.io/projected/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-kube-api-access-zp5f9\") pod \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\" (UID: \"ac636e5a-8020-49fb-b5d1-3461fb0ca9f2\") "
Jul 15 18:58:37.727436 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.727420    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kq5\" (UniqueName: \"kubernetes.io/projected/03fb04ac-cf0f-44d4-9c3e-b720effac277-kube-api-access-l6kq5\") pod \"limitador-operator-controller-manager-859d7b78bd-gv466\" (UID: \"03fb04ac-cf0f-44d4-9c3e-b720effac277\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"
Jul 15 18:58:37.727670 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.727647    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" (UID: "ac636e5a-8020-49fb-b5d1-3461fb0ca9f2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:58:37.728480 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.728453    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxp6z\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:37.730414 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.730388    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-kube-api-access-zp5f9" (OuterVolumeSpecName: "kube-api-access-zp5f9") pod "ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" (UID: "ac636e5a-8020-49fb-b5d1-3461fb0ca9f2"). InnerVolumeSpecName "kube-api-access-zp5f9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:58:37.732070 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.732043    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="feec3520-c134-4d22-9807-099620f6c466" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:37.748332 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.748305    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6kq5\" (UniqueName: \"kubernetes.io/projected/03fb04ac-cf0f-44d4-9c3e-b720effac277-kube-api-access-l6kq5\") pod \"limitador-operator-controller-manager-859d7b78bd-gv466\" (UID: \"03fb04ac-cf0f-44d4-9c3e-b720effac277\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"
Jul 15 18:58:37.754389 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.754364    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:37.760177 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.760142    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fthc\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:37.762554 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.762525    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxp6z\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:37.764750 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:37.764727    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="feec3520-c134-4d22-9807-099620f6c466" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:37.828276 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.828238    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2fm8\" (UniqueName: \"kubernetes.io/projected/4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21-kube-api-access-s2fm8\") pod \"4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21\" (UID: \"4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21\") "
Jul 15 18:58:37.828526 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.828509    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp5f9\" (UniqueName: \"kubernetes.io/projected/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-kube-api-access-zp5f9\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:58:37.828589 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.828530    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2-extensions-socket-volume\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:58:37.830266 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.830239    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21-kube-api-access-s2fm8" (OuterVolumeSpecName: "kube-api-access-s2fm8") pod "4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" (UID: "4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21"). InnerVolumeSpecName "kube-api-access-s2fm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:58:37.881177 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.881139    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:37.886622 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.886586    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"
Jul 15 18:58:37.929435 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:37.929388    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2fm8\" (UniqueName: \"kubernetes.io/projected/4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21-kube-api-access-s2fm8\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:58:38.040310 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.040029    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"]
Jul 15 18:58:38.043200 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:58:38.043169    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b73889_c513_47cd_a2ef_ca935c1bc2dd.slice/crio-dcb4cec9b4cc8502a71427a545e30df569a10cd420a0758fec726b1bf8d6c28a WatchSource:0}: Error finding container dcb4cec9b4cc8502a71427a545e30df569a10cd420a0758fec726b1bf8d6c28a: Status 404 returned error can't find the container with id dcb4cec9b4cc8502a71427a545e30df569a10cd420a0758fec726b1bf8d6c28a
Jul 15 18:58:38.065833 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.065809    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"]
Jul 15 18:58:38.067922 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:58:38.067895    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03fb04ac_cf0f_44d4_9c3e_b720effac277.slice/crio-e83f4547ca3d5fa729cc053cf6b0654ba9bc62420054fee19cee899603af5249 WatchSource:0}: Error finding container e83f4547ca3d5fa729cc053cf6b0654ba9bc62420054fee19cee899603af5249: Status 404 returned error can't find the container with id e83f4547ca3d5fa729cc053cf6b0654ba9bc62420054fee19cee899603af5249
Jul 15 18:58:38.339216 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.339179    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21" path="/var/lib/kubelet/pods/4b5944d1-54fd-40a5-bbd4-5cb79d8c7a21/volumes"
Jul 15 18:58:38.339582 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.339562    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac636e5a-8020-49fb-b5d1-3461fb0ca9f2" path="/var/lib/kubelet/pods/ac636e5a-8020-49fb-b5d1-3461fb0ca9f2/volumes"
Jul 15 18:58:38.629322 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.629209    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxp6z"
Jul 15 18:58:38.629322 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.629213    2571 scope.go:117] "RemoveContainer" containerID="0d26223f9277f2234b89f44027f67f9df8d682bf82551d4c36f1fa5fb19f9b20"
Jul 15 18:58:38.630920 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.630887    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466" event={"ID":"03fb04ac-cf0f-44d4-9c3e-b720effac277","Type":"ContainerStarted","Data":"e83f93de9ca7e069097980ed538811bade7ec9cc7b13997150446a4e78743ad5"}
Jul 15 18:58:38.631040 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.630951    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466" event={"ID":"03fb04ac-cf0f-44d4-9c3e-b720effac277","Type":"ContainerStarted","Data":"e83f4547ca3d5fa729cc053cf6b0654ba9bc62420054fee19cee899603af5249"}
Jul 15 18:58:38.631306 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.631267    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"
Jul 15 18:58:38.633042 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.632777    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fthc"
Jul 15 18:58:38.639342 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.635650    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8" podUID="feec3520-c134-4d22-9807-099620f6c466" containerName="manager" containerID="cri-o://27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b" gracePeriod=2
Jul 15 18:58:38.641750 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.641247    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh" event={"ID":"b1b73889-c513-47cd-a2ef-ca935c1bc2dd","Type":"ContainerStarted","Data":"cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a"}
Jul 15 18:58:38.641750 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.641366    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh" event={"ID":"b1b73889-c513-47cd-a2ef-ca935c1bc2dd","Type":"ContainerStarted","Data":"dcb4cec9b4cc8502a71427a545e30df569a10cd420a0758fec726b1bf8d6c28a"}
Jul 15 18:58:38.642213 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.642157    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:38.649242 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.649221    2571 scope.go:117] "RemoveContainer" containerID="9cec7cf0dceda8635df047da293e2ce7be587b638a137644e819af73b8cb4373"
Jul 15 18:58:38.653687 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.653647    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466" podStartSLOduration=1.653632806 podStartE2EDuration="1.653632806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:38.651600859 +0000 UTC m=+442.833373529" watchObservedRunningTime="2026-07-15 18:58:38.653632806 +0000 UTC m=+442.835405454"
Jul 15 18:58:38.676024 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.675972    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh" podStartSLOduration=1.675954838 podStartE2EDuration="1.675954838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:38.674998708 +0000 UTC m=+442.856771375" watchObservedRunningTime="2026-07-15 18:58:38.675954838 +0000 UTC m=+442.857727508"
Jul 15 18:58:38.881324 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.881241    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:38.883600 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:38.883572    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="feec3520-c134-4d22-9807-099620f6c466" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:38.938256 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.938221    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feec3520-c134-4d22-9807-099620f6c466-extensions-socket-volume\") pod \"feec3520-c134-4d22-9807-099620f6c466\" (UID: \"feec3520-c134-4d22-9807-099620f6c466\") "
Jul 15 18:58:38.938455 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.938395    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h7l8\" (UniqueName: \"kubernetes.io/projected/feec3520-c134-4d22-9807-099620f6c466-kube-api-access-4h7l8\") pod \"feec3520-c134-4d22-9807-099620f6c466\" (UID: \"feec3520-c134-4d22-9807-099620f6c466\") "
Jul 15 18:58:38.938758 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.938723    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feec3520-c134-4d22-9807-099620f6c466-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "feec3520-c134-4d22-9807-099620f6c466" (UID: "feec3520-c134-4d22-9807-099620f6c466"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:58:38.940463 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:38.940434    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feec3520-c134-4d22-9807-099620f6c466-kube-api-access-4h7l8" (OuterVolumeSpecName: "kube-api-access-4h7l8") pod "feec3520-c134-4d22-9807-099620f6c466" (UID: "feec3520-c134-4d22-9807-099620f6c466"). InnerVolumeSpecName "kube-api-access-4h7l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:58:39.039436 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:39.039400    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h7l8\" (UniqueName: \"kubernetes.io/projected/feec3520-c134-4d22-9807-099620f6c466-kube-api-access-4h7l8\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:58:39.039436 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:39.039429    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feec3520-c134-4d22-9807-099620f6c466-extensions-socket-volume\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:58:39.649991 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:39.649954    2571 generic.go:356] "Generic (PLEG): container finished" podID="feec3520-c134-4d22-9807-099620f6c466" containerID="27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b" exitCode=0
Jul 15 18:58:39.650192 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:39.649997    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:39.650192 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:39.650058    2571 scope.go:117] "RemoveContainer" containerID="27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b"
Jul 15 18:58:39.652659 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:39.652625    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="feec3520-c134-4d22-9807-099620f6c466" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:39.659088 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:39.659068    2571 scope.go:117] "RemoveContainer" containerID="27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b"
Jul 15 18:58:39.659345 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:39.659327    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b\": container with ID starting with 27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b not found: ID does not exist" containerID="27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b"
Jul 15 18:58:39.659400 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:39.659355    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b"} err="failed to get container status \"27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b\": rpc error: code = NotFound desc = could not find container \"27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b\": container with ID starting with 27b912344a1a75052f1e296abd52742348c7bf8f937e4f75fd3d57b6e549756b not found: ID does not exist"
Jul 15 18:58:39.660593 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:58:39.660572    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pnkf8\" is forbidden: User \"system:node:ip-10-0-130-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-233.ec2.internal' and this object" podUID="feec3520-c134-4d22-9807-099620f6c466" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pnkf8"
Jul 15 18:58:40.337520 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:40.337478    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feec3520-c134-4d22-9807-099620f6c466" path="/var/lib/kubelet/pods/feec3520-c134-4d22-9807-099620f6c466/volumes"
Jul 15 18:58:50.657680 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:50.657642    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:58:50.658188 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:50.657713    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gv466"
Jul 15 18:58:50.961714 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:50.961632    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"]
Jul 15 18:58:50.965269 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:50.965245    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:58:50.983187 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:50.983163    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"]
Jul 15 18:58:51.049424 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.049392    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn9np\" (UniqueName: \"kubernetes.io/projected/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-kube-api-access-bn9np\") pod \"kuadrant-operator-controller-manager-86878c769f-8d8h8\" (UID: \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:58:51.049556 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.049449    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8d8h8\" (UID: \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:58:51.150876 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.150848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn9np\" (UniqueName: \"kubernetes.io/projected/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-kube-api-access-bn9np\") pod \"kuadrant-operator-controller-manager-86878c769f-8d8h8\" (UID: \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:58:51.151046 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.150904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8d8h8\" (UID: \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:58:51.151214 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.151197    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8d8h8\" (UID: \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:58:51.161825 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.161798    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn9np\" (UniqueName: \"kubernetes.io/projected/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-kube-api-access-bn9np\") pod \"kuadrant-operator-controller-manager-86878c769f-8d8h8\" (UID: \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:58:51.275538 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.275465    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:58:51.413009 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.412908    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"]
Jul 15 18:58:51.416094 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:58:51.416062    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3c198a_f07b_4bf0_bc5a_70ad7d944d7f.slice/crio-8cb7599b9d6e22fcd72e11d6d73c894751407381c504441f17625787593c845c WatchSource:0}: Error finding container 8cb7599b9d6e22fcd72e11d6d73c894751407381c504441f17625787593c845c: Status 404 returned error can't find the container with id 8cb7599b9d6e22fcd72e11d6d73c894751407381c504441f17625787593c845c
Jul 15 18:58:51.713622 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.713586    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8" event={"ID":"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f","Type":"ContainerStarted","Data":"6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329"}
Jul 15 18:58:51.713981 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.713643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8" event={"ID":"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f","Type":"ContainerStarted","Data":"8cb7599b9d6e22fcd72e11d6d73c894751407381c504441f17625787593c845c"}
Jul 15 18:58:51.713981 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.713667    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:58:51.744255 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:58:51.744206    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8" podStartSLOduration=1.744189524 podStartE2EDuration="1.744189524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:51.741477891 +0000 UTC m=+455.923250561" watchObservedRunningTime="2026-07-15 18:58:51.744189524 +0000 UTC m=+455.925962194"
Jul 15 18:59:02.721220 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:02.721182    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 18:59:02.773603 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:02.773566    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"]
Jul 15 18:59:02.773785 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:02.773762    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh" podUID="b1b73889-c513-47cd-a2ef-ca935c1bc2dd" containerName="manager" containerID="cri-o://cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a" gracePeriod=10
Jul 15 18:59:03.025247 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.025218    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:59:03.159367 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.159332    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x55bn\" (UniqueName: \"kubernetes.io/projected/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-kube-api-access-x55bn\") pod \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\" (UID: \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\") "
Jul 15 18:59:03.159549 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.159442    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-extensions-socket-volume\") pod \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\" (UID: \"b1b73889-c513-47cd-a2ef-ca935c1bc2dd\") "
Jul 15 18:59:03.159842 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.159822    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b1b73889-c513-47cd-a2ef-ca935c1bc2dd" (UID: "b1b73889-c513-47cd-a2ef-ca935c1bc2dd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:59:03.161554 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.161530    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-kube-api-access-x55bn" (OuterVolumeSpecName: "kube-api-access-x55bn") pod "b1b73889-c513-47cd-a2ef-ca935c1bc2dd" (UID: "b1b73889-c513-47cd-a2ef-ca935c1bc2dd"). InnerVolumeSpecName "kube-api-access-x55bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:59:03.260640 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.260559    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-extensions-socket-volume\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:59:03.260640 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.260590    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x55bn\" (UniqueName: \"kubernetes.io/projected/b1b73889-c513-47cd-a2ef-ca935c1bc2dd-kube-api-access-x55bn\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 18:59:03.771077 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.771042    2571 generic.go:356] "Generic (PLEG): container finished" podID="b1b73889-c513-47cd-a2ef-ca935c1bc2dd" containerID="cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a" exitCode=0
Jul 15 18:59:03.771555 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.771090    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"
Jul 15 18:59:03.771555 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.771092    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh" event={"ID":"b1b73889-c513-47cd-a2ef-ca935c1bc2dd","Type":"ContainerDied","Data":"cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a"}
Jul 15 18:59:03.771555 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.771216    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh" event={"ID":"b1b73889-c513-47cd-a2ef-ca935c1bc2dd","Type":"ContainerDied","Data":"dcb4cec9b4cc8502a71427a545e30df569a10cd420a0758fec726b1bf8d6c28a"}
Jul 15 18:59:03.771555 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.771245    2571 scope.go:117] "RemoveContainer" containerID="cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a"
Jul 15 18:59:03.780748 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.780612    2571 scope.go:117] "RemoveContainer" containerID="cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a"
Jul 15 18:59:03.780895 ip-10-0-130-233 kubenswrapper[2571]: E0715 18:59:03.780878    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a\": container with ID starting with cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a not found: ID does not exist" containerID="cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a"
Jul 15 18:59:03.780941 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.780903    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a"} err="failed to get container status \"cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a\": rpc error: code = NotFound desc = could not find container \"cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a\": container with ID starting with cbd516e4614398a02c8e5da2d8f7e323d757d1773fcaf3e33b58380a1facce2a not found: ID does not exist"
Jul 15 18:59:03.795106 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.795075    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"]
Jul 15 18:59:03.799054 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:03.799029    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tbhfh"]
Jul 15 18:59:04.337517 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:04.337475    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1b73889-c513-47cd-a2ef-ca935c1bc2dd" path="/var/lib/kubelet/pods/b1b73889-c513-47cd-a2ef-ca935c1bc2dd/volumes"
Jul 15 18:59:07.226990 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.226948    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"]
Jul 15 18:59:07.227562 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.227541    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b73889-c513-47cd-a2ef-ca935c1bc2dd" containerName="manager"
Jul 15 18:59:07.227654 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.227564    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b73889-c513-47cd-a2ef-ca935c1bc2dd" containerName="manager"
Jul 15 18:59:07.227654 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.227643    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b73889-c513-47cd-a2ef-ca935c1bc2dd" containerName="manager"
Jul 15 18:59:07.230606 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.230584    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.233962 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.233938    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8n8gs\""
Jul 15 18:59:07.243748 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.243726    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"]
Jul 15 18:59:07.398651 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.398615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.398651 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.398655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.398845 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.398677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.398845 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.398776    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.398845 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.398805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcf006fd-11fe-40d0-be77-35608b4413ee-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.399071 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.398849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.399071 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.398885    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.399071 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.398945    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.399071 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.398962    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf4t5\" (UniqueName: \"kubernetes.io/projected/dcf006fd-11fe-40d0-be77-35608b4413ee-kube-api-access-jf4t5\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499476 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499476 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499432    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcf006fd-11fe-40d0-be77-35608b4413ee-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499672 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499672 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499672 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499672 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499572    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf4t5\" (UniqueName: \"kubernetes.io/projected/dcf006fd-11fe-40d0-be77-35608b4413ee-kube-api-access-jf4t5\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499672 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499672 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499972 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499972 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499836    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.499972 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.499957    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.500132 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.500005    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.500132 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.500056    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.500261 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.500241    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcf006fd-11fe-40d0-be77-35608b4413ee-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.501748 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.501728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.501968 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.501950    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.508524 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.508472    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf4t5\" (UniqueName: \"kubernetes.io/projected/dcf006fd-11fe-40d0-be77-35608b4413ee-kube-api-access-jf4t5\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.508721 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.508696    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcf006fd-11fe-40d0-be77-35608b4413ee-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j8c9d\" (UID: \"dcf006fd-11fe-40d0-be77-35608b4413ee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.540556 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.540535    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:07.679705 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.679678    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"]
Jul 15 18:59:07.682087 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:59:07.682058    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf006fd_11fe_40d0_be77_35608b4413ee.slice/crio-caedf171fc19a8462691662f3ee16bfa98260362434f70363c138bad5d7c53ae WatchSource:0}: Error finding container caedf171fc19a8462691662f3ee16bfa98260362434f70363c138bad5d7c53ae: Status 404 returned error can't find the container with id caedf171fc19a8462691662f3ee16bfa98260362434f70363c138bad5d7c53ae
Jul 15 18:59:07.684193 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.684158    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:59:07.684321 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.684243    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:59:07.684321 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.684307    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 18:59:07.794008 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.793915    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" event={"ID":"dcf006fd-11fe-40d0-be77-35608b4413ee","Type":"ContainerStarted","Data":"174c49ee626ecfe855ca978e0d4d11de6faad7a19894bf6c00c83457a1d45a90"}
Jul 15 18:59:07.794008 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.793980    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" event={"ID":"dcf006fd-11fe-40d0-be77-35608b4413ee","Type":"ContainerStarted","Data":"caedf171fc19a8462691662f3ee16bfa98260362434f70363c138bad5d7c53ae"}
Jul 15 18:59:07.820253 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:07.820196    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" podStartSLOduration=0.820173382 podStartE2EDuration="820.173382ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:59:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:59:07.818601878 +0000 UTC m=+472.000374543" watchObservedRunningTime="2026-07-15 18:59:07.820173382 +0000 UTC m=+472.001946052"
Jul 15 18:59:08.541473 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:08.541431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:08.546168 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:08.546142    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:08.799038 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:08.798953    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:08.800084 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:08.800063    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 18:59:22.195185 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.195148    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 18:59:22.200138 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.200116    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 18:59:22.202743 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.202722    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4wzkg\""
Jul 15 18:59:22.202743 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.202732    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 18:59:22.207177 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.207152    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 18:59:22.234332 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.234300    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 18:59:22.234692 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.234672    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h85lz\" (UniqueName: \"kubernetes.io/projected/305d2bfb-740a-4d74-9a4a-b13a0209b000-kube-api-access-h85lz\") pod \"limitador-limitador-54d6d988d5-9hjrw\" (UID: \"305d2bfb-740a-4d74-9a4a-b13a0209b000\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 18:59:22.234800 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.234781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/305d2bfb-740a-4d74-9a4a-b13a0209b000-config-file\") pod \"limitador-limitador-54d6d988d5-9hjrw\" (UID: \"305d2bfb-740a-4d74-9a4a-b13a0209b000\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 18:59:22.335267 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.335235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/305d2bfb-740a-4d74-9a4a-b13a0209b000-config-file\") pod \"limitador-limitador-54d6d988d5-9hjrw\" (UID: \"305d2bfb-740a-4d74-9a4a-b13a0209b000\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 18:59:22.335461 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.335330    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h85lz\" (UniqueName: \"kubernetes.io/projected/305d2bfb-740a-4d74-9a4a-b13a0209b000-kube-api-access-h85lz\") pod \"limitador-limitador-54d6d988d5-9hjrw\" (UID: \"305d2bfb-740a-4d74-9a4a-b13a0209b000\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 18:59:22.335867 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.335850    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/305d2bfb-740a-4d74-9a4a-b13a0209b000-config-file\") pod \"limitador-limitador-54d6d988d5-9hjrw\" (UID: \"305d2bfb-740a-4d74-9a4a-b13a0209b000\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 18:59:22.347070 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.347044    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h85lz\" (UniqueName: \"kubernetes.io/projected/305d2bfb-740a-4d74-9a4a-b13a0209b000-kube-api-access-h85lz\") pod \"limitador-limitador-54d6d988d5-9hjrw\" (UID: \"305d2bfb-740a-4d74-9a4a-b13a0209b000\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 18:59:22.511914 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.511825    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 18:59:22.641796 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.641767    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 18:59:22.643450 ip-10-0-130-233 kubenswrapper[2571]: W0715 18:59:22.643424    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305d2bfb_740a_4d74_9a4a_b13a0209b000.slice/crio-f059c3edf390acc10fc014a487cd3805ed85472a6b03da454f76aada4638d138 WatchSource:0}: Error finding container f059c3edf390acc10fc014a487cd3805ed85472a6b03da454f76aada4638d138: Status 404 returned error can't find the container with id f059c3edf390acc10fc014a487cd3805ed85472a6b03da454f76aada4638d138
Jul 15 18:59:22.867113 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:22.867073    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw" event={"ID":"305d2bfb-740a-4d74-9a4a-b13a0209b000","Type":"ContainerStarted","Data":"f059c3edf390acc10fc014a487cd3805ed85472a6b03da454f76aada4638d138"}
Jul 15 18:59:25.884077 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:25.884041    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw" event={"ID":"305d2bfb-740a-4d74-9a4a-b13a0209b000","Type":"ContainerStarted","Data":"3cd348927f95380ec603d5a3e434e53675a1a7600d78e055cd410275b033f38e"}
Jul 15 18:59:25.884467 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:25.884190    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 18:59:25.901726 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:25.901681    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw" podStartSLOduration=1.37533397 podStartE2EDuration="3.901667394s" totalImagesPullingTime="2.526333424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:59:25.899911652 +0000 UTC m=+490.081684333" watchObservedRunningTime="2026-07-15 18:59:25.901667394 +0000 UTC m=+490.083440064"
Jul 15 18:59:36.889997 ip-10-0-130-233 kubenswrapper[2571]: I0715 18:59:36.889961    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"
Jul 15 19:00:38.804481 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:38.804444    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:00:47.294129 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:47.294092    2571 generic.go:356] "Generic (PLEG): container finished" podID="dcf006fd-11fe-40d0-be77-35608b4413ee" containerID="174c49ee626ecfe855ca978e0d4d11de6faad7a19894bf6c00c83457a1d45a90" exitCode=0
Jul 15 19:00:47.294607 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:47.294155    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" event={"ID":"dcf006fd-11fe-40d0-be77-35608b4413ee","Type":"ContainerDied","Data":"174c49ee626ecfe855ca978e0d4d11de6faad7a19894bf6c00c83457a1d45a90"}
Jul 15 19:00:47.294607 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:47.294532    2571 scope.go:117] "RemoveContainer" containerID="174c49ee626ecfe855ca978e0d4d11de6faad7a19894bf6c00c83457a1d45a90"
Jul 15 19:00:47.295488 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:47.295459    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:00:47.295599 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:47.295527    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:00:47.295599 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:47.295558    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:00:48.300890 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:48.300854    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" event={"ID":"dcf006fd-11fe-40d0-be77-35608b4413ee","Type":"ContainerStarted","Data":"2ef280f97e07d1fe8b8b40dc84adb38c5d88b2ee9a1f5e9702859c7b70e1cd22"}
Jul 15 19:00:48.540932 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:48.540898    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 19:00:48.541101 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:48.541083    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j8c9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 15 19:00:48.541153 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:48.541136    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" podUID="dcf006fd-11fe-40d0-be77-35608b4413ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 15 19:00:49.541833 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:49.541789    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j8c9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 15 19:00:49.542237 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:49.541868    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" podUID="dcf006fd-11fe-40d0-be77-35608b4413ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 15 19:00:50.541222 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:50.541181    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j8c9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 15 19:00:50.541558 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:50.541527    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" podUID="dcf006fd-11fe-40d0-be77-35608b4413ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 15 19:00:51.541567 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:51.541092    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j8c9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 15 19:00:51.541567 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:51.541156    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" podUID="dcf006fd-11fe-40d0-be77-35608b4413ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 15 19:00:52.541655 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:52.541621    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j8c9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 15 19:00:52.542200 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:52.542167    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" podUID="dcf006fd-11fe-40d0-be77-35608b4413ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 15 19:00:53.545695 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:53.545652    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j8c9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 15 19:00:53.546165 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:53.545741    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d" podUID="dcf006fd-11fe-40d0-be77-35608b4413ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 15 19:00:53.799832 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:53.799743    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 19:00:54.545259 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:54.545233    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 19:00:54.546242 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:00:54.546218    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j8c9d"
Jul 15 19:01:04.003517 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:01:04.003485    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:01:08.995084 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:01:08.995049    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:01:16.200533 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:01:16.200502    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:01:16.203331 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:01:16.203312    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:01:19.710555 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:01:19.710514    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:01:26.187004 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:01:26.186965    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:01:33.402474 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:01:33.402431    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:01:42.798777 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:01:42.798688    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:03:06.892964 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:03:06.892928    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:03:18.195979 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:03:18.195941    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:03:27.996571 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:03:27.996536    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:03:37.494066 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:03:37.494026    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:03:48.398456 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:03:48.398420    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:04:15.127370 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:04:15.127326    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:04:25.990744 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:04:25.990707    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:05:01.397471 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:05:01.397437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:05:11.195044 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:05:11.195008    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:05:19.607026 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:05:19.606993    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:05:28.792157 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:05:28.792119    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:05:39.400614 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:05:39.400581    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:05:49.094683 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:05:49.094651    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:06:00.724539 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:06:00.724505    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:06:10.607503 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:06:10.607422    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:06:16.231675 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:06:16.231646    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:06:16.232124 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:06:16.231865    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:06:33.195401 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:06:33.195358    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:06:43.898692 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:06:43.898652    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:07:06.400713 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:07:06.400673    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:07:19.007681 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:07:19.007640    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:07:35.422497 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:07:35.422459    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:07:45.315419 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:07:45.315337    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:07:55.799494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:07:55.799453    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:08:05.713479 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:05.713443    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:08:14.702176 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:14.702137    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:08:41.232377 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:41.232343    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"]
Jul 15 19:08:41.232961 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:41.232557    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8" podUID="9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f" containerName="manager" containerID="cri-o://6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329" gracePeriod=10
Jul 15 19:08:43.790067 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:43.790004    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 19:08:43.803217 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:43.803189    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-extensions-socket-volume\") pod \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\" (UID: \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\") "
Jul 15 19:08:43.803375 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:43.803256    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn9np\" (UniqueName: \"kubernetes.io/projected/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-kube-api-access-bn9np\") pod \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\" (UID: \"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f\") "
Jul 15 19:08:43.803649 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:43.803623    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f" (UID: "9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:08:43.805321 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:43.805272    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-kube-api-access-bn9np" (OuterVolumeSpecName: "kube-api-access-bn9np") pod "9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f" (UID: "9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f"). InnerVolumeSpecName "kube-api-access-bn9np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:08:43.904491 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:43.904453    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-extensions-socket-volume\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:08:43.904491 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:43.904483    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn9np\" (UniqueName: \"kubernetes.io/projected/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f-kube-api-access-bn9np\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:08:44.587275 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:44.587235    2571 generic.go:356] "Generic (PLEG): container finished" podID="9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f" containerID="6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329" exitCode=0
Jul 15 19:08:44.587451 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:44.587304    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"
Jul 15 19:08:44.587451 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:44.587308    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8" event={"ID":"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f","Type":"ContainerDied","Data":"6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329"}
Jul 15 19:08:44.587451 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:44.587363    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8" event={"ID":"9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f","Type":"ContainerDied","Data":"8cb7599b9d6e22fcd72e11d6d73c894751407381c504441f17625787593c845c"}
Jul 15 19:08:44.587451 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:44.587394    2571 scope.go:117] "RemoveContainer" containerID="6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329"
Jul 15 19:08:44.597084 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:44.597063    2571 scope.go:117] "RemoveContainer" containerID="6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329"
Jul 15 19:08:44.597396 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:08:44.597373    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329\": container with ID starting with 6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329 not found: ID does not exist" containerID="6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329"
Jul 15 19:08:44.597461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:44.597407    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329"} err="failed to get container status \"6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329\": rpc error: code = NotFound desc = could not find container \"6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329\": container with ID starting with 6df87f23bb2197c0a255628b307e625af0ca0db976d778dfafeb429a04ade329 not found: ID does not exist"
Jul 15 19:08:44.621109 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:44.621078    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"]
Jul 15 19:08:44.624486 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:44.624462    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8d8h8"]
Jul 15 19:08:46.337390 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:08:46.337360    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f" path="/var/lib/kubelet/pods/9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f/volumes"
Jul 15 19:09:42.875490 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:42.875454    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"]
Jul 15 19:09:42.875899 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:42.875823    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f" containerName="manager"
Jul 15 19:09:42.875899 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:42.875834    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f" containerName="manager"
Jul 15 19:09:42.875969 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:42.875905    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3c198a-f07b-4bf0-bc5a-70ad7d944d7f" containerName="manager"
Jul 15 19:09:42.878910 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:42.878889    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:09:42.882681 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:42.882664    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-glvv5\""
Jul 15 19:09:42.896027 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:42.895980    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"]
Jul 15 19:09:42.949419 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:42.949373    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwwn6\" (UniqueName: \"kubernetes.io/projected/0cb924dd-7f17-4b5c-84a7-2419e4614428-kube-api-access-cwwn6\") pod \"kuadrant-operator-controller-manager-86878c769f-44v4p\" (UID: \"0cb924dd-7f17-4b5c-84a7-2419e4614428\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:09:42.949596 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:42.949505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cb924dd-7f17-4b5c-84a7-2419e4614428-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-44v4p\" (UID: \"0cb924dd-7f17-4b5c-84a7-2419e4614428\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:09:43.050159 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.050110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwwn6\" (UniqueName: \"kubernetes.io/projected/0cb924dd-7f17-4b5c-84a7-2419e4614428-kube-api-access-cwwn6\") pod \"kuadrant-operator-controller-manager-86878c769f-44v4p\" (UID: \"0cb924dd-7f17-4b5c-84a7-2419e4614428\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:09:43.050395 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.050192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cb924dd-7f17-4b5c-84a7-2419e4614428-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-44v4p\" (UID: \"0cb924dd-7f17-4b5c-84a7-2419e4614428\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:09:43.050616 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.050593    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cb924dd-7f17-4b5c-84a7-2419e4614428-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-44v4p\" (UID: \"0cb924dd-7f17-4b5c-84a7-2419e4614428\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:09:43.061766 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.061733    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwwn6\" (UniqueName: \"kubernetes.io/projected/0cb924dd-7f17-4b5c-84a7-2419e4614428-kube-api-access-cwwn6\") pod \"kuadrant-operator-controller-manager-86878c769f-44v4p\" (UID: \"0cb924dd-7f17-4b5c-84a7-2419e4614428\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:09:43.189734 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.189625    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:09:43.353865 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.353823    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"]
Jul 15 19:09:43.356499 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:09:43.356467    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb924dd_7f17_4b5c_84a7_2419e4614428.slice/crio-88e8c7e2f4cd8cc657e788bad6ee4d546f8d3a53deb6d2ae8bb8f3854967b5e9 WatchSource:0}: Error finding container 88e8c7e2f4cd8cc657e788bad6ee4d546f8d3a53deb6d2ae8bb8f3854967b5e9: Status 404 returned error can't find the container with id 88e8c7e2f4cd8cc657e788bad6ee4d546f8d3a53deb6d2ae8bb8f3854967b5e9
Jul 15 19:09:43.877770 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.877729    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p" event={"ID":"0cb924dd-7f17-4b5c-84a7-2419e4614428","Type":"ContainerStarted","Data":"bd0e22ec9e77d6d12c77cfb3451aac8753ffe67237c88d43cb2534b54300538c"}
Jul 15 19:09:43.878255 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.877794    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p" event={"ID":"0cb924dd-7f17-4b5c-84a7-2419e4614428","Type":"ContainerStarted","Data":"88e8c7e2f4cd8cc657e788bad6ee4d546f8d3a53deb6d2ae8bb8f3854967b5e9"}
Jul 15 19:09:43.878255 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.877867    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:09:43.900081 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:43.900032    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p" podStartSLOduration=1.90001558 podStartE2EDuration="1.90001558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:09:43.89790852 +0000 UTC m=+1108.079681189" watchObservedRunningTime="2026-07-15 19:09:43.90001558 +0000 UTC m=+1108.081788249"
Jul 15 19:09:54.885767 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:09:54.885733    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-44v4p"
Jul 15 19:10:03.889178 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:10:03.889135    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:10:15.308561 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:10:15.308520    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:10:24.201292 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:10:24.201241    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:10:36.598965 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:10:36.598919    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:10:48.802634 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:10:48.802592    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:10:58.442855 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:10:58.442814    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:11:06.813416 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:11:06.813380    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:11:16.263746 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:11:16.263711    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:11:16.266235 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:11:16.266211    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:11:18.193617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:11:18.193574    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:11:29.296147 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:11:29.296110    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:11:37.404395 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:11:37.404358    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:11:49.918509 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:11:49.918466    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:11:56.493298 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:11:56.493225    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:12:22.096431 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:12:22.096385    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:12:29.898977 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:12:29.898938    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:12:40.118350 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:12:40.118310    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:12:49.598122 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:12:49.598087    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:12:59.307437 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:12:59.307400    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:13:11.305472 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:13:11.305434    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:13:23.004400 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:13:23.004360    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:13:32.400363 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:13:32.400323    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:13:40.296336 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:13:40.296250    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:13:51.197197 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:13:51.197161    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:14:00.509683 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:14:00.509644    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:14:13.295076 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:14:13.295032    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:14:22.498643 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:14:22.498602    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:14:34.102396 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:14:34.102356    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:14:46.801948 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:14:46.801905    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:14:58.190335 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:14:58.190292    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:15:00.183578 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:00.183532    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn"]
Jul 15 19:15:00.187707 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:00.187682    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn"
Jul 15 19:15:00.191974 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:00.191940    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:15:00.197065 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:00.197043    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn"
Jul 15 19:15:00.218953 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:00.218919    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn"]
Jul 15 19:15:00.351893 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:00.351869    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn"]
Jul 15 19:15:00.354388 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:15:00.354356    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod547f8329_38e3_4fa3_bb4f_65efa6ad887e.slice/crio-6472f20861aa68881476262c7361a1f01150a6043f29ff73948946c1652687c2 WatchSource:0}: Error finding container 6472f20861aa68881476262c7361a1f01150a6043f29ff73948946c1652687c2: Status 404 returned error can't find the container with id 6472f20861aa68881476262c7361a1f01150a6043f29ff73948946c1652687c2
Jul 15 19:15:00.356158 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:00.356139    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:15:00.482132 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:00.482039    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn" event={"ID":"547f8329-38e3-4fa3-bb4f-65efa6ad887e","Type":"ContainerStarted","Data":"6472f20861aa68881476262c7361a1f01150a6043f29ff73948946c1652687c2"}
Jul 15 19:15:03.498098 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:03.498059    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn" event={"ID":"547f8329-38e3-4fa3-bb4f-65efa6ad887e","Type":"ContainerStarted","Data":"dcefaaaaf306a4ba86dac39189a4c0b57d60635598a795e5a76c39620ae2c94e"}
Jul 15 19:15:03.513321 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:03.513242    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn" podStartSLOduration=0.969994094 podStartE2EDuration="3.513216331s" totalImagesPullingTime="2.543222237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:03.512373078 +0000 UTC m=+1427.694145748" watchObservedRunningTime="2026-07-15 19:15:03.513216331 +0000 UTC m=+1427.694989044"
Jul 15 19:15:04.504579 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:04.504545    2571 generic.go:356] "Generic (PLEG): container finished" podID="547f8329-38e3-4fa3-bb4f-65efa6ad887e" containerID="dcefaaaaf306a4ba86dac39189a4c0b57d60635598a795e5a76c39620ae2c94e" exitCode=0
Jul 15 19:15:04.504958 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:04.504638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn" event={"ID":"547f8329-38e3-4fa3-bb4f-65efa6ad887e","Type":"ContainerDied","Data":"dcefaaaaf306a4ba86dac39189a4c0b57d60635598a795e5a76c39620ae2c94e"}
Jul 15 19:15:05.648353 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:05.648322    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn"
Jul 15 19:15:06.516181 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:06.516153    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn"
Jul 15 19:15:06.516377 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:06.516153    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735715-g69rn" event={"ID":"547f8329-38e3-4fa3-bb4f-65efa6ad887e","Type":"ContainerDied","Data":"6472f20861aa68881476262c7361a1f01150a6043f29ff73948946c1652687c2"}
Jul 15 19:15:06.516377 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:06.516274    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6472f20861aa68881476262c7361a1f01150a6043f29ff73948946c1652687c2"
Jul 15 19:15:11.005638 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:11.005602    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:15:23.695902 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:23.695863    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:15:36.894251 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:36.894211    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:15:46.497097 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:46.497060    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:15:59.600334 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:15:59.600273    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:16:09.907222 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:09.907185    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:16:16.294966 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:16.294929    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:16:16.297945 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:16.297912    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:16:19.201172 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.201135    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:16:19.550795 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.550720    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"]
Jul 15 19:16:19.551136 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.551122    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547f8329-38e3-4fa3-bb4f-65efa6ad887e" containerName="cleanup"
Jul 15 19:16:19.551136 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.551137    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="547f8329-38e3-4fa3-bb4f-65efa6ad887e" containerName="cleanup"
Jul 15 19:16:19.551377 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.551244    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="547f8329-38e3-4fa3-bb4f-65efa6ad887e" containerName="cleanup"
Jul 15 19:16:19.554382 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.554356    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.558116 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.558096    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ba1e3d30-openshift-default-dockercfg-tmtrg\""
Jul 15 19:16:19.571672 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.571642    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"]
Jul 15 19:16:19.678525 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.678486    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgpz7\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-kube-api-access-dgpz7\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.678703 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.678529    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-podinfo\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.678703 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.678587    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istiod-ca-cert\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.678703 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.678638    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-token\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.678842 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.678731    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-credential-socket\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.678842 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.678770    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-socket\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.678842 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.678808    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-certs\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.678842 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.678829    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-envoy\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.678986 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.678845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-data\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.779707 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.779665    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-certs\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.779707 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.779707    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-envoy\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.779963 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.779726    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-data\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.779963 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.779767    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgpz7\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-kube-api-access-dgpz7\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.779963 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.779792    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-podinfo\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.779963 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.779830    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istiod-ca-cert\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.779963 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.779880    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-token\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.779963 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.779942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-credential-socket\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.780260 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.779980    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-socket\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.780260 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.780163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-certs\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.780260 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.780215    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-data\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.780458 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.780380    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-socket\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.780561 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.780541    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-credential-socket\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.780647 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.780628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istiod-ca-cert\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.782064 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.782037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-envoy\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.782324 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.782306    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-podinfo\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.802881 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.802818    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-token\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.803908 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.803888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgpz7\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-kube-api-access-dgpz7\") pod \"e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") " pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:19.866001 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:19.865966    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:20.016378 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:20.016349    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"]
Jul 15 19:16:20.019137 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:16:20.019108    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3b8aad_57bb_4438_8eed_43f30fda5ef5.slice/crio-1dc28aa56dfc09df7c0bfa67a3168c2bbf869746e11151715ffd6178193ee411 WatchSource:0}: Error finding container 1dc28aa56dfc09df7c0bfa67a3168c2bbf869746e11151715ffd6178193ee411: Status 404 returned error can't find the container with id 1dc28aa56dfc09df7c0bfa67a3168c2bbf869746e11151715ffd6178193ee411
Jul 15 19:16:20.021308 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:20.021244    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:16:20.021414 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:20.021340    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:16:20.021414 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:20.021391    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:16:20.892798 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:20.892756    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" event={"ID":"9a3b8aad-57bb-4438-8eed-43f30fda5ef5","Type":"ContainerStarted","Data":"241914fb51c7f17f28f50f6f70ac70d642c8ea2a9147f021684d9624de2f02e8"}
Jul 15 19:16:20.893184 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:20.892814    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" event={"ID":"9a3b8aad-57bb-4438-8eed-43f30fda5ef5","Type":"ContainerStarted","Data":"1dc28aa56dfc09df7c0bfa67a3168c2bbf869746e11151715ffd6178193ee411"}
Jul 15 19:16:20.941398 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:20.941338    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" podStartSLOduration=1.941316286 podStartE2EDuration="1.941316286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:20.940712948 +0000 UTC m=+1505.122485641" watchObservedRunningTime="2026-07-15 19:16:20.941316286 +0000 UTC m=+1505.123088960"
Jul 15 19:16:21.866912 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:21.866878    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:21.871912 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:21.871884    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:21.904703 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:21.904662    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:21.905679 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:21.905657    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:25.847712 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:25.847671    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"]
Jul 15 19:16:25.852433 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:25.852398    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"
Jul 15 19:16:25.855707 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:25.855675    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:16:25.855916 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:25.855896    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:16:25.861456 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:25.861424    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"]
Jul 15 19:16:25.945585 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:25.945532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41387a42-93bc-42a4-81bb-60a605402b1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28\" (UID: \"41387a42-93bc-42a4-81bb-60a605402b1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"
Jul 15 19:16:26.046664 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:26.046619    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41387a42-93bc-42a4-81bb-60a605402b1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28\" (UID: \"41387a42-93bc-42a4-81bb-60a605402b1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"
Jul 15 19:16:26.047900 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:26.047872    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41387a42-93bc-42a4-81bb-60a605402b1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28\" (UID: \"41387a42-93bc-42a4-81bb-60a605402b1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"
Jul 15 19:16:26.170899 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:26.170816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"
Jul 15 19:16:26.329736 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:26.329708    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"]
Jul 15 19:16:26.331445 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:16:26.331413    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41387a42_93bc_42a4_81bb_60a605402b1c.slice/crio-ec487440e8e570507ce368ada119f3c6b1596ddb1b2a07e0636c51442331f650 WatchSource:0}: Error finding container ec487440e8e570507ce368ada119f3c6b1596ddb1b2a07e0636c51442331f650: Status 404 returned error can't find the container with id ec487440e8e570507ce368ada119f3c6b1596ddb1b2a07e0636c51442331f650
Jul 15 19:16:26.929786 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:26.929750    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" event={"ID":"41387a42-93bc-42a4-81bb-60a605402b1c","Type":"ContainerStarted","Data":"68abac6e666e31bacbe85fb6aa05b2709b6ca802fd617bd290399fc592263642"}
Jul 15 19:16:26.930159 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:26.929810    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" event={"ID":"41387a42-93bc-42a4-81bb-60a605402b1c","Type":"ContainerStarted","Data":"ec487440e8e570507ce368ada119f3c6b1596ddb1b2a07e0636c51442331f650"}
Jul 15 19:16:26.970381 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:26.970319    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" podStartSLOduration=1.9702984639999999 podStartE2EDuration="1.970298464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:26.95967411 +0000 UTC m=+1511.141446783" watchObservedRunningTime="2026-07-15 19:16:26.970298464 +0000 UTC m=+1511.152071136"
Jul 15 19:16:27.938089 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:27.938043    2571 generic.go:356] "Generic (PLEG): container finished" podID="41387a42-93bc-42a4-81bb-60a605402b1c" containerID="68abac6e666e31bacbe85fb6aa05b2709b6ca802fd617bd290399fc592263642" exitCode=7
Jul 15 19:16:27.938615 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:27.938178    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" event={"ID":"41387a42-93bc-42a4-81bb-60a605402b1c","Type":"ContainerDied","Data":"68abac6e666e31bacbe85fb6aa05b2709b6ca802fd617bd290399fc592263642"}
Jul 15 19:16:27.938684 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:27.938627    2571 scope.go:117] "RemoveContainer" containerID="68abac6e666e31bacbe85fb6aa05b2709b6ca802fd617bd290399fc592263642"
Jul 15 19:16:28.947838 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:28.947793    2571 generic.go:356] "Generic (PLEG): container finished" podID="41387a42-93bc-42a4-81bb-60a605402b1c" containerID="986eb026d15190a216098c7f9fe01068e490d626e6aedb1153b5327f7676b91a" exitCode=7
Jul 15 19:16:28.950882 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:28.947889    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" event={"ID":"41387a42-93bc-42a4-81bb-60a605402b1c","Type":"ContainerDied","Data":"986eb026d15190a216098c7f9fe01068e490d626e6aedb1153b5327f7676b91a"}
Jul 15 19:16:28.950882 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:28.947948    2571 scope.go:117] "RemoveContainer" containerID="68abac6e666e31bacbe85fb6aa05b2709b6ca802fd617bd290399fc592263642"
Jul 15 19:16:28.950882 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:28.948358    2571 scope.go:117] "RemoveContainer" containerID="986eb026d15190a216098c7f9fe01068e490d626e6aedb1153b5327f7676b91a"
Jul 15 19:16:28.950882 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:16:28.948633    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28_odh-ai-gateway-infra(41387a42-93bc-42a4-81bb-60a605402b1c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" podUID="41387a42-93bc-42a4-81bb-60a605402b1c"
Jul 15 19:16:29.955650 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:29.955620    2571 scope.go:117] "RemoveContainer" containerID="986eb026d15190a216098c7f9fe01068e490d626e6aedb1153b5327f7676b91a"
Jul 15 19:16:29.956087 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:16:29.955861    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28_odh-ai-gateway-infra(41387a42-93bc-42a4-81bb-60a605402b1c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" podUID="41387a42-93bc-42a4-81bb-60a605402b1c"
Jul 15 19:16:31.900033 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:31.899956    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:16:31.967997 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:31.967920    2571 generic.go:356] "Generic (PLEG): container finished" podID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerID="241914fb51c7f17f28f50f6f70ac70d642c8ea2a9147f021684d9624de2f02e8" exitCode=0
Jul 15 19:16:31.967997 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:31.967975    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" event={"ID":"9a3b8aad-57bb-4438-8eed-43f30fda5ef5","Type":"ContainerDied","Data":"241914fb51c7f17f28f50f6f70ac70d642c8ea2a9147f021684d9624de2f02e8"}
Jul 15 19:16:31.968385 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:31.968369    2571 scope.go:117] "RemoveContainer" containerID="241914fb51c7f17f28f50f6f70ac70d642c8ea2a9147f021684d9624de2f02e8"
Jul 15 19:16:31.969402 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:31.969369    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:16:31.969471 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:31.969441    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:16:31.969509 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:31.969472    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:16:32.976641 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:32.976602    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" event={"ID":"9a3b8aad-57bb-4438-8eed-43f30fda5ef5","Type":"ContainerStarted","Data":"0e548e1469248e49c845285736edb305fae2954dc543a630c84f53c23546a974"}
Jul 15 19:16:33.866954 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:33.866902    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:33.868135 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:33.868108    2571 patch_prober.go:28] interesting pod/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 15 19:16:33.868199 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:33.868166    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 15 19:16:34.866494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:34.866454    2571 patch_prober.go:28] interesting pod/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 15 19:16:34.866981 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:34.866540    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 15 19:16:35.866896 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:35.866856    2571 patch_prober.go:28] interesting pod/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 15 19:16:35.867323 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:35.866943    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 15 19:16:36.867200 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:36.867156    2571 patch_prober.go:28] interesting pod/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 15 19:16:36.867606 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:36.867226    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 15 19:16:36.904753 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:36.904705    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:37.870231 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:37.870200    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:37.871152 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:37.871130    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:16:44.332265 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:44.332228    2571 scope.go:117] "RemoveContainer" containerID="986eb026d15190a216098c7f9fe01068e490d626e6aedb1153b5327f7676b91a"
Jul 15 19:16:45.040387 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:45.040301    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" event={"ID":"41387a42-93bc-42a4-81bb-60a605402b1c","Type":"ContainerStarted","Data":"eccc19bc6236ac066d237133b9e8c3abe7d151e076d58b77af8e9569fb88cf1a"}
Jul 15 19:16:46.046930 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:46.046897    2571 generic.go:356] "Generic (PLEG): container finished" podID="41387a42-93bc-42a4-81bb-60a605402b1c" containerID="eccc19bc6236ac066d237133b9e8c3abe7d151e076d58b77af8e9569fb88cf1a" exitCode=0
Jul 15 19:16:46.047339 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:46.046968    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" event={"ID":"41387a42-93bc-42a4-81bb-60a605402b1c","Type":"ContainerDied","Data":"eccc19bc6236ac066d237133b9e8c3abe7d151e076d58b77af8e9569fb88cf1a"}
Jul 15 19:16:46.047339 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:46.047028    2571 scope.go:117] "RemoveContainer" containerID="986eb026d15190a216098c7f9fe01068e490d626e6aedb1153b5327f7676b91a"
Jul 15 19:16:46.069935 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:46.069909    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"]
Jul 15 19:16:47.192297 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:47.192261    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"
Jul 15 19:16:47.276993 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:47.276948    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41387a42-93bc-42a4-81bb-60a605402b1c-maas-api-service-ca\") pod \"41387a42-93bc-42a4-81bb-60a605402b1c\" (UID: \"41387a42-93bc-42a4-81bb-60a605402b1c\") "
Jul 15 19:16:47.277306 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:47.277271    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41387a42-93bc-42a4-81bb-60a605402b1c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "41387a42-93bc-42a4-81bb-60a605402b1c" (UID: "41387a42-93bc-42a4-81bb-60a605402b1c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:16:47.378042 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:47.377998    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41387a42-93bc-42a4-81bb-60a605402b1c-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:16:48.061805 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:48.061773    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"
Jul 15 19:16:48.061805 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:48.061781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28" event={"ID":"41387a42-93bc-42a4-81bb-60a605402b1c","Type":"ContainerDied","Data":"ec487440e8e570507ce368ada119f3c6b1596ddb1b2a07e0636c51442331f650"}
Jul 15 19:16:48.061984 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:48.061825    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec487440e8e570507ce368ada119f3c6b1596ddb1b2a07e0636c51442331f650"
Jul 15 19:16:48.093935 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:48.093898    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"]
Jul 15 19:16:48.098818 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:48.098789    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-8wf28"]
Jul 15 19:16:48.338169 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:16:48.338131    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" path="/var/lib/kubelet/pods/41387a42-93bc-42a4-81bb-60a605402b1c/volumes"
Jul 15 19:17:25.910968 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.910923    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"]
Jul 15 19:17:25.911494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.911345    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" containerName="revoke-keys"
Jul 15 19:17:25.911494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.911357    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" containerName="revoke-keys"
Jul 15 19:17:25.911494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.911375    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" containerName="revoke-keys"
Jul 15 19:17:25.911494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.911380    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" containerName="revoke-keys"
Jul 15 19:17:25.911494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.911456    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" containerName="revoke-keys"
Jul 15 19:17:25.911494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.911464    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" containerName="revoke-keys"
Jul 15 19:17:25.911494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.911475    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" containerName="revoke-keys"
Jul 15 19:17:25.913541 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.913524    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"
Jul 15 19:17:25.916640 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.916615    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:17:25.916762 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.916650    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:17:25.923108 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.923081    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"]
Jul 15 19:17:25.944803 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:25.944773    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0267e6cb-201b-4287-a48c-57b1a4339f5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj\" (UID: \"0267e6cb-201b-4287-a48c-57b1a4339f5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"
Jul 15 19:17:26.046125 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:26.046079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0267e6cb-201b-4287-a48c-57b1a4339f5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj\" (UID: \"0267e6cb-201b-4287-a48c-57b1a4339f5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"
Jul 15 19:17:26.046760 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:26.046737    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0267e6cb-201b-4287-a48c-57b1a4339f5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj\" (UID: \"0267e6cb-201b-4287-a48c-57b1a4339f5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"
Jul 15 19:17:26.225309 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:26.225193    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"
Jul 15 19:17:26.572750 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:26.572725    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"]
Jul 15 19:17:26.574748 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:17:26.574725    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0267e6cb_201b_4287_a48c_57b1a4339f5e.slice/crio-28a5ea0481f0f2dceb2e7a9358b1e6e66c6a973d49da0f04c9e203d49783eb84 WatchSource:0}: Error finding container 28a5ea0481f0f2dceb2e7a9358b1e6e66c6a973d49da0f04c9e203d49783eb84: Status 404 returned error can't find the container with id 28a5ea0481f0f2dceb2e7a9358b1e6e66c6a973d49da0f04c9e203d49783eb84
Jul 15 19:17:27.258234 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:27.258200    2571 generic.go:356] "Generic (PLEG): container finished" podID="0267e6cb-201b-4287-a48c-57b1a4339f5e" containerID="7b6005ff1abf400b0afcdc9272abe65286c8bcda286a0eb70e78a12a1ad4fa0d" exitCode=0
Jul 15 19:17:27.258564 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:27.258300    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj" event={"ID":"0267e6cb-201b-4287-a48c-57b1a4339f5e","Type":"ContainerDied","Data":"7b6005ff1abf400b0afcdc9272abe65286c8bcda286a0eb70e78a12a1ad4fa0d"}
Jul 15 19:17:27.258564 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:27.258398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj" event={"ID":"0267e6cb-201b-4287-a48c-57b1a4339f5e","Type":"ContainerStarted","Data":"28a5ea0481f0f2dceb2e7a9358b1e6e66c6a973d49da0f04c9e203d49783eb84"}
Jul 15 19:17:28.404022 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:28.403990    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"
Jul 15 19:17:28.467532 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:28.467500    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0267e6cb-201b-4287-a48c-57b1a4339f5e-maas-api-service-ca\") pod \"0267e6cb-201b-4287-a48c-57b1a4339f5e\" (UID: \"0267e6cb-201b-4287-a48c-57b1a4339f5e\") "
Jul 15 19:17:28.467863 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:28.467843    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0267e6cb-201b-4287-a48c-57b1a4339f5e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0267e6cb-201b-4287-a48c-57b1a4339f5e" (UID: "0267e6cb-201b-4287-a48c-57b1a4339f5e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:28.569102 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:28.569071    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0267e6cb-201b-4287-a48c-57b1a4339f5e-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:29.270066 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:29.270035    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj"
Jul 15 19:17:29.270272 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:29.270063    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj" event={"ID":"0267e6cb-201b-4287-a48c-57b1a4339f5e","Type":"ContainerDied","Data":"28a5ea0481f0f2dceb2e7a9358b1e6e66c6a973d49da0f04c9e203d49783eb84"}
Jul 15 19:17:29.270272 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:29.270109    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28a5ea0481f0f2dceb2e7a9358b1e6e66c6a973d49da0f04c9e203d49783eb84"
Jul 15 19:17:39.395572 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:39.395533    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:17:51.222025 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.221982    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"]
Jul 15 19:17:51.222515 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.222187    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy" containerID="cri-o://0e548e1469248e49c845285736edb305fae2954dc543a630c84f53c23546a974" gracePeriod=30
Jul 15 19:17:51.841049 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.841010    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"]
Jul 15 19:17:51.841494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.841475    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" containerName="revoke-keys"
Jul 15 19:17:51.841494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.841493    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="41387a42-93bc-42a4-81bb-60a605402b1c" containerName="revoke-keys"
Jul 15 19:17:51.841660 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.841504    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0267e6cb-201b-4287-a48c-57b1a4339f5e" containerName="revoke-keys"
Jul 15 19:17:51.841660 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.841510    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0267e6cb-201b-4287-a48c-57b1a4339f5e" containerName="revoke-keys"
Jul 15 19:17:51.841660 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.841575    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0267e6cb-201b-4287-a48c-57b1a4339f5e" containerName="revoke-keys"
Jul 15 19:17:51.844540 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.844516    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:51.851094 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.851059    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9df5bb53-gw-openshift-default-dockercfg-s2q5b\""
Jul 15 19:17:51.872516 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.872481    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"]
Jul 15 19:17:51.991137 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.991095    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-socket\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:51.991374 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.991148    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8683f359-f033-47dc-a0c4-11823b729a52-istio-podinfo\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:51.991374 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.991241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-certs\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:51.991374 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.991334    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-istio-token\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:51.991543 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.991373    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-data\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:51.991543 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.991459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8683f359-f033-47dc-a0c4-11823b729a52-istiod-ca-cert\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:51.991543 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.991500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-envoy\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:51.991543 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.991527    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-credential-socket\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:51.991684 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:51.991560    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxx6s\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-kube-api-access-wxx6s\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092335 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092183    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-envoy\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092335 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092249    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-credential-socket\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092335 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092274    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxx6s\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-kube-api-access-wxx6s\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092335 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-socket\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092776 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8683f359-f033-47dc-a0c4-11823b729a52-istio-podinfo\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092776 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-certs\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092776 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092522    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-istio-token\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092776 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-data\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092776 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8683f359-f033-47dc-a0c4-11823b729a52-istiod-ca-cert\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092983 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092796    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-credential-socket\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.092983 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.092825    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-socket\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.093066 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.093003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-data\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.093103 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.093067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-certs\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.093334 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.093317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8683f359-f033-47dc-a0c4-11823b729a52-istiod-ca-cert\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.094604 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.094580    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-envoy\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.094843 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.094823    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8683f359-f033-47dc-a0c4-11823b729a52-istio-podinfo\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.102037 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.102009    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-istio-token\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.102204 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.102178    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxx6s\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-kube-api-access-wxx6s\") pod \"e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") " pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.157048 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.157009    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:52.308338 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.308311    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"]
Jul 15 19:17:52.310949 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:17:52.310924    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8683f359_f033_47dc_a0c4_11823b729a52.slice/crio-2598f7b471ab17c74211cfdb3decd044ec447267ec31cda677c95d8f3cfc77cc WatchSource:0}: Error finding container 2598f7b471ab17c74211cfdb3decd044ec447267ec31cda677c95d8f3cfc77cc: Status 404 returned error can't find the container with id 2598f7b471ab17c74211cfdb3decd044ec447267ec31cda677c95d8f3cfc77cc
Jul 15 19:17:52.313072 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.313037    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:17:52.313185 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.313140    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:17:52.313259 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.313186    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:17:52.392668 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.392622    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" event={"ID":"8683f359-f033-47dc-a0c4-11823b729a52","Type":"ContainerStarted","Data":"457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe"}
Jul 15 19:17:52.392843 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.392695    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" event={"ID":"8683f359-f033-47dc-a0c4-11823b729a52","Type":"ContainerStarted","Data":"2598f7b471ab17c74211cfdb3decd044ec447267ec31cda677c95d8f3cfc77cc"}
Jul 15 19:17:52.426176 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.426106    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" podStartSLOduration=1.426081268 podStartE2EDuration="1.426081268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:17:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:17:52.423795997 +0000 UTC m=+1596.605568667" watchObservedRunningTime="2026-07-15 19:17:52.426081268 +0000 UTC m=+1596.607853939"
Jul 15 19:17:52.873138 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.873099    2571 patch_prober.go:28] interesting pod/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:17:52.873326 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:52.873162    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:17:53.157640 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:53.157540    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:53.162684 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:53.162656    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:53.399626 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:53.399592    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:53.400452 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:53.400431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:17:56.419729 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.419698    2571 generic.go:356] "Generic (PLEG): container finished" podID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerID="0e548e1469248e49c845285736edb305fae2954dc543a630c84f53c23546a974" exitCode=0
Jul 15 19:17:56.420181 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.419781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" event={"ID":"9a3b8aad-57bb-4438-8eed-43f30fda5ef5","Type":"ContainerDied","Data":"0e548e1469248e49c845285736edb305fae2954dc543a630c84f53c23546a974"}
Jul 15 19:17:56.420181 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.419869    2571 scope.go:117] "RemoveContainer" containerID="241914fb51c7f17f28f50f6f70ac70d642c8ea2a9147f021684d9624de2f02e8"
Jul 15 19:17:56.484295 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.484218    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:17:56.640348 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640274    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-data\") pod \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") "
Jul 15 19:17:56.640539 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640361    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-podinfo\") pod \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") "
Jul 15 19:17:56.640539 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640385    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-envoy\") pod \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") "
Jul 15 19:17:56.640539 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640438    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istiod-ca-cert\") pod \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") "
Jul 15 19:17:56.640539 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640483    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgpz7\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-kube-api-access-dgpz7\") pod \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") "
Jul 15 19:17:56.640756 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640601    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-credential-socket\") pod \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") "
Jul 15 19:17:56.640756 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640635    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-certs\") pod \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") "
Jul 15 19:17:56.640756 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640668    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-token\") pod \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") "
Jul 15 19:17:56.640756 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640706    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-socket\") pod \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\" (UID: \"9a3b8aad-57bb-4438-8eed-43f30fda5ef5\") "
Jul 15 19:17:56.640952 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.640886    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a3b8aad-57bb-4438-8eed-43f30fda5ef5" (UID: "9a3b8aad-57bb-4438-8eed-43f30fda5ef5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:56.641133 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.641103    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a3b8aad-57bb-4438-8eed-43f30fda5ef5" (UID: "9a3b8aad-57bb-4438-8eed-43f30fda5ef5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:17:56.641133 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.641118    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a3b8aad-57bb-4438-8eed-43f30fda5ef5" (UID: "9a3b8aad-57bb-4438-8eed-43f30fda5ef5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:17:56.641133 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.641128    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a3b8aad-57bb-4438-8eed-43f30fda5ef5" (UID: "9a3b8aad-57bb-4438-8eed-43f30fda5ef5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:17:56.641365 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.641135    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:56.641430 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.641055    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a3b8aad-57bb-4438-8eed-43f30fda5ef5" (UID: "9a3b8aad-57bb-4438-8eed-43f30fda5ef5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:17:56.643067 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.643040    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-kube-api-access-dgpz7" (OuterVolumeSpecName: "kube-api-access-dgpz7") pod "9a3b8aad-57bb-4438-8eed-43f30fda5ef5" (UID: "9a3b8aad-57bb-4438-8eed-43f30fda5ef5"). InnerVolumeSpecName "kube-api-access-dgpz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:17:56.643177 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.643146    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a3b8aad-57bb-4438-8eed-43f30fda5ef5" (UID: "9a3b8aad-57bb-4438-8eed-43f30fda5ef5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:17:56.643253 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.643236    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a3b8aad-57bb-4438-8eed-43f30fda5ef5" (UID: "9a3b8aad-57bb-4438-8eed-43f30fda5ef5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:17:56.643324 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.643245    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a3b8aad-57bb-4438-8eed-43f30fda5ef5" (UID: "9a3b8aad-57bb-4438-8eed-43f30fda5ef5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:17:56.741785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.741680    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgpz7\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-kube-api-access-dgpz7\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:56.741785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.741717    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:56.741785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.741734    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:56.741785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.741746    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:56.741785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.741756    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:56.741785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.741768    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:56.741785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.741781    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:56.741785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:56.741792    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a3b8aad-57bb-4438-8eed-43f30fda5ef5-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:17:57.426194 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.426160    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"
Jul 15 19:17:57.426194 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.426180    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq" event={"ID":"9a3b8aad-57bb-4438-8eed-43f30fda5ef5","Type":"ContainerDied","Data":"1dc28aa56dfc09df7c0bfa67a3168c2bbf869746e11151715ffd6178193ee411"}
Jul 15 19:17:57.426772 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.426235    2571 scope.go:117] "RemoveContainer" containerID="0e548e1469248e49c845285736edb305fae2954dc543a630c84f53c23546a974"
Jul 15 19:17:57.449920 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.449518    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"]
Jul 15 19:17:57.459361 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.459327    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ba1e3d30-openshift-default-76d8558c7-pcprq"]
Jul 15 19:17:57.631328 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.631275    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"]
Jul 15 19:17:57.631701 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.631688    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy"
Jul 15 19:17:57.631745 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.631703    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy"
Jul 15 19:17:57.631745 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.631711    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy"
Jul 15 19:17:57.631745 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.631716    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy"
Jul 15 19:17:57.631837 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.631775    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy"
Jul 15 19:17:57.631837 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.631789    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" containerName="istio-proxy"
Jul 15 19:17:57.636450 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.636422    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"
Jul 15 19:17:57.639887 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.639852    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:17:57.639887 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.639876    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:17:57.643869 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.643838    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"]
Jul 15 19:17:57.752204 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.752092    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce143598-f7c8-4b52-907c-2e02018b18f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx\" (UID: \"ce143598-f7c8-4b52-907c-2e02018b18f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"
Jul 15 19:17:57.853491 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.853445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce143598-f7c8-4b52-907c-2e02018b18f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx\" (UID: \"ce143598-f7c8-4b52-907c-2e02018b18f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"
Jul 15 19:17:57.854143 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.854118    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce143598-f7c8-4b52-907c-2e02018b18f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx\" (UID: \"ce143598-f7c8-4b52-907c-2e02018b18f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"
Jul 15 19:17:57.949419 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:57.949374    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"
Jul 15 19:17:58.107801 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:58.107722    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"]
Jul 15 19:17:58.111099 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:17:58.110963    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce143598_f7c8_4b52_907c_2e02018b18f0.slice/crio-ddde48549310816fb31cd41841a3806581977b785078c9e8ae52ff200a1bd4c0 WatchSource:0}: Error finding container ddde48549310816fb31cd41841a3806581977b785078c9e8ae52ff200a1bd4c0: Status 404 returned error can't find the container with id ddde48549310816fb31cd41841a3806581977b785078c9e8ae52ff200a1bd4c0
Jul 15 19:17:58.339222 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:58.339188    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a3b8aad-57bb-4438-8eed-43f30fda5ef5" path="/var/lib/kubelet/pods/9a3b8aad-57bb-4438-8eed-43f30fda5ef5/volumes"
Jul 15 19:17:58.433274 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:58.433228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx" event={"ID":"ce143598-f7c8-4b52-907c-2e02018b18f0","Type":"ContainerStarted","Data":"ddde48549310816fb31cd41841a3806581977b785078c9e8ae52ff200a1bd4c0"}
Jul 15 19:17:59.440648 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:59.440612    2571 generic.go:356] "Generic (PLEG): container finished" podID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerID="452b23aae4eb30674e73a1927c3bac58623cd765fd95cbcb8c3e35451e0619ab" exitCode=7
Jul 15 19:17:59.441047 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:59.440697    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx" event={"ID":"ce143598-f7c8-4b52-907c-2e02018b18f0","Type":"ContainerDied","Data":"452b23aae4eb30674e73a1927c3bac58623cd765fd95cbcb8c3e35451e0619ab"}
Jul 15 19:17:59.441047 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:17:59.440866    2571 scope.go:117] "RemoveContainer" containerID="452b23aae4eb30674e73a1927c3bac58623cd765fd95cbcb8c3e35451e0619ab"
Jul 15 19:18:00.448941 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:00.448908    2571 generic.go:356] "Generic (PLEG): container finished" podID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerID="30b5c113eb0ee026ca3d2dc64cd1ac6627723f54d186a4f57a186d8f3c15ed2b" exitCode=7
Jul 15 19:18:00.449518 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:00.448979    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx" event={"ID":"ce143598-f7c8-4b52-907c-2e02018b18f0","Type":"ContainerDied","Data":"30b5c113eb0ee026ca3d2dc64cd1ac6627723f54d186a4f57a186d8f3c15ed2b"}
Jul 15 19:18:00.449518 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:00.449023    2571 scope.go:117] "RemoveContainer" containerID="452b23aae4eb30674e73a1927c3bac58623cd765fd95cbcb8c3e35451e0619ab"
Jul 15 19:18:00.449518 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:00.449335    2571 scope.go:117] "RemoveContainer" containerID="30b5c113eb0ee026ca3d2dc64cd1ac6627723f54d186a4f57a186d8f3c15ed2b"
Jul 15 19:18:00.449746 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:18:00.449620    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx_odh-ai-gateway-infra(ce143598-f7c8-4b52-907c-2e02018b18f0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0"
Jul 15 19:18:00.498743 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:00.498701    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:18:01.457340 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:01.457312    2571 scope.go:117] "RemoveContainer" containerID="30b5c113eb0ee026ca3d2dc64cd1ac6627723f54d186a4f57a186d8f3c15ed2b"
Jul 15 19:18:01.457716 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:18:01.457590    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx_odh-ai-gateway-infra(ce143598-f7c8-4b52-907c-2e02018b18f0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0"
Jul 15 19:18:08.708515 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:08.707832    2571 patch_prober.go:28] interesting pod/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": read tcp 10.134.0.2:46942->10.134.0.42:15021: read: connection reset by peer" start-of-body=
Jul 15 19:18:08.708515 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:08.707906    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": read tcp 10.134.0.2:46942->10.134.0.42:15021: read: connection reset by peer"
Jul 15 19:18:09.505498 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:09.505460    2571 generic.go:356] "Generic (PLEG): container finished" podID="8683f359-f033-47dc-a0c4-11823b729a52" containerID="457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe" exitCode=0
Jul 15 19:18:09.505680 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:09.505538    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" event={"ID":"8683f359-f033-47dc-a0c4-11823b729a52","Type":"ContainerDied","Data":"457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe"}
Jul 15 19:18:09.505957 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:09.505943    2571 scope.go:117] "RemoveContainer" containerID="457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe"
Jul 15 19:18:09.507074 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:09.507042    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:18:09.507164 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:09.507148    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:18:09.507203 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:09.507189    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:18:10.512541 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:10.512506    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" event={"ID":"8683f359-f033-47dc-a0c4-11823b729a52","Type":"ContainerStarted","Data":"87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced"}
Jul 15 19:18:11.157666 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:11.157619    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:18:11.157885 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:11.157754    2571 patch_prober.go:28] interesting pod/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 15 19:18:11.157885 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:11.157821    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 15 19:18:12.157789 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:12.157738    2571 patch_prober.go:28] interesting pod/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 15 19:18:12.158322 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:12.157814    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 15 19:18:13.158403 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:13.158353    2571 patch_prober.go:28] interesting pod/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 15 19:18:13.158796 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:13.158430    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 15 19:18:14.158169 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:14.158125    2571 patch_prober.go:28] interesting pod/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 15 19:18:14.158414 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:14.158370    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 15 19:18:15.161313 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:15.161260    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:18:15.161764 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:15.161542    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:18:15.162353 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:15.162335    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:18:15.332152 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:15.332122    2571 scope.go:117] "RemoveContainer" containerID="30b5c113eb0ee026ca3d2dc64cd1ac6627723f54d186a4f57a186d8f3c15ed2b"
Jul 15 19:18:16.546743 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:16.546650    2571 generic.go:356] "Generic (PLEG): container finished" podID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerID="27156711ca1af240cf57ed3f95ca61d0707738daf068c1407e86e6ad4512a75a" exitCode=0
Jul 15 19:18:16.546743 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:16.546727    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx" event={"ID":"ce143598-f7c8-4b52-907c-2e02018b18f0","Type":"ContainerDied","Data":"27156711ca1af240cf57ed3f95ca61d0707738daf068c1407e86e6ad4512a75a"}
Jul 15 19:18:16.547239 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:16.546801    2571 scope.go:117] "RemoveContainer" containerID="30b5c113eb0ee026ca3d2dc64cd1ac6627723f54d186a4f57a186d8f3c15ed2b"
Jul 15 19:18:17.579356 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:17.579318    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"]
Jul 15 19:18:17.705014 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:17.704983    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"
Jul 15 19:18:17.763019 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:17.762980    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce143598-f7c8-4b52-907c-2e02018b18f0-maas-api-service-ca\") pod \"ce143598-f7c8-4b52-907c-2e02018b18f0\" (UID: \"ce143598-f7c8-4b52-907c-2e02018b18f0\") "
Jul 15 19:18:17.763302 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:17.763262    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce143598-f7c8-4b52-907c-2e02018b18f0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce143598-f7c8-4b52-907c-2e02018b18f0" (UID: "ce143598-f7c8-4b52-907c-2e02018b18f0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:18:17.863657 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:17.863621    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce143598-f7c8-4b52-907c-2e02018b18f0-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:18:18.561060 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:18.561026    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"
Jul 15 19:18:18.561254 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:18.561054    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx" event={"ID":"ce143598-f7c8-4b52-907c-2e02018b18f0","Type":"ContainerDied","Data":"ddde48549310816fb31cd41841a3806581977b785078c9e8ae52ff200a1bd4c0"}
Jul 15 19:18:18.561254 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:18.561117    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddde48549310816fb31cd41841a3806581977b785078c9e8ae52ff200a1bd4c0"
Jul 15 19:18:18.592772 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:18.592725    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"]
Jul 15 19:18:18.594494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:18.594471    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-dq2zx"]
Jul 15 19:18:20.338667 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:20.338633    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" path="/var/lib/kubelet/pods/ce143598-f7c8-4b52-907c-2e02018b18f0/volumes"
Jul 15 19:18:57.691298 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.691258    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"]
Jul 15 19:18:57.691706 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.691645    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerName="revoke-keys"
Jul 15 19:18:57.691706 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.691656    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerName="revoke-keys"
Jul 15 19:18:57.691706 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.691676    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerName="revoke-keys"
Jul 15 19:18:57.691706 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.691681    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerName="revoke-keys"
Jul 15 19:18:57.691840 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.691739    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerName="revoke-keys"
Jul 15 19:18:57.691840 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.691747    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerName="revoke-keys"
Jul 15 19:18:57.693804 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.693788    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"
Jul 15 19:18:57.696879 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.696860    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:18:57.696967 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.696950    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:18:57.703636 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.703612    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"]
Jul 15 19:18:57.725558 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.725510    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1881091-dd2d-47f7-88e7-c7aeaea49001-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb\" (UID: \"e1881091-dd2d-47f7-88e7-c7aeaea49001\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"
Jul 15 19:18:57.749311 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.749262    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"]
Jul 15 19:18:57.749550 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.749523    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy" containerID="cri-o://87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced" gracePeriod=30
Jul 15 19:18:57.826732 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.826696    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1881091-dd2d-47f7-88e7-c7aeaea49001-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb\" (UID: \"e1881091-dd2d-47f7-88e7-c7aeaea49001\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"
Jul 15 19:18:57.827410 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:57.827386    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1881091-dd2d-47f7-88e7-c7aeaea49001-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb\" (UID: \"e1881091-dd2d-47f7-88e7-c7aeaea49001\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"
Jul 15 19:18:58.005056 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:58.004976    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"
Jul 15 19:18:58.134953 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:58.134926    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"]
Jul 15 19:18:58.136514 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:18:58.136482    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1881091_dd2d_47f7_88e7_c7aeaea49001.slice/crio-306875edf7ea3507f289456d91fc96802f5a7e694df44d824f518aaeafcfb1aa WatchSource:0}: Error finding container 306875edf7ea3507f289456d91fc96802f5a7e694df44d824f518aaeafcfb1aa: Status 404 returned error can't find the container with id 306875edf7ea3507f289456d91fc96802f5a7e694df44d824f518aaeafcfb1aa
Jul 15 19:18:58.767363 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:58.767239    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb" event={"ID":"e1881091-dd2d-47f7-88e7-c7aeaea49001","Type":"ContainerStarted","Data":"088417af96e788315aec51243e1ad9226d6be67a19a4a30eaff3be97bb6820ba"}
Jul 15 19:18:58.767363 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:58.767319    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb" event={"ID":"e1881091-dd2d-47f7-88e7-c7aeaea49001","Type":"ContainerStarted","Data":"306875edf7ea3507f289456d91fc96802f5a7e694df44d824f518aaeafcfb1aa"}
Jul 15 19:18:58.784530 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:58.784476    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb" podStartSLOduration=1.784457666 podStartE2EDuration="1.784457666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:18:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:18:58.783720235 +0000 UTC m=+1662.965492907" watchObservedRunningTime="2026-07-15 19:18:58.784457666 +0000 UTC m=+1662.966230395"
Jul 15 19:18:59.773383 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:59.773342    2571 generic.go:356] "Generic (PLEG): container finished" podID="e1881091-dd2d-47f7-88e7-c7aeaea49001" containerID="088417af96e788315aec51243e1ad9226d6be67a19a4a30eaff3be97bb6820ba" exitCode=0
Jul 15 19:18:59.773785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:18:59.773420    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb" event={"ID":"e1881091-dd2d-47f7-88e7-c7aeaea49001","Type":"ContainerDied","Data":"088417af96e788315aec51243e1ad9226d6be67a19a4a30eaff3be97bb6820ba"}
Jul 15 19:19:00.164027 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:00.163989    2571 patch_prober.go:28] interesting pod/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:19:00.164207 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:00.164060    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:19:00.914744 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:00.914721    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"
Jul 15 19:19:00.955742 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:00.955708    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1881091-dd2d-47f7-88e7-c7aeaea49001-maas-api-service-ca\") pod \"e1881091-dd2d-47f7-88e7-c7aeaea49001\" (UID: \"e1881091-dd2d-47f7-88e7-c7aeaea49001\") "
Jul 15 19:19:00.956103 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:00.956079    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1881091-dd2d-47f7-88e7-c7aeaea49001-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e1881091-dd2d-47f7-88e7-c7aeaea49001" (UID: "e1881091-dd2d-47f7-88e7-c7aeaea49001"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:19:01.057031 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:01.056952    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1881091-dd2d-47f7-88e7-c7aeaea49001-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:01.096300 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:01.096253    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:19:01.785275 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:01.785244    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb"
Jul 15 19:19:01.785513 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:01.785301    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb" event={"ID":"e1881091-dd2d-47f7-88e7-c7aeaea49001","Type":"ContainerDied","Data":"306875edf7ea3507f289456d91fc96802f5a7e694df44d824f518aaeafcfb1aa"}
Jul 15 19:19:01.785513 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:01.785355    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="306875edf7ea3507f289456d91fc96802f5a7e694df44d824f518aaeafcfb1aa"
Jul 15 19:19:03.006835 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.006809    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:19:03.077855 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.077819    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxx6s\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-kube-api-access-wxx6s\") pod \"8683f359-f033-47dc-a0c4-11823b729a52\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") "
Jul 15 19:19:03.078014 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.077872    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-socket\") pod \"8683f359-f033-47dc-a0c4-11823b729a52\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") "
Jul 15 19:19:03.078014 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.077937    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-certs\") pod \"8683f359-f033-47dc-a0c4-11823b729a52\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") "
Jul 15 19:19:03.078014 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.077952    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-credential-socket\") pod \"8683f359-f033-47dc-a0c4-11823b729a52\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") "
Jul 15 19:19:03.078014 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.077969    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-istio-token\") pod \"8683f359-f033-47dc-a0c4-11823b729a52\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") "
Jul 15 19:19:03.078238 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078037    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8683f359-f033-47dc-a0c4-11823b729a52-istio-podinfo\") pod \"8683f359-f033-47dc-a0c4-11823b729a52\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") "
Jul 15 19:19:03.078238 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078075    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8683f359-f033-47dc-a0c4-11823b729a52-istiod-ca-cert\") pod \"8683f359-f033-47dc-a0c4-11823b729a52\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") "
Jul 15 19:19:03.078238 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078099    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-data\") pod \"8683f359-f033-47dc-a0c4-11823b729a52\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") "
Jul 15 19:19:03.078238 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078122    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-envoy\") pod \"8683f359-f033-47dc-a0c4-11823b729a52\" (UID: \"8683f359-f033-47dc-a0c4-11823b729a52\") "
Jul 15 19:19:03.078508 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078254    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8683f359-f033-47dc-a0c4-11823b729a52" (UID: "8683f359-f033-47dc-a0c4-11823b729a52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:19:03.078508 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078299    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8683f359-f033-47dc-a0c4-11823b729a52" (UID: "8683f359-f033-47dc-a0c4-11823b729a52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:19:03.078508 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078324    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8683f359-f033-47dc-a0c4-11823b729a52" (UID: "8683f359-f033-47dc-a0c4-11823b729a52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:19:03.078669 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078518    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.078669 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078539    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.078669 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.078553    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.079143 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.079099    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-data" (OuterVolumeSpecName: "istio-data") pod "8683f359-f033-47dc-a0c4-11823b729a52" (UID: "8683f359-f033-47dc-a0c4-11823b729a52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:19:03.079327 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.079172    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8683f359-f033-47dc-a0c4-11823b729a52-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8683f359-f033-47dc-a0c4-11823b729a52" (UID: "8683f359-f033-47dc-a0c4-11823b729a52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:19:03.081473 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.081437    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8683f359-f033-47dc-a0c4-11823b729a52" (UID: "8683f359-f033-47dc-a0c4-11823b729a52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:19:03.081473 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.081453    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-istio-token" (OuterVolumeSpecName: "istio-token") pod "8683f359-f033-47dc-a0c4-11823b729a52" (UID: "8683f359-f033-47dc-a0c4-11823b729a52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:19:03.083316 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.083260    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-kube-api-access-wxx6s" (OuterVolumeSpecName: "kube-api-access-wxx6s") pod "8683f359-f033-47dc-a0c4-11823b729a52" (UID: "8683f359-f033-47dc-a0c4-11823b729a52"). InnerVolumeSpecName "kube-api-access-wxx6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:19:03.083428 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.083369    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8683f359-f033-47dc-a0c4-11823b729a52-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8683f359-f033-47dc-a0c4-11823b729a52" (UID: "8683f359-f033-47dc-a0c4-11823b729a52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:19:03.179648 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.179605    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8683f359-f033-47dc-a0c4-11823b729a52-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.179648 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.179639    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8683f359-f033-47dc-a0c4-11823b729a52-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.179648 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.179649    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.179648 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.179657    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8683f359-f033-47dc-a0c4-11823b729a52-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.179914 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.179666    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxx6s\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-kube-api-access-wxx6s\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.179914 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.179675    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8683f359-f033-47dc-a0c4-11823b729a52-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.796684 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.796644    2571 generic.go:356] "Generic (PLEG): container finished" podID="8683f359-f033-47dc-a0c4-11823b729a52" containerID="87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced" exitCode=0
Jul 15 19:19:03.796832 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.796689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" event={"ID":"8683f359-f033-47dc-a0c4-11823b729a52","Type":"ContainerDied","Data":"87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced"}
Jul 15 19:19:03.796832 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.796705    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"
Jul 15 19:19:03.796832 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.796739    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6" event={"ID":"8683f359-f033-47dc-a0c4-11823b729a52","Type":"ContainerDied","Data":"2598f7b471ab17c74211cfdb3decd044ec447267ec31cda677c95d8f3cfc77cc"}
Jul 15 19:19:03.796832 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.796765    2571 scope.go:117] "RemoveContainer" containerID="87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced"
Jul 15 19:19:03.806800 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.806778    2571 scope.go:117] "RemoveContainer" containerID="457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe"
Jul 15 19:19:03.815206 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.815182    2571 scope.go:117] "RemoveContainer" containerID="87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced"
Jul 15 19:19:03.815513 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:19:03.815490    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced\": container with ID starting with 87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced not found: ID does not exist" containerID="87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced"
Jul 15 19:19:03.815555 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.815524    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced"} err="failed to get container status \"87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced\": rpc error: code = NotFound desc = could not find container \"87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced\": container with ID starting with 87c76ab6c71b470a5e2a45470e0ed9ca7a3ac8e74fcd0d0f0d79949bb3c48ced not found: ID does not exist"
Jul 15 19:19:03.815555 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.815543    2571 scope.go:117] "RemoveContainer" containerID="457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe"
Jul 15 19:19:03.815813 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:19:03.815794    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe\": container with ID starting with 457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe not found: ID does not exist" containerID="457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe"
Jul 15 19:19:03.815872 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.815819    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe"} err="failed to get container status \"457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe\": rpc error: code = NotFound desc = could not find container \"457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe\": container with ID starting with 457e39292a257dcb5dd565965f364ced82eedd5702e5f7814a38e17295b070fe not found: ID does not exist"
Jul 15 19:19:03.821729 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.821700    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"]
Jul 15 19:19:03.827317 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:03.827272    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9df5bb53-gw-openshift-default-869b575695-r2nx6"]
Jul 15 19:19:04.339201 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:04.339154    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8683f359-f033-47dc-a0c4-11823b729a52" path="/var/lib/kubelet/pods/8683f359-f033-47dc-a0c4-11823b729a52/volumes"
Jul 15 19:19:09.780045 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780009    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"]
Jul 15 19:19:09.780647 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780625    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1881091-dd2d-47f7-88e7-c7aeaea49001" containerName="revoke-keys"
Jul 15 19:19:09.780695 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780652    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1881091-dd2d-47f7-88e7-c7aeaea49001" containerName="revoke-keys"
Jul 15 19:19:09.780695 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780676    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy"
Jul 15 19:19:09.780695 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780685    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy"
Jul 15 19:19:09.780793 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780700    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy"
Jul 15 19:19:09.780793 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780709    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy"
Jul 15 19:19:09.780793 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780724    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerName="revoke-keys"
Jul 15 19:19:09.780793 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780733    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerName="revoke-keys"
Jul 15 19:19:09.780915 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780849    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy"
Jul 15 19:19:09.780915 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780867    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1881091-dd2d-47f7-88e7-c7aeaea49001" containerName="revoke-keys"
Jul 15 19:19:09.780915 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780876    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8683f359-f033-47dc-a0c4-11823b729a52" containerName="istio-proxy"
Jul 15 19:19:09.780915 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.780886    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce143598-f7c8-4b52-907c-2e02018b18f0" containerName="revoke-keys"
Jul 15 19:19:09.784646 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.784614    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.788553 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.788529    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-109e9634-openshift-default-dockercfg-j4rcc\""
Jul 15 19:19:09.803910 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.803873    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"]
Jul 15 19:19:09.842271 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.842236    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-data\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.842474 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.842273    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl4qx\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-kube-api-access-dl4qx\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.842474 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.842338    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-credential-socket\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.842474 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.842374    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-token\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.842653 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.842465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-envoy\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.842653 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.842520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa2ce16d-7749-4335-b431-a3c6b77e2725-istiod-ca-cert\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.842653 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.842574    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-socket\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.842653 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.842605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-certs\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.842811 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.842668    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-podinfo\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943170 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943132    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-token\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943395 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-envoy\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943395 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa2ce16d-7749-4335-b431-a3c6b77e2725-istiod-ca-cert\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943395 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943240    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-socket\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943395 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943256    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-certs\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943395 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943314    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-podinfo\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943395 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943352    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-data\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943395 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943382    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl4qx\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-kube-api-access-dl4qx\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943804 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943410    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-credential-socket\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943804 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943672    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-certs\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943804 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-socket\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.943984 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943960    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-credential-socket\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.944172 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.943988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-data\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.944241 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.944022    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa2ce16d-7749-4335-b431-a3c6b77e2725-istiod-ca-cert\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.945660 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.945635    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-envoy\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.945948 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.945929    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-podinfo\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.952795 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.952769    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-token\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:09.953727 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:09.953706    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl4qx\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-kube-api-access-dl4qx\") pod \"e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") " pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:10.095400 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:10.095370    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:10.237131 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:10.237103    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"]
Jul 15 19:19:10.239037 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:19:10.239011    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2ce16d_7749_4335_b431_a3c6b77e2725.slice/crio-a1038893446e725f7b590a365b15c090d7b4618d46b016b1a9fe330b75876e6c WatchSource:0}: Error finding container a1038893446e725f7b590a365b15c090d7b4618d46b016b1a9fe330b75876e6c: Status 404 returned error can't find the container with id a1038893446e725f7b590a365b15c090d7b4618d46b016b1a9fe330b75876e6c
Jul 15 19:19:10.241375 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:10.241331    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:19:10.241475 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:10.241409    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:19:10.241475 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:10.241438    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:19:10.836785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:10.836746    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" event={"ID":"fa2ce16d-7749-4335-b431-a3c6b77e2725","Type":"ContainerStarted","Data":"14cc93468341b5f22409751c07d2556a322af14b58de00b3491f167aa95f9402"}
Jul 15 19:19:10.837190 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:10.836802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" event={"ID":"fa2ce16d-7749-4335-b431-a3c6b77e2725","Type":"ContainerStarted","Data":"a1038893446e725f7b590a365b15c090d7b4618d46b016b1a9fe330b75876e6c"}
Jul 15 19:19:10.859212 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:10.859158    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" podStartSLOduration=1.859140106 podStartE2EDuration="1.859140106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:10.857240612 +0000 UTC m=+1675.039013283" watchObservedRunningTime="2026-07-15 19:19:10.859140106 +0000 UTC m=+1675.040912843"
Jul 15 19:19:11.096052 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:11.095958    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:11.097860 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:11.097812    2571 patch_prober.go:28] interesting pod/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 15 19:19:11.098010 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:11.097877    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 15 19:19:12.099406 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:12.099379    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:12.847678 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:12.847646    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:12.848698 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:12.848679    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:16.087612 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.087567    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"]
Jul 15 19:19:16.090338 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.090320    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"
Jul 15 19:19:16.093436 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.093389    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:19:16.093596 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.093518    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:19:16.104761 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.104735    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"]
Jul 15 19:19:16.202069 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.202034    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a213f3d5-a3e7-4c72-bb71-1da5076303a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-109e9634-kprm5\" (UID: \"a213f3d5-a3e7-4c72-bb71-1da5076303a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"
Jul 15 19:19:16.303090 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.303041    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a213f3d5-a3e7-4c72-bb71-1da5076303a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-109e9634-kprm5\" (UID: \"a213f3d5-a3e7-4c72-bb71-1da5076303a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"
Jul 15 19:19:16.307716 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.307690    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:19:16.314440 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.314417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a213f3d5-a3e7-4c72-bb71-1da5076303a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-109e9634-kprm5\" (UID: \"a213f3d5-a3e7-4c72-bb71-1da5076303a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"
Jul 15 19:19:16.404586 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.404557    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:19:16.412340 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.412310    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"
Jul 15 19:19:16.556941 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.556860    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"]
Jul 15 19:19:16.559349 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:19:16.559320    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda213f3d5_a3e7_4c72_bb71_1da5076303a3.slice/crio-6bff7c19c04ff8ef45f08281851875192c18a572eb1b1abb7074c960140011f2 WatchSource:0}: Error finding container 6bff7c19c04ff8ef45f08281851875192c18a572eb1b1abb7074c960140011f2: Status 404 returned error can't find the container with id 6bff7c19c04ff8ef45f08281851875192c18a572eb1b1abb7074c960140011f2
Jul 15 19:19:16.868534 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.868496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" event={"ID":"a213f3d5-a3e7-4c72-bb71-1da5076303a3","Type":"ContainerStarted","Data":"39e3310eb71dd27e7964fff2b1396bd4435b967644f4b81cdf1430ad50acece5"}
Jul 15 19:19:16.868707 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.868554    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" event={"ID":"a213f3d5-a3e7-4c72-bb71-1da5076303a3","Type":"ContainerStarted","Data":"6bff7c19c04ff8ef45f08281851875192c18a572eb1b1abb7074c960140011f2"}
Jul 15 19:19:16.901239 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:16.901169    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" podStartSLOduration=0.901149591 podStartE2EDuration="901.149591ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:16.900352514 +0000 UTC m=+1681.082125184" watchObservedRunningTime="2026-07-15 19:19:16.901149591 +0000 UTC m=+1681.082922261"
Jul 15 19:19:17.875859 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:17.875822    2571 generic.go:356] "Generic (PLEG): container finished" podID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerID="39e3310eb71dd27e7964fff2b1396bd4435b967644f4b81cdf1430ad50acece5" exitCode=7
Jul 15 19:19:17.876293 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:17.875914    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" event={"ID":"a213f3d5-a3e7-4c72-bb71-1da5076303a3","Type":"ContainerDied","Data":"39e3310eb71dd27e7964fff2b1396bd4435b967644f4b81cdf1430ad50acece5"}
Jul 15 19:19:17.876293 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:17.876083    2571 scope.go:117] "RemoveContainer" containerID="39e3310eb71dd27e7964fff2b1396bd4435b967644f4b81cdf1430ad50acece5"
Jul 15 19:19:18.884786 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:18.884750    2571 generic.go:356] "Generic (PLEG): container finished" podID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerID="79de15c2a6a031cdb3c9d6c0755e5447c97212c995df2963663664f35d68cc16" exitCode=7
Jul 15 19:19:18.885328 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:18.884834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" event={"ID":"a213f3d5-a3e7-4c72-bb71-1da5076303a3","Type":"ContainerDied","Data":"79de15c2a6a031cdb3c9d6c0755e5447c97212c995df2963663664f35d68cc16"}
Jul 15 19:19:18.885328 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:18.884907    2571 scope.go:117] "RemoveContainer" containerID="39e3310eb71dd27e7964fff2b1396bd4435b967644f4b81cdf1430ad50acece5"
Jul 15 19:19:18.885328 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:18.885121    2571 scope.go:117] "RemoveContainer" containerID="79de15c2a6a031cdb3c9d6c0755e5447c97212c995df2963663664f35d68cc16"
Jul 15 19:19:18.885466 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:19:18.885372    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-109e9634-kprm5_odh-ai-gateway-infra(a213f3d5-a3e7-4c72-bb71-1da5076303a3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3"
Jul 15 19:19:19.607401 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:19.607365    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:19:19.891964 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:19.891876    2571 scope.go:117] "RemoveContainer" containerID="79de15c2a6a031cdb3c9d6c0755e5447c97212c995df2963663664f35d68cc16"
Jul 15 19:19:19.892370 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:19:19.892108    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-109e9634-kprm5_odh-ai-gateway-infra(a213f3d5-a3e7-4c72-bb71-1da5076303a3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3"
Jul 15 19:19:27.849462 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:27.849422    2571 patch_prober.go:28] interesting pod/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 15 19:19:27.849889 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:27.849501    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 15 19:19:27.936857 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:27.936763    2571 generic.go:356] "Generic (PLEG): container finished" podID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerID="14cc93468341b5f22409751c07d2556a322af14b58de00b3491f167aa95f9402" exitCode=0
Jul 15 19:19:27.936857 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:27.936838    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" event={"ID":"fa2ce16d-7749-4335-b431-a3c6b77e2725","Type":"ContainerDied","Data":"14cc93468341b5f22409751c07d2556a322af14b58de00b3491f167aa95f9402"}
Jul 15 19:19:27.937329 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:27.937311    2571 scope.go:117] "RemoveContainer" containerID="14cc93468341b5f22409751c07d2556a322af14b58de00b3491f167aa95f9402"
Jul 15 19:19:27.938340 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:27.938309    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:19:27.938448 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:27.938392    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:19:27.938448 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:27.938429    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:19:28.944987 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:28.944944    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" event={"ID":"fa2ce16d-7749-4335-b431-a3c6b77e2725","Type":"ContainerStarted","Data":"65b4c497d7226d9f7ed11f6c9aa8244d2ae9567b55ac33575c06d14ad8cbaf47"}
Jul 15 19:19:29.095988 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:29.095947    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:29.096173 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:29.096149    2571 patch_prober.go:28] interesting pod/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 15 19:19:29.096222 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:29.096197    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 15 19:19:30.096381 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:30.096345    2571 patch_prober.go:28] interesting pod/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 15 19:19:30.096813 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:30.096400    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 15 19:19:31.095670 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:31.095633    2571 patch_prober.go:28] interesting pod/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 15 19:19:31.095843 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:31.095690    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 15 19:19:32.096499 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:32.096458    2571 patch_prober.go:28] interesting pod/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 15 19:19:32.096882 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:32.096529    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 15 19:19:33.096125 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:33.096090    2571 patch_prober.go:28] interesting pod/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 15 19:19:33.096317 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:33.096146    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 15 19:19:33.332901 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:33.332868    2571 scope.go:117] "RemoveContainer" containerID="79de15c2a6a031cdb3c9d6c0755e5447c97212c995df2963663664f35d68cc16"
Jul 15 19:19:33.978905 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:33.978869    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" event={"ID":"a213f3d5-a3e7-4c72-bb71-1da5076303a3","Type":"ContainerStarted","Data":"92be4c20be3c4f4a44bcce7d391716782bdfffb019e1ffcdc0562d5d2332b40c"}
Jul 15 19:19:34.099666 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:34.099628    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:34.099990 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:34.099971    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:34.100768 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:34.100750    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:19:34.986364 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:34.986328    2571 generic.go:356] "Generic (PLEG): container finished" podID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerID="92be4c20be3c4f4a44bcce7d391716782bdfffb019e1ffcdc0562d5d2332b40c" exitCode=0
Jul 15 19:19:34.986842 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:34.986401    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" event={"ID":"a213f3d5-a3e7-4c72-bb71-1da5076303a3","Type":"ContainerDied","Data":"92be4c20be3c4f4a44bcce7d391716782bdfffb019e1ffcdc0562d5d2332b40c"}
Jul 15 19:19:34.986842 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:34.986463    2571 scope.go:117] "RemoveContainer" containerID="79de15c2a6a031cdb3c9d6c0755e5447c97212c995df2963663664f35d68cc16"
Jul 15 19:19:35.020741 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:35.020705    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"]
Jul 15 19:19:36.131132 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:36.131106    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"
Jul 15 19:19:36.213545 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:36.213509    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a213f3d5-a3e7-4c72-bb71-1da5076303a3-maas-api-service-ca\") pod \"a213f3d5-a3e7-4c72-bb71-1da5076303a3\" (UID: \"a213f3d5-a3e7-4c72-bb71-1da5076303a3\") "
Jul 15 19:19:36.213873 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:36.213851    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a213f3d5-a3e7-4c72-bb71-1da5076303a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a213f3d5-a3e7-4c72-bb71-1da5076303a3" (UID: "a213f3d5-a3e7-4c72-bb71-1da5076303a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:19:36.314826 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:36.314735    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a213f3d5-a3e7-4c72-bb71-1da5076303a3-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:19:36.999785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:36.999754    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"
Jul 15 19:19:36.999991 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:36.999757    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5" event={"ID":"a213f3d5-a3e7-4c72-bb71-1da5076303a3","Type":"ContainerDied","Data":"6bff7c19c04ff8ef45f08281851875192c18a572eb1b1abb7074c960140011f2"}
Jul 15 19:19:36.999991 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:36.999870    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bff7c19c04ff8ef45f08281851875192c18a572eb1b1abb7074c960140011f2"
Jul 15 19:19:37.041680 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:37.041648    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"]
Jul 15 19:19:37.044783 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:37.044756    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-kprm5"]
Jul 15 19:19:38.341641 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:19:38.339933    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" path="/var/lib/kubelet/pods/a213f3d5-a3e7-4c72-bb71-1da5076303a3/volumes"
Jul 15 19:20:16.163683 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.163646    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"]
Jul 15 19:20:16.164161 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.164064    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerName="revoke-keys"
Jul 15 19:20:16.164161 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.164078    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerName="revoke-keys"
Jul 15 19:20:16.164161 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.164093    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerName="revoke-keys"
Jul 15 19:20:16.164161 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.164098    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerName="revoke-keys"
Jul 15 19:20:16.164161 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.164159    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerName="revoke-keys"
Jul 15 19:20:16.164356 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.164171    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerName="revoke-keys"
Jul 15 19:20:16.166693 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.166676    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"
Jul 15 19:20:16.170416 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.170392    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:20:16.170585 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.170563    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:20:16.239397 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.239361    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"]
Jul 15 19:20:16.301501 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.301468    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc1514e-94ce-4e2a-b5e5-8ff79649b9db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-109e9634-s4sxp\" (UID: \"0fc1514e-94ce-4e2a-b5e5-8ff79649b9db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"
Jul 15 19:20:16.401950 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.401913    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc1514e-94ce-4e2a-b5e5-8ff79649b9db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-109e9634-s4sxp\" (UID: \"0fc1514e-94ce-4e2a-b5e5-8ff79649b9db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"
Jul 15 19:20:16.402573 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.402547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc1514e-94ce-4e2a-b5e5-8ff79649b9db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-109e9634-s4sxp\" (UID: \"0fc1514e-94ce-4e2a-b5e5-8ff79649b9db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"
Jul 15 19:20:16.478011 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.477922    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"
Jul 15 19:20:16.616936 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:16.616902    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"]
Jul 15 19:20:16.618699 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:20:16.618662    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc1514e_94ce_4e2a_b5e5_8ff79649b9db.slice/crio-3fe15edb17a8c381e2a2c688e18fa276761c84c26f7962c9a4198555eb570a66 WatchSource:0}: Error finding container 3fe15edb17a8c381e2a2c688e18fa276761c84c26f7962c9a4198555eb570a66: Status 404 returned error can't find the container with id 3fe15edb17a8c381e2a2c688e18fa276761c84c26f7962c9a4198555eb570a66
Jul 15 19:20:17.209412 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:17.209315    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp" event={"ID":"0fc1514e-94ce-4e2a-b5e5-8ff79649b9db","Type":"ContainerStarted","Data":"8f30769238a90c30a46385ff09a7b2bc6167fe1badf65c85ed6e952eeabad562"}
Jul 15 19:20:17.209412 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:17.209377    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp" event={"ID":"0fc1514e-94ce-4e2a-b5e5-8ff79649b9db","Type":"ContainerStarted","Data":"3fe15edb17a8c381e2a2c688e18fa276761c84c26f7962c9a4198555eb570a66"}
Jul 15 19:20:17.228872 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:17.228819    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp" podStartSLOduration=1.22880476 podStartE2EDuration="1.22880476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:20:17.226347925 +0000 UTC m=+1741.408120591" watchObservedRunningTime="2026-07-15 19:20:17.22880476 +0000 UTC m=+1741.410577430"
Jul 15 19:20:18.216593 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:18.216556    2571 generic.go:356] "Generic (PLEG): container finished" podID="0fc1514e-94ce-4e2a-b5e5-8ff79649b9db" containerID="8f30769238a90c30a46385ff09a7b2bc6167fe1badf65c85ed6e952eeabad562" exitCode=0
Jul 15 19:20:18.217002 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:18.216606    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp" event={"ID":"0fc1514e-94ce-4e2a-b5e5-8ff79649b9db","Type":"ContainerDied","Data":"8f30769238a90c30a46385ff09a7b2bc6167fe1badf65c85ed6e952eeabad562"}
Jul 15 19:20:19.358602 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:19.358567    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"
Jul 15 19:20:19.433373 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:19.433332    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc1514e-94ce-4e2a-b5e5-8ff79649b9db-maas-api-service-ca\") pod \"0fc1514e-94ce-4e2a-b5e5-8ff79649b9db\" (UID: \"0fc1514e-94ce-4e2a-b5e5-8ff79649b9db\") "
Jul 15 19:20:19.433727 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:19.433701    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fc1514e-94ce-4e2a-b5e5-8ff79649b9db-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0fc1514e-94ce-4e2a-b5e5-8ff79649b9db" (UID: "0fc1514e-94ce-4e2a-b5e5-8ff79649b9db"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:20:19.534371 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:19.534247    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fc1514e-94ce-4e2a-b5e5-8ff79649b9db-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:20.240371 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:20.240322    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp" event={"ID":"0fc1514e-94ce-4e2a-b5e5-8ff79649b9db","Type":"ContainerDied","Data":"3fe15edb17a8c381e2a2c688e18fa276761c84c26f7962c9a4198555eb570a66"}
Jul 15 19:20:20.240584 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:20.240428    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fe15edb17a8c381e2a2c688e18fa276761c84c26f7962c9a4198555eb570a66"
Jul 15 19:20:20.240584 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:20.240498    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-109e9634-s4sxp"
Jul 15 19:20:29.794345 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:29.794308    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:20:42.258202 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.258159    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"]
Jul 15 19:20:42.258750 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.258404    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy" containerID="cri-o://65b4c497d7226d9f7ed11f6c9aa8244d2ae9567b55ac33575c06d14ad8cbaf47" gracePeriod=30
Jul 15 19:20:42.573003 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.572964    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"]
Jul 15 19:20:42.573579 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.573557    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc1514e-94ce-4e2a-b5e5-8ff79649b9db" containerName="revoke-keys"
Jul 15 19:20:42.573579 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.573580    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc1514e-94ce-4e2a-b5e5-8ff79649b9db" containerName="revoke-keys"
Jul 15 19:20:42.573752 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.573610    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerName="revoke-keys"
Jul 15 19:20:42.573752 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.573618    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerName="revoke-keys"
Jul 15 19:20:42.573752 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.573735    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a213f3d5-a3e7-4c72-bb71-1da5076303a3" containerName="revoke-keys"
Jul 15 19:20:42.573752 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.573751    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fc1514e-94ce-4e2a-b5e5-8ff79649b9db" containerName="revoke-keys"
Jul 15 19:20:42.577313 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.577272    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.580317 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.580276    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b5322848-openshift-default-dockercfg-92k9n\""
Jul 15 19:20:42.594090 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.594055    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"]
Jul 15 19:20:42.654508 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.654463    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c78d00c8-0627-4f12-bc07-39b8da39e407-istiod-ca-cert\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.654508 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.654513    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-envoy\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.654788 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.654529    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-data\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.654788 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.654637    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-token\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.654788 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.654678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-credential-socket\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.654788 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.654720    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th78l\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-kube-api-access-th78l\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.654788 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.654770    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-certs\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.655022 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.654833    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-podinfo\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.655022 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.654861    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-socket\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755396 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755354    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-certs\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755604 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755418    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-podinfo\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755604 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-socket\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755604 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755471    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c78d00c8-0627-4f12-bc07-39b8da39e407-istiod-ca-cert\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755604 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755506    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-envoy\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755604 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755528    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-data\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755604 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-token\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755935 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-credential-socket\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755935 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th78l\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-kube-api-access-th78l\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755935 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755813    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-certs\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.755935 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-socket\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.756213 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.755992    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-data\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.756213 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.756132    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-credential-socket\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.756356 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.756256    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c78d00c8-0627-4f12-bc07-39b8da39e407-istiod-ca-cert\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.757933 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.757903    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-envoy\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.758190 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.758170    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-podinfo\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.764476 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.764449    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-token\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.764584 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.764570    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th78l\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-kube-api-access-th78l\") pod \"e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") " pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:42.888266 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:42.888166    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:43.034965 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:43.034906    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"]
Jul 15 19:20:43.038408 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:20:43.038374    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78d00c8_0627_4f12_bc07_39b8da39e407.slice/crio-e30c89fca4ff03bc8f4294e07bf8acb0f713c7c26909863fdda26736ad5b7ff7 WatchSource:0}: Error finding container e30c89fca4ff03bc8f4294e07bf8acb0f713c7c26909863fdda26736ad5b7ff7: Status 404 returned error can't find the container with id e30c89fca4ff03bc8f4294e07bf8acb0f713c7c26909863fdda26736ad5b7ff7
Jul 15 19:20:43.040740 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:43.040698    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:20:43.040814 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:43.040790    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:20:43.040852 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:43.040838    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:20:43.365658 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:43.365619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" event={"ID":"c78d00c8-0627-4f12-bc07-39b8da39e407","Type":"ContainerStarted","Data":"a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2"}
Jul 15 19:20:43.366055 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:43.365677    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" event={"ID":"c78d00c8-0627-4f12-bc07-39b8da39e407","Type":"ContainerStarted","Data":"e30c89fca4ff03bc8f4294e07bf8acb0f713c7c26909863fdda26736ad5b7ff7"}
Jul 15 19:20:43.388213 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:43.388153    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" podStartSLOduration=1.388137008 podStartE2EDuration="1.388137008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:20:43.387121818 +0000 UTC m=+1767.568894488" watchObservedRunningTime="2026-07-15 19:20:43.388137008 +0000 UTC m=+1767.569909677"
Jul 15 19:20:43.888847 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:43.888810    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:44.893616 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:44.893579    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:45.377579 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:45.377540    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:45.378450 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:45.378431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:20:47.389473 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.389436    2571 generic.go:356] "Generic (PLEG): container finished" podID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerID="65b4c497d7226d9f7ed11f6c9aa8244d2ae9567b55ac33575c06d14ad8cbaf47" exitCode=0
Jul 15 19:20:47.389867 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.389499    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" event={"ID":"fa2ce16d-7749-4335-b431-a3c6b77e2725","Type":"ContainerDied","Data":"65b4c497d7226d9f7ed11f6c9aa8244d2ae9567b55ac33575c06d14ad8cbaf47"}
Jul 15 19:20:47.389867 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.389586    2571 scope.go:117] "RemoveContainer" containerID="14cc93468341b5f22409751c07d2556a322af14b58de00b3491f167aa95f9402"
Jul 15 19:20:47.509471 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.509447    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:20:47.594595 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.594561    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl4qx\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-kube-api-access-dl4qx\") pod \"fa2ce16d-7749-4335-b431-a3c6b77e2725\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") "
Jul 15 19:20:47.594780 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.594628    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-envoy\") pod \"fa2ce16d-7749-4335-b431-a3c6b77e2725\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") "
Jul 15 19:20:47.594780 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.594660    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa2ce16d-7749-4335-b431-a3c6b77e2725-istiod-ca-cert\") pod \"fa2ce16d-7749-4335-b431-a3c6b77e2725\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") "
Jul 15 19:20:47.594780 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.594702    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-socket\") pod \"fa2ce16d-7749-4335-b431-a3c6b77e2725\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") "
Jul 15 19:20:47.594780 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.594743    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-token\") pod \"fa2ce16d-7749-4335-b431-a3c6b77e2725\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") "
Jul 15 19:20:47.595007 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.594790    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-podinfo\") pod \"fa2ce16d-7749-4335-b431-a3c6b77e2725\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") "
Jul 15 19:20:47.595007 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.594814    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-certs\") pod \"fa2ce16d-7749-4335-b431-a3c6b77e2725\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") "
Jul 15 19:20:47.595007 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.594844    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-data\") pod \"fa2ce16d-7749-4335-b431-a3c6b77e2725\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") "
Jul 15 19:20:47.595007 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.594874    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-credential-socket\") pod \"fa2ce16d-7749-4335-b431-a3c6b77e2725\" (UID: \"fa2ce16d-7749-4335-b431-a3c6b77e2725\") "
Jul 15 19:20:47.595216 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.595033    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa2ce16d-7749-4335-b431-a3c6b77e2725-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fa2ce16d-7749-4335-b431-a3c6b77e2725" (UID: "fa2ce16d-7749-4335-b431-a3c6b77e2725"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:20:47.595323 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.595230    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa2ce16d-7749-4335-b431-a3c6b77e2725-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:47.595323 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.595256    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fa2ce16d-7749-4335-b431-a3c6b77e2725" (UID: "fa2ce16d-7749-4335-b431-a3c6b77e2725"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:20:47.595780 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.595686    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fa2ce16d-7749-4335-b431-a3c6b77e2725" (UID: "fa2ce16d-7749-4335-b431-a3c6b77e2725"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:20:47.595898 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.595825    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fa2ce16d-7749-4335-b431-a3c6b77e2725" (UID: "fa2ce16d-7749-4335-b431-a3c6b77e2725"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:20:47.596712 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.596692    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-data" (OuterVolumeSpecName: "istio-data") pod "fa2ce16d-7749-4335-b431-a3c6b77e2725" (UID: "fa2ce16d-7749-4335-b431-a3c6b77e2725"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:20:47.597181 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.597154    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-kube-api-access-dl4qx" (OuterVolumeSpecName: "kube-api-access-dl4qx") pod "fa2ce16d-7749-4335-b431-a3c6b77e2725" (UID: "fa2ce16d-7749-4335-b431-a3c6b77e2725"). InnerVolumeSpecName "kube-api-access-dl4qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:20:47.597482 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.597462    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fa2ce16d-7749-4335-b431-a3c6b77e2725" (UID: "fa2ce16d-7749-4335-b431-a3c6b77e2725"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:20:47.597612 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.597498    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fa2ce16d-7749-4335-b431-a3c6b77e2725" (UID: "fa2ce16d-7749-4335-b431-a3c6b77e2725"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:20:47.597850 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.597825    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa2ce16d-7749-4335-b431-a3c6b77e2725" (UID: "fa2ce16d-7749-4335-b431-a3c6b77e2725"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:20:47.695731 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.695691    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl4qx\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-kube-api-access-dl4qx\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:47.695731 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.695726    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:47.695731 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.695735    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:47.695968 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.695744    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:47.695968 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.695754    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:47.695968 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.695762    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:47.695968 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.695770    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:47.695968 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:47.695778    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa2ce16d-7749-4335-b431-a3c6b77e2725-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:20:48.141703 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.141665    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"]
Jul 15 19:20:48.142092 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.142080    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy"
Jul 15 19:20:48.142134 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.142094    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy"
Jul 15 19:20:48.142178 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.142167    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy"
Jul 15 19:20:48.145610 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.145591    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"
Jul 15 19:20:48.148511 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.148485    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:20:48.148677 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.148544    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:20:48.154594 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.154566    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"]
Jul 15 19:20:48.198866 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.198828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb287a0-063f-4648-8939-ad6aab66d422-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b5322848-t77dj\" (UID: \"beb287a0-063f-4648-8939-ad6aab66d422\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"
Jul 15 19:20:48.299432 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.299389    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb287a0-063f-4648-8939-ad6aab66d422-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b5322848-t77dj\" (UID: \"beb287a0-063f-4648-8939-ad6aab66d422\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"
Jul 15 19:20:48.300035 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.300014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb287a0-063f-4648-8939-ad6aab66d422-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b5322848-t77dj\" (UID: \"beb287a0-063f-4648-8939-ad6aab66d422\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"
Jul 15 19:20:48.395991 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.395912    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"
Jul 15 19:20:48.396418 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.395912    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8" event={"ID":"fa2ce16d-7749-4335-b431-a3c6b77e2725","Type":"ContainerDied","Data":"a1038893446e725f7b590a365b15c090d7b4618d46b016b1a9fe330b75876e6c"}
Jul 15 19:20:48.396418 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.396045    2571 scope.go:117] "RemoveContainer" containerID="65b4c497d7226d9f7ed11f6c9aa8244d2ae9567b55ac33575c06d14ad8cbaf47"
Jul 15 19:20:48.431693 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.431655    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"]
Jul 15 19:20:48.438795 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.438758    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-109e9634-openshift-default-6c58585cfc-hm8c8"]
Jul 15 19:20:48.457484 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.457456    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"
Jul 15 19:20:48.620727 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:48.620699    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"]
Jul 15 19:20:48.623343 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:20:48.623314    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb287a0_063f_4648_8939_ad6aab66d422.slice/crio-92936a4bc4986d6d175662ac977187a383d66d270c8a1ac8f16378672671285a WatchSource:0}: Error finding container 92936a4bc4986d6d175662ac977187a383d66d270c8a1ac8f16378672671285a: Status 404 returned error can't find the container with id 92936a4bc4986d6d175662ac977187a383d66d270c8a1ac8f16378672671285a
Jul 15 19:20:49.403427 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:49.403393    2571 generic.go:356] "Generic (PLEG): container finished" podID="beb287a0-063f-4648-8939-ad6aab66d422" containerID="cda7edf72f336636c956364400cb9b60937900b2c3f64a49bae8412fb08c7530" exitCode=7
Jul 15 19:20:49.403827 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:49.403480    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj" event={"ID":"beb287a0-063f-4648-8939-ad6aab66d422","Type":"ContainerDied","Data":"cda7edf72f336636c956364400cb9b60937900b2c3f64a49bae8412fb08c7530"}
Jul 15 19:20:49.403827 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:49.403537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj" event={"ID":"beb287a0-063f-4648-8939-ad6aab66d422","Type":"ContainerStarted","Data":"92936a4bc4986d6d175662ac977187a383d66d270c8a1ac8f16378672671285a"}
Jul 15 19:20:49.403827 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:49.403668    2571 scope.go:117] "RemoveContainer" containerID="cda7edf72f336636c956364400cb9b60937900b2c3f64a49bae8412fb08c7530"
Jul 15 19:20:50.340718 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:50.340684    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" path="/var/lib/kubelet/pods/fa2ce16d-7749-4335-b431-a3c6b77e2725/volumes"
Jul 15 19:20:50.411836 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:50.411745    2571 generic.go:356] "Generic (PLEG): container finished" podID="beb287a0-063f-4648-8939-ad6aab66d422" containerID="89b42eeb3d0939822ad8fa0b010426b2b2fc55913a39a125f591aad7f27b787b" exitCode=7
Jul 15 19:20:50.411836 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:50.411808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj" event={"ID":"beb287a0-063f-4648-8939-ad6aab66d422","Type":"ContainerDied","Data":"89b42eeb3d0939822ad8fa0b010426b2b2fc55913a39a125f591aad7f27b787b"}
Jul 15 19:20:50.412315 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:50.411850    2571 scope.go:117] "RemoveContainer" containerID="cda7edf72f336636c956364400cb9b60937900b2c3f64a49bae8412fb08c7530"
Jul 15 19:20:50.412315 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:50.412044    2571 scope.go:117] "RemoveContainer" containerID="89b42eeb3d0939822ad8fa0b010426b2b2fc55913a39a125f591aad7f27b787b"
Jul 15 19:20:50.412315 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:20:50.412268    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-b5322848-t77dj_odh-ai-gateway-infra(beb287a0-063f-4648-8939-ad6aab66d422)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj" podUID="beb287a0-063f-4648-8939-ad6aab66d422"
Jul 15 19:20:51.419304 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:51.413922    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:20:51.423670 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:51.423644    2571 scope.go:117] "RemoveContainer" containerID="89b42eeb3d0939822ad8fa0b010426b2b2fc55913a39a125f591aad7f27b787b"
Jul 15 19:20:51.423884 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:20:51.423862    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-b5322848-t77dj_odh-ai-gateway-infra(beb287a0-063f-4648-8939-ad6aab66d422)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj" podUID="beb287a0-063f-4648-8939-ad6aab66d422"
Jul 15 19:20:59.476115 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:59.476033    2571 generic.go:356] "Generic (PLEG): container finished" podID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerID="a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2" exitCode=0
Jul 15 19:20:59.476115 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:59.476084    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" event={"ID":"c78d00c8-0627-4f12-bc07-39b8da39e407","Type":"ContainerDied","Data":"a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2"}
Jul 15 19:20:59.476590 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:59.476493    2571 scope.go:117] "RemoveContainer" containerID="a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2"
Jul 15 19:20:59.477555 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:59.477518    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:20:59.477619 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:59.477592    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:20:59.477658 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:20:59.477632    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:21:00.377646 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:00.377603    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:21:00.483948 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:00.483908    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" event={"ID":"c78d00c8-0627-4f12-bc07-39b8da39e407","Type":"ContainerStarted","Data":"e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39"}
Jul 15 19:21:00.888398 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:00.888349    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:21:00.889523 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:00.889500    2571 patch_prober.go:28] interesting pod/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 15 19:21:00.889589 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:00.889549    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 15 19:21:01.888693 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:01.888656    2571 patch_prober.go:28] interesting pod/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 15 19:21:01.889086 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:01.888715    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 15 19:21:02.332394 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:02.332364    2571 scope.go:117] "RemoveContainer" containerID="89b42eeb3d0939822ad8fa0b010426b2b2fc55913a39a125f591aad7f27b787b"
Jul 15 19:21:02.889581 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:02.889541    2571 patch_prober.go:28] interesting pod/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 15 19:21:02.889951 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:02.889596    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 15 19:21:03.502306 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:03.502249    2571 generic.go:356] "Generic (PLEG): container finished" podID="beb287a0-063f-4648-8939-ad6aab66d422" containerID="cf5a35ec0d188d7e1e7fa9bf8cfe01670ace83bac7378b16ecefe36a8b6752bb" exitCode=0
Jul 15 19:21:03.502471 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:03.502313    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj" event={"ID":"beb287a0-063f-4648-8939-ad6aab66d422","Type":"ContainerDied","Data":"cf5a35ec0d188d7e1e7fa9bf8cfe01670ace83bac7378b16ecefe36a8b6752bb"}
Jul 15 19:21:03.502471 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:03.502376    2571 scope.go:117] "RemoveContainer" containerID="89b42eeb3d0939822ad8fa0b010426b2b2fc55913a39a125f591aad7f27b787b"
Jul 15 19:21:03.889156 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:03.889122    2571 patch_prober.go:28] interesting pod/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 15 19:21:03.889368 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:03.889175    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 15 19:21:04.538511 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:04.538470    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"]
Jul 15 19:21:04.651296 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:04.651258    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"
Jul 15 19:21:04.769243 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:04.769154    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb287a0-063f-4648-8939-ad6aab66d422-maas-api-service-ca\") pod \"beb287a0-063f-4648-8939-ad6aab66d422\" (UID: \"beb287a0-063f-4648-8939-ad6aab66d422\") "
Jul 15 19:21:04.769586 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:04.769559    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beb287a0-063f-4648-8939-ad6aab66d422-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "beb287a0-063f-4648-8939-ad6aab66d422" (UID: "beb287a0-063f-4648-8939-ad6aab66d422"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:21:04.870785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:04.870749    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb287a0-063f-4648-8939-ad6aab66d422-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:21:04.892369 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:04.892337    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:21:04.892628 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:04.892604    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:21:04.893185 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:04.893168    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:21:05.515617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:05.515588    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"
Jul 15 19:21:05.515782 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:05.515628    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj" event={"ID":"beb287a0-063f-4648-8939-ad6aab66d422","Type":"ContainerDied","Data":"92936a4bc4986d6d175662ac977187a383d66d270c8a1ac8f16378672671285a"}
Jul 15 19:21:05.515782 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:05.515672    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92936a4bc4986d6d175662ac977187a383d66d270c8a1ac8f16378672671285a"
Jul 15 19:21:05.548587 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:05.548557    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"]
Jul 15 19:21:05.552289 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:05.552254    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-t77dj"]
Jul 15 19:21:06.337929 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:06.337894    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beb287a0-063f-4648-8939-ad6aab66d422" path="/var/lib/kubelet/pods/beb287a0-063f-4648-8939-ad6aab66d422/volumes"
Jul 15 19:21:16.329127 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:16.329089    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:21:16.335233 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:16.335205    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:21:38.206557 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.206520    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"]
Jul 15 19:21:38.207104 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.207082    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb287a0-063f-4648-8939-ad6aab66d422" containerName="revoke-keys"
Jul 15 19:21:38.207194 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.207108    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb287a0-063f-4648-8939-ad6aab66d422" containerName="revoke-keys"
Jul 15 19:21:38.207194 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.207124    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb287a0-063f-4648-8939-ad6aab66d422" containerName="revoke-keys"
Jul 15 19:21:38.207194 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.207132    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb287a0-063f-4648-8939-ad6aab66d422" containerName="revoke-keys"
Jul 15 19:21:38.207194 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.207164    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy"
Jul 15 19:21:38.207194 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.207173    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy"
Jul 15 19:21:38.207463 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.207308    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb287a0-063f-4648-8939-ad6aab66d422" containerName="revoke-keys"
Jul 15 19:21:38.207463 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.207325    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb287a0-063f-4648-8939-ad6aab66d422" containerName="revoke-keys"
Jul 15 19:21:38.207463 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.207335    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2ce16d-7749-4335-b431-a3c6b77e2725" containerName="istio-proxy"
Jul 15 19:21:38.210611 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.210589    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"
Jul 15 19:21:38.213577 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.213553    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:21:38.213721 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.213636    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:21:38.226832 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.226799    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"]
Jul 15 19:21:38.295785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.295751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce30a9ec-ca6a-4cf6-8390-728a01f8e800-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b5322848-s99z7\" (UID: \"ce30a9ec-ca6a-4cf6-8390-728a01f8e800\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"
Jul 15 19:21:38.397161 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.397124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce30a9ec-ca6a-4cf6-8390-728a01f8e800-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b5322848-s99z7\" (UID: \"ce30a9ec-ca6a-4cf6-8390-728a01f8e800\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"
Jul 15 19:21:38.397785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.397764    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce30a9ec-ca6a-4cf6-8390-728a01f8e800-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b5322848-s99z7\" (UID: \"ce30a9ec-ca6a-4cf6-8390-728a01f8e800\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"
Jul 15 19:21:38.520939 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.520849    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"
Jul 15 19:21:38.864202 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:38.864177    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"]
Jul 15 19:21:38.866379 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:21:38.866334    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce30a9ec_ca6a_4cf6_8390_728a01f8e800.slice/crio-f6d5c95bf023397dea09407f5b647c24cf578252071a9a7adca6a8a11ef81a02 WatchSource:0}: Error finding container f6d5c95bf023397dea09407f5b647c24cf578252071a9a7adca6a8a11ef81a02: Status 404 returned error can't find the container with id f6d5c95bf023397dea09407f5b647c24cf578252071a9a7adca6a8a11ef81a02
Jul 15 19:21:39.702025 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:39.701980    2571 generic.go:356] "Generic (PLEG): container finished" podID="ce30a9ec-ca6a-4cf6-8390-728a01f8e800" containerID="4948cc24962d558567ba35206c1fec662706a6a328e831cb707f4c2508ce4613" exitCode=0
Jul 15 19:21:39.702426 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:39.702066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7" event={"ID":"ce30a9ec-ca6a-4cf6-8390-728a01f8e800","Type":"ContainerDied","Data":"4948cc24962d558567ba35206c1fec662706a6a328e831cb707f4c2508ce4613"}
Jul 15 19:21:39.702426 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:39.702127    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7" event={"ID":"ce30a9ec-ca6a-4cf6-8390-728a01f8e800","Type":"ContainerStarted","Data":"f6d5c95bf023397dea09407f5b647c24cf578252071a9a7adca6a8a11ef81a02"}
Jul 15 19:21:40.847170 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:40.847140    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"
Jul 15 19:21:40.924108 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:40.924072    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce30a9ec-ca6a-4cf6-8390-728a01f8e800-maas-api-service-ca\") pod \"ce30a9ec-ca6a-4cf6-8390-728a01f8e800\" (UID: \"ce30a9ec-ca6a-4cf6-8390-728a01f8e800\") "
Jul 15 19:21:40.924426 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:40.924402    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce30a9ec-ca6a-4cf6-8390-728a01f8e800-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce30a9ec-ca6a-4cf6-8390-728a01f8e800" (UID: "ce30a9ec-ca6a-4cf6-8390-728a01f8e800"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:21:41.025167 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:41.025079    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce30a9ec-ca6a-4cf6-8390-728a01f8e800-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:21:41.714700 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:41.714666    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7"
Jul 15 19:21:41.714700 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:41.714695    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5322848-s99z7" event={"ID":"ce30a9ec-ca6a-4cf6-8390-728a01f8e800","Type":"ContainerDied","Data":"f6d5c95bf023397dea09407f5b647c24cf578252071a9a7adca6a8a11ef81a02"}
Jul 15 19:21:41.714952 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:41.714740    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6d5c95bf023397dea09407f5b647c24cf578252071a9a7adca6a8a11ef81a02"
Jul 15 19:21:51.842972 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:21:51.842937    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:22:03.537078 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:03.537037    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"]
Jul 15 19:22:03.537575 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:03.537250    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy" containerID="cri-o://e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39" gracePeriod=30
Jul 15 19:22:04.895224 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:04.895182    2571 patch_prober.go:28] interesting pod/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:22:04.895641 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:04.895261    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:22:08.792841 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.792816    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:22:08.867603 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.867568    2571 generic.go:356] "Generic (PLEG): container finished" podID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerID="e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39" exitCode=0
Jul 15 19:22:08.867778 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.867618    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" event={"ID":"c78d00c8-0627-4f12-bc07-39b8da39e407","Type":"ContainerDied","Data":"e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39"}
Jul 15 19:22:08.867778 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.867628    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"
Jul 15 19:22:08.867778 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.867667    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh" event={"ID":"c78d00c8-0627-4f12-bc07-39b8da39e407","Type":"ContainerDied","Data":"e30c89fca4ff03bc8f4294e07bf8acb0f713c7c26909863fdda26736ad5b7ff7"}
Jul 15 19:22:08.867778 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.867690    2571 scope.go:117] "RemoveContainer" containerID="e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39"
Jul 15 19:22:08.876721 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.876691    2571 scope.go:117] "RemoveContainer" containerID="a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2"
Jul 15 19:22:08.884307 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.884261    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th78l\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-kube-api-access-th78l\") pod \"c78d00c8-0627-4f12-bc07-39b8da39e407\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") "
Jul 15 19:22:08.884491 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.884476    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c78d00c8-0627-4f12-bc07-39b8da39e407-istiod-ca-cert\") pod \"c78d00c8-0627-4f12-bc07-39b8da39e407\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") "
Jul 15 19:22:08.884651 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.884639    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-envoy\") pod \"c78d00c8-0627-4f12-bc07-39b8da39e407\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") "
Jul 15 19:22:08.884752 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.884740    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-credential-socket\") pod \"c78d00c8-0627-4f12-bc07-39b8da39e407\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") "
Jul 15 19:22:08.884845 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.884834    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-data\") pod \"c78d00c8-0627-4f12-bc07-39b8da39e407\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") "
Jul 15 19:22:08.884934 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.884923    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-socket\") pod \"c78d00c8-0627-4f12-bc07-39b8da39e407\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") "
Jul 15 19:22:08.885062 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.885051    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-podinfo\") pod \"c78d00c8-0627-4f12-bc07-39b8da39e407\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") "
Jul 15 19:22:08.885183 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.885171    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-token\") pod \"c78d00c8-0627-4f12-bc07-39b8da39e407\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") "
Jul 15 19:22:08.885297 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.885268    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-certs\") pod \"c78d00c8-0627-4f12-bc07-39b8da39e407\" (UID: \"c78d00c8-0627-4f12-bc07-39b8da39e407\") "
Jul 15 19:22:08.885999 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.885174    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c78d00c8-0627-4f12-bc07-39b8da39e407-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c78d00c8-0627-4f12-bc07-39b8da39e407" (UID: "c78d00c8-0627-4f12-bc07-39b8da39e407"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:22:08.886142 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.886121    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-data" (OuterVolumeSpecName: "istio-data") pod "c78d00c8-0627-4f12-bc07-39b8da39e407" (UID: "c78d00c8-0627-4f12-bc07-39b8da39e407"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:22:08.886240 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.886183    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c78d00c8-0627-4f12-bc07-39b8da39e407" (UID: "c78d00c8-0627-4f12-bc07-39b8da39e407"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:22:08.886325 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.885977    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c78d00c8-0627-4f12-bc07-39b8da39e407" (UID: "c78d00c8-0627-4f12-bc07-39b8da39e407"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:22:08.886325 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.885543    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c78d00c8-0627-4f12-bc07-39b8da39e407" (UID: "c78d00c8-0627-4f12-bc07-39b8da39e407"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:22:08.887650 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.887626    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-kube-api-access-th78l" (OuterVolumeSpecName: "kube-api-access-th78l") pod "c78d00c8-0627-4f12-bc07-39b8da39e407" (UID: "c78d00c8-0627-4f12-bc07-39b8da39e407"). InnerVolumeSpecName "kube-api-access-th78l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:22:08.887807 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.887791    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c78d00c8-0627-4f12-bc07-39b8da39e407" (UID: "c78d00c8-0627-4f12-bc07-39b8da39e407"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:22:08.888021 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.888002    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-token" (OuterVolumeSpecName: "istio-token") pod "c78d00c8-0627-4f12-bc07-39b8da39e407" (UID: "c78d00c8-0627-4f12-bc07-39b8da39e407"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:22:08.888554 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.888529    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c78d00c8-0627-4f12-bc07-39b8da39e407" (UID: "c78d00c8-0627-4f12-bc07-39b8da39e407"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:22:08.892994 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.892972    2571 scope.go:117] "RemoveContainer" containerID="e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39"
Jul 15 19:22:08.893474 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:22:08.893447    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39\": container with ID starting with e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39 not found: ID does not exist" containerID="e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39"
Jul 15 19:22:08.893586 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.893481    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39"} err="failed to get container status \"e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39\": rpc error: code = NotFound desc = could not find container \"e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39\": container with ID starting with e18b0c0ada09cf14f140ed00496fe56e126d5368ec1e2ab1a7017795f058ed39 not found: ID does not exist"
Jul 15 19:22:08.893586 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.893502    2571 scope.go:117] "RemoveContainer" containerID="a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2"
Jul 15 19:22:08.893820 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:22:08.893796    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2\": container with ID starting with a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2 not found: ID does not exist" containerID="a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2"
Jul 15 19:22:08.893906 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.893827    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2"} err="failed to get container status \"a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2\": rpc error: code = NotFound desc = could not find container \"a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2\": container with ID starting with a5bacab155b2e7fa0273a5e5984bf88b08dd36eff997eee9bf918e93ef6b33c2 not found: ID does not exist"
Jul 15 19:22:08.986661 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.986628    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:22:08.986661 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.986655    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:22:08.986661 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.986668    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:22:08.986880 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.986682    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th78l\" (UniqueName: \"kubernetes.io/projected/c78d00c8-0627-4f12-bc07-39b8da39e407-kube-api-access-th78l\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:22:08.986880 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.986692    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c78d00c8-0627-4f12-bc07-39b8da39e407-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:22:08.986880 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.986700    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:22:08.986880 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.986708    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:22:08.986880 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.986715    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:22:08.986880 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:08.986723    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c78d00c8-0627-4f12-bc07-39b8da39e407-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:22:09.190702 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:09.190671    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"]
Jul 15 19:22:09.198734 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:09.198707    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b5322848-openshift-default-68d9d4d7c5-tlgmh"]
Jul 15 19:22:10.338881 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:22:10.338844    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" path="/var/lib/kubelet/pods/c78d00c8-0627-4f12-bc07-39b8da39e407/volumes"
Jul 15 19:23:16.432449 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:16.432414    2571 scope.go:117] "RemoveContainer" containerID="eccc19bc6236ac066d237133b9e8c3abe7d151e076d58b77af8e9569fb88cf1a"
Jul 15 19:23:29.303966 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:29.303926    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:23:37.121922 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:37.121884    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:23:43.903559 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.903525    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"]
Jul 15 19:23:43.903981 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.903918    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce30a9ec-ca6a-4cf6-8390-728a01f8e800" containerName="revoke-keys"
Jul 15 19:23:43.903981 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.903930    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce30a9ec-ca6a-4cf6-8390-728a01f8e800" containerName="revoke-keys"
Jul 15 19:23:43.903981 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.903942    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy"
Jul 15 19:23:43.903981 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.903958    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy"
Jul 15 19:23:43.903981 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.903975    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb287a0-063f-4648-8939-ad6aab66d422" containerName="revoke-keys"
Jul 15 19:23:43.903981 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.903981    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb287a0-063f-4648-8939-ad6aab66d422" containerName="revoke-keys"
Jul 15 19:23:43.904186 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.904038    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy"
Jul 15 19:23:43.904186 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.904045    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb287a0-063f-4648-8939-ad6aab66d422" containerName="revoke-keys"
Jul 15 19:23:43.904186 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.904055    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce30a9ec-ca6a-4cf6-8390-728a01f8e800" containerName="revoke-keys"
Jul 15 19:23:43.904186 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.904061    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy"
Jul 15 19:23:43.907402 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.907382    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:43.910596 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.910575    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-23ae53ab-openshift-default-dockercfg-nhnwx\""
Jul 15 19:23:43.931119 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.931093    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"]
Jul 15 19:23:43.952473 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.952435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-podinfo\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:43.952628 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.952485    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-certs\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:43.952628 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.952517    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-credential-socket\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:43.952628 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.952597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-578xf\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-kube-api-access-578xf\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:43.952763 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.952644    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-socket\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:43.952763 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.952665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-data\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:43.952763 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.952720    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce800ec-3ee3-4569-8dfa-42411fef5d72-istiod-ca-cert\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:43.952876 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.952762    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-envoy\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:43.952876 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:43.952794    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-token\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.053587 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.053552    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-podinfo\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.053775 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.053594    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-certs\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.053775 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.053619    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-credential-socket\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.053900 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.053820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-578xf\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-kube-api-access-578xf\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.053962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.053899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-socket\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.053962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.053934    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-data\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.054065 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.053976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce800ec-3ee3-4569-8dfa-42411fef5d72-istiod-ca-cert\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.054065 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.054000    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-certs\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.054065 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.054016    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-envoy\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.054065 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.054038    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-credential-socket\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.054276 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.054063    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-token\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.054359 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.054295    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-socket\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.054417 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.054392    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-data\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.054691 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.054669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce800ec-3ee3-4569-8dfa-42411fef5d72-istiod-ca-cert\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.056077 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.056058    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-envoy\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.056176 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.056161    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-podinfo\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.064569 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.064544    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-578xf\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-kube-api-access-578xf\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.065493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.065471    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-token\") pod \"e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") " pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.217272 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.217166    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:44.361305 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.361258    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"]
Jul 15 19:23:44.362724 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:23:44.362692    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce800ec_3ee3_4569_8dfa_42411fef5d72.slice/crio-b8bd9e654f259dd228760b16295ce373314edc61ceee8300af7d3b0987a73ec0 WatchSource:0}: Error finding container b8bd9e654f259dd228760b16295ce373314edc61ceee8300af7d3b0987a73ec0: Status 404 returned error can't find the container with id b8bd9e654f259dd228760b16295ce373314edc61ceee8300af7d3b0987a73ec0
Jul 15 19:23:44.364632 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.364597    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:23:44.364717 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.364666    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:23:44.364717 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:44.364694    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:23:45.369708 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:45.369673    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" event={"ID":"fce800ec-3ee3-4569-8dfa-42411fef5d72","Type":"ContainerStarted","Data":"74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11"}
Jul 15 19:23:45.370087 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:45.369726    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" event={"ID":"fce800ec-3ee3-4569-8dfa-42411fef5d72","Type":"ContainerStarted","Data":"b8bd9e654f259dd228760b16295ce373314edc61ceee8300af7d3b0987a73ec0"}
Jul 15 19:23:45.397843 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:45.397779    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" podStartSLOduration=2.397762681 podStartE2EDuration="2.397762681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:23:45.395969776 +0000 UTC m=+1949.577742470" watchObservedRunningTime="2026-07-15 19:23:45.397762681 +0000 UTC m=+1949.579535351"
Jul 15 19:23:45.798338 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:45.798233    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:23:46.217833 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:46.217794    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:46.222469 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:46.222442    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:46.375535 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:46.375500    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:46.376418 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:46.376394    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:23:57.705946 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:57.705904    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:23:59.810699 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:59.810660    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"]
Jul 15 19:23:59.811089 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:59.811047    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy"
Jul 15 19:23:59.811089 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:59.811058    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78d00c8-0627-4f12-bc07-39b8da39e407" containerName="istio-proxy"
Jul 15 19:23:59.814855 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:59.814834    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"
Jul 15 19:23:59.818757 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:59.818734    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:23:59.820077 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:59.820056    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:23:59.827027 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:59.827000    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"]
Jul 15 19:23:59.915975 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:23:59.915940    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/704db709-1b5e-4a16-ac14-e81e7d691dea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw\" (UID: \"704db709-1b5e-4a16-ac14-e81e7d691dea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"
Jul 15 19:24:00.017560 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.017530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/704db709-1b5e-4a16-ac14-e81e7d691dea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw\" (UID: \"704db709-1b5e-4a16-ac14-e81e7d691dea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"
Jul 15 19:24:00.018135 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.018117    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/704db709-1b5e-4a16-ac14-e81e7d691dea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw\" (UID: \"704db709-1b5e-4a16-ac14-e81e7d691dea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"
Jul 15 19:24:00.126983 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.126928    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"
Jul 15 19:24:00.268156 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.268124    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"]
Jul 15 19:24:00.270319 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:24:00.270277    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704db709_1b5e_4a16_ac14_e81e7d691dea.slice/crio-4df7704983f423035b73815365a743dee04ba1788aa45ef956e064a8bc011887 WatchSource:0}: Error finding container 4df7704983f423035b73815365a743dee04ba1788aa45ef956e064a8bc011887: Status 404 returned error can't find the container with id 4df7704983f423035b73815365a743dee04ba1788aa45ef956e064a8bc011887
Jul 15 19:24:00.450945 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.450915    2571 generic.go:356] "Generic (PLEG): container finished" podID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerID="74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11" exitCode=0
Jul 15 19:24:00.451101 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.450988    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" event={"ID":"fce800ec-3ee3-4569-8dfa-42411fef5d72","Type":"ContainerDied","Data":"74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11"}
Jul 15 19:24:00.451459 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.451438    2571 scope.go:117] "RemoveContainer" containerID="74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11"
Jul 15 19:24:00.452244 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.452213    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw" event={"ID":"704db709-1b5e-4a16-ac14-e81e7d691dea","Type":"ContainerStarted","Data":"4df7704983f423035b73815365a743dee04ba1788aa45ef956e064a8bc011887"}
Jul 15 19:24:00.452545 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.452501    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:24:00.452629 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.452608    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:24:00.452692 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:00.452658    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:24:01.375840 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:01.375803    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:24:01.459403 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:01.459365    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" event={"ID":"fce800ec-3ee3-4569-8dfa-42411fef5d72","Type":"ContainerStarted","Data":"6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7"}
Jul 15 19:24:01.460889 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:01.460863    2571 generic.go:356] "Generic (PLEG): container finished" podID="704db709-1b5e-4a16-ac14-e81e7d691dea" containerID="ccab0f5560e59d8383898df13b6a69e9b9fe39508d968e193ed9b46eef2f0527" exitCode=0
Jul 15 19:24:01.461014 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:01.460913    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw" event={"ID":"704db709-1b5e-4a16-ac14-e81e7d691dea","Type":"ContainerDied","Data":"ccab0f5560e59d8383898df13b6a69e9b9fe39508d968e193ed9b46eef2f0527"}
Jul 15 19:24:02.217764 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:02.217729    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:24:02.218902 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:02.218870    2571 patch_prober.go:28] interesting pod/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 15 19:24:02.219041 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:02.218925    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 15 19:24:02.620649 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:02.620627    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"
Jul 15 19:24:02.667743 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:02.667703    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/704db709-1b5e-4a16-ac14-e81e7d691dea-maas-api-service-ca\") pod \"704db709-1b5e-4a16-ac14-e81e7d691dea\" (UID: \"704db709-1b5e-4a16-ac14-e81e7d691dea\") "
Jul 15 19:24:02.668029 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:02.668004    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/704db709-1b5e-4a16-ac14-e81e7d691dea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "704db709-1b5e-4a16-ac14-e81e7d691dea" (UID: "704db709-1b5e-4a16-ac14-e81e7d691dea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:24:02.769126 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:02.769089    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/704db709-1b5e-4a16-ac14-e81e7d691dea-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:03.217610 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:03.217571    2571 patch_prober.go:28] interesting pod/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 15 19:24:03.217808 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:03.217629    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 15 19:24:03.473230 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:03.473146    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw"
Jul 15 19:24:03.473230 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:03.473162    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw" event={"ID":"704db709-1b5e-4a16-ac14-e81e7d691dea","Type":"ContainerDied","Data":"4df7704983f423035b73815365a743dee04ba1788aa45ef956e064a8bc011887"}
Jul 15 19:24:03.473230 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:03.473215    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4df7704983f423035b73815365a743dee04ba1788aa45ef956e064a8bc011887"
Jul 15 19:24:04.218558 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:04.218517    2571 patch_prober.go:28] interesting pod/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 15 19:24:04.218962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:04.218579    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 15 19:24:05.218111 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:05.218067    2571 patch_prober.go:28] interesting pod/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 15 19:24:05.218325 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:05.218126    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 15 19:24:06.221524 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:06.221492    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:24:06.221883 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:06.221749    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:24:06.222413 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:06.222397    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:24:13.109949 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:13.109858    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:24:16.453463 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:16.453421    2571 scope.go:117] "RemoveContainer" containerID="27156711ca1af240cf57ed3f95ca61d0707738daf068c1407e86e6ad4512a75a"
Jul 15 19:24:25.638149 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:25.638115    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"]
Jul 15 19:24:25.638619 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:25.638382    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy" containerID="cri-o://6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7" gracePeriod=30
Jul 15 19:24:30.898639 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:30.898569    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:24:31.032401 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032362    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-data\") pod \"fce800ec-3ee3-4569-8dfa-42411fef5d72\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") "
Jul 15 19:24:31.032589 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032416    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-credential-socket\") pod \"fce800ec-3ee3-4569-8dfa-42411fef5d72\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") "
Jul 15 19:24:31.032589 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032437    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-socket\") pod \"fce800ec-3ee3-4569-8dfa-42411fef5d72\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") "
Jul 15 19:24:31.032589 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032456    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-envoy\") pod \"fce800ec-3ee3-4569-8dfa-42411fef5d72\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") "
Jul 15 19:24:31.032589 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032513    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-certs\") pod \"fce800ec-3ee3-4569-8dfa-42411fef5d72\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") "
Jul 15 19:24:31.032589 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032560    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-podinfo\") pod \"fce800ec-3ee3-4569-8dfa-42411fef5d72\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") "
Jul 15 19:24:31.032859 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032672    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce800ec-3ee3-4569-8dfa-42411fef5d72-istiod-ca-cert\") pod \"fce800ec-3ee3-4569-8dfa-42411fef5d72\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") "
Jul 15 19:24:31.032859 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032712    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-token\") pod \"fce800ec-3ee3-4569-8dfa-42411fef5d72\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") "
Jul 15 19:24:31.032859 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032706    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fce800ec-3ee3-4569-8dfa-42411fef5d72" (UID: "fce800ec-3ee3-4569-8dfa-42411fef5d72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:24:31.032859 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032755    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-578xf\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-kube-api-access-578xf\") pod \"fce800ec-3ee3-4569-8dfa-42411fef5d72\" (UID: \"fce800ec-3ee3-4569-8dfa-42411fef5d72\") "
Jul 15 19:24:31.032859 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032777    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fce800ec-3ee3-4569-8dfa-42411fef5d72" (UID: "fce800ec-3ee3-4569-8dfa-42411fef5d72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:24:31.033111 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.032872    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fce800ec-3ee3-4569-8dfa-42411fef5d72" (UID: "fce800ec-3ee3-4569-8dfa-42411fef5d72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:24:31.033111 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.033030    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fce800ec-3ee3-4569-8dfa-42411fef5d72-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fce800ec-3ee3-4569-8dfa-42411fef5d72" (UID: "fce800ec-3ee3-4569-8dfa-42411fef5d72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:24:31.033217 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.033149    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:31.033217 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.033169    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:31.033217 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.033185    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:31.033217 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.033198    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce800ec-3ee3-4569-8dfa-42411fef5d72-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:31.033470 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.033239    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-data" (OuterVolumeSpecName: "istio-data") pod "fce800ec-3ee3-4569-8dfa-42411fef5d72" (UID: "fce800ec-3ee3-4569-8dfa-42411fef5d72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:24:31.034892 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.034862    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-token" (OuterVolumeSpecName: "istio-token") pod "fce800ec-3ee3-4569-8dfa-42411fef5d72" (UID: "fce800ec-3ee3-4569-8dfa-42411fef5d72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:24:31.035013 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.034911    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-kube-api-access-578xf" (OuterVolumeSpecName: "kube-api-access-578xf") pod "fce800ec-3ee3-4569-8dfa-42411fef5d72" (UID: "fce800ec-3ee3-4569-8dfa-42411fef5d72"). InnerVolumeSpecName "kube-api-access-578xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:24:31.035013 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.034929    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fce800ec-3ee3-4569-8dfa-42411fef5d72" (UID: "fce800ec-3ee3-4569-8dfa-42411fef5d72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:24:31.035092 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.035030    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fce800ec-3ee3-4569-8dfa-42411fef5d72" (UID: "fce800ec-3ee3-4569-8dfa-42411fef5d72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:24:31.134484 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.134442    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:31.134484 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.134475    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:31.134484 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.134485    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-578xf\" (UniqueName: \"kubernetes.io/projected/fce800ec-3ee3-4569-8dfa-42411fef5d72-kube-api-access-578xf\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:31.134484 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.134495    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:31.134751 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.134504    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce800ec-3ee3-4569-8dfa-42411fef5d72-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:24:31.624470 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.624433    2571 generic.go:356] "Generic (PLEG): container finished" podID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerID="6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7" exitCode=0
Jul 15 19:24:31.624674 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.624485    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"
Jul 15 19:24:31.624674 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.624522    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" event={"ID":"fce800ec-3ee3-4569-8dfa-42411fef5d72","Type":"ContainerDied","Data":"6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7"}
Jul 15 19:24:31.624674 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.624578    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl" event={"ID":"fce800ec-3ee3-4569-8dfa-42411fef5d72","Type":"ContainerDied","Data":"b8bd9e654f259dd228760b16295ce373314edc61ceee8300af7d3b0987a73ec0"}
Jul 15 19:24:31.624674 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.624600    2571 scope.go:117] "RemoveContainer" containerID="6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7"
Jul 15 19:24:31.634078 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.634057    2571 scope.go:117] "RemoveContainer" containerID="74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11"
Jul 15 19:24:31.642871 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.642854    2571 scope.go:117] "RemoveContainer" containerID="6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7"
Jul 15 19:24:31.643105 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:24:31.643086    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7\": container with ID starting with 6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7 not found: ID does not exist" containerID="6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7"
Jul 15 19:24:31.643156 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.643113    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7"} err="failed to get container status \"6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7\": rpc error: code = NotFound desc = could not find container \"6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7\": container with ID starting with 6c2619092ff8fb7e219d7e41cb5a04cddd19972158fdafa41031999d93b21bc7 not found: ID does not exist"
Jul 15 19:24:31.643156 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.643134    2571 scope.go:117] "RemoveContainer" containerID="74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11"
Jul 15 19:24:31.643407 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:24:31.643389    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11\": container with ID starting with 74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11 not found: ID does not exist" containerID="74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11"
Jul 15 19:24:31.643474 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.643412    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11"} err="failed to get container status \"74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11\": rpc error: code = NotFound desc = could not find container \"74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11\": container with ID starting with 74e189daa9643e670ef3e7e68ae64958024ddc844cdaf684c9da3fae2bd97f11 not found: ID does not exist"
Jul 15 19:24:31.661866 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.661841    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"]
Jul 15 19:24:31.670051 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:31.670023    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-23ae53ab-openshift-default-59656fc9d7-4s6rl"]
Jul 15 19:24:32.339546 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:32.339512    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" path="/var/lib/kubelet/pods/fce800ec-3ee3-4569-8dfa-42411fef5d72/volumes"
Jul 15 19:24:46.171489 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171453    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"]
Jul 15 19:24:46.171891 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171848    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="704db709-1b5e-4a16-ac14-e81e7d691dea" containerName="revoke-keys"
Jul 15 19:24:46.171891 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171860    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="704db709-1b5e-4a16-ac14-e81e7d691dea" containerName="revoke-keys"
Jul 15 19:24:46.171891 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171876    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy"
Jul 15 19:24:46.171891 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171882    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy"
Jul 15 19:24:46.171891 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171890    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy"
Jul 15 19:24:46.171891 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171896    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy"
Jul 15 19:24:46.172109 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171963    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy"
Jul 15 19:24:46.172109 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171972    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce800ec-3ee3-4569-8dfa-42411fef5d72" containerName="istio-proxy"
Jul 15 19:24:46.172109 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.171981    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="704db709-1b5e-4a16-ac14-e81e7d691dea" containerName="revoke-keys"
Jul 15 19:24:46.175422 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.175404    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.183600 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.183579    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-52712cae-openshift-default-dockercfg-ppttd\""
Jul 15 19:24:46.198347 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.198317    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"]
Jul 15 19:24:46.267962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.267923    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-podinfo\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.268143 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.268026    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d332db0-78c7-4f39-bbff-f19c22a06a94-istiod-ca-cert\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.268143 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.268067    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-credential-socket\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.268143 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.268104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-envoy\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.268143 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.268139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-socket\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.268344 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.268178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-certs\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.268344 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.268215    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-data\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.268344 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.268304    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-token\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.268344 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.268337    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc554\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-kube-api-access-hc554\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.369460 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369428    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-socket\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.369654 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369469    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-certs\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.369654 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369492    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-data\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.369654 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-token\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.369654 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369579    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc554\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-kube-api-access-hc554\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.369654 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-podinfo\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.369918 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369695    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d332db0-78c7-4f39-bbff-f19c22a06a94-istiod-ca-cert\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.369918 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369723    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-credential-socket\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.369918 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-envoy\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.370083 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.369977    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-certs\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.370083 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.370005    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-socket\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.370083 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.370025    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-data\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.370245 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.370186    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-credential-socket\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.370497 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.370474    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d332db0-78c7-4f39-bbff-f19c22a06a94-istiod-ca-cert\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.371870 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.371844    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-envoy\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.372153 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.372135    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-podinfo\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.385637 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.385614    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-token\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.388910 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.388887    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc554\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-kube-api-access-hc554\") pod \"e2e-mt-52712cae-openshift-default-b64459d6c-74vwv\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") " pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.486040 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.485942    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:46.634888 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.634857    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"]
Jul 15 19:24:46.636591 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:24:46.636561    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d332db0_78c7_4f39_bbff_f19c22a06a94.slice/crio-ca32cf45b86147f1413202cbc8b7e9620f60572715f64a4bfe4f4abd5e02a673 WatchSource:0}: Error finding container ca32cf45b86147f1413202cbc8b7e9620f60572715f64a4bfe4f4abd5e02a673: Status 404 returned error can't find the container with id ca32cf45b86147f1413202cbc8b7e9620f60572715f64a4bfe4f4abd5e02a673
Jul 15 19:24:46.638659 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.638629    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:24:46.638731 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.638696    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:24:46.638775 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.638728    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:24:46.708441 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.708406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" event={"ID":"7d332db0-78c7-4f39-bbff-f19c22a06a94","Type":"ContainerStarted","Data":"008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669"}
Jul 15 19:24:46.708565 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.708473    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" event={"ID":"7d332db0-78c7-4f39-bbff-f19c22a06a94","Type":"ContainerStarted","Data":"ca32cf45b86147f1413202cbc8b7e9620f60572715f64a4bfe4f4abd5e02a673"}
Jul 15 19:24:46.741661 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:46.741540    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" podStartSLOduration=0.741514795 podStartE2EDuration="741.514795ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:24:46.737231339 +0000 UTC m=+2010.919004009" watchObservedRunningTime="2026-07-15 19:24:46.741514795 +0000 UTC m=+2010.923287466"
Jul 15 19:24:47.486230 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:47.486193    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:47.491086 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:47.491057    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:47.713941 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:47.713911    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:47.714970 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:47.714945    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:24:54.289583 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:24:54.289546    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:25:02.749392 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:02.748629    2571 patch_prober.go:28] interesting pod/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:45778->10.134.0.53:15021: read: connection reset by peer" start-of-body=
Jul 15 19:25:02.749392 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:02.748701    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:45778->10.134.0.53:15021: read: connection reset by peer"
Jul 15 19:25:03.804227 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:03.804190    2571 generic.go:356] "Generic (PLEG): container finished" podID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerID="008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669" exitCode=0
Jul 15 19:25:03.804727 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:03.804266    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" event={"ID":"7d332db0-78c7-4f39-bbff-f19c22a06a94","Type":"ContainerDied","Data":"008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669"}
Jul 15 19:25:03.804857 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:03.804838    2571 scope.go:117] "RemoveContainer" containerID="008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669"
Jul 15 19:25:03.805954 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:03.805925    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:25:03.806052 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:03.805996    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:25:03.806052 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:03.806029    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:25:04.696777 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:04.696739    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:25:04.813093 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:04.813047    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" event={"ID":"7d332db0-78c7-4f39-bbff-f19c22a06a94","Type":"ContainerStarted","Data":"325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc"}
Jul 15 19:25:05.486932 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:05.486890    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:25:05.487136 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:05.487068    2571 patch_prober.go:28] interesting pod/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 15 19:25:05.487213 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:05.487160    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 15 19:25:06.487013 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:06.486968    2571 patch_prober.go:28] interesting pod/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 15 19:25:06.487542 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:06.487051    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 15 19:25:07.487193 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:07.487144    2571 patch_prober.go:28] interesting pod/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 15 19:25:07.487697 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:07.487211    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 15 19:25:08.487179 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:08.487139    2571 patch_prober.go:28] interesting pod/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 15 19:25:08.487405 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:08.487199    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 15 19:25:09.489858 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:09.489822    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:25:09.490314 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:09.490138    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:25:09.490738 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:09.490720    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:25:41.087650 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:41.087564    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:25:47.155873 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.155833    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"]
Jul 15 19:25:47.158540 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.158522    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"
Jul 15 19:25:47.161331 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.161308    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:25:47.161635 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.161615    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:25:47.175565 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.175532    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"]
Jul 15 19:25:47.243258 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.243218    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-52712cae-qw4kl\" (UID: \"64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"
Jul 15 19:25:47.344593 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.344547    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-52712cae-qw4kl\" (UID: \"64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"
Jul 15 19:25:47.345184 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.345162    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-52712cae-qw4kl\" (UID: \"64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"
Jul 15 19:25:47.469712 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.469613    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"
Jul 15 19:25:47.833015 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:47.832898    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"]
Jul 15 19:25:47.835841 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:25:47.835806    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64afc338_8a2e_4d7e_b3f6_bb3c3593bb2d.slice/crio-14f5c6b5d07df2612529e2bdbbc071e846990a2f8b31a9647f6868a2b458007c WatchSource:0}: Error finding container 14f5c6b5d07df2612529e2bdbbc071e846990a2f8b31a9647f6868a2b458007c: Status 404 returned error can't find the container with id 14f5c6b5d07df2612529e2bdbbc071e846990a2f8b31a9647f6868a2b458007c
Jul 15 19:25:48.042887 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:48.042849    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl" event={"ID":"64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d","Type":"ContainerStarted","Data":"14f5c6b5d07df2612529e2bdbbc071e846990a2f8b31a9647f6868a2b458007c"}
Jul 15 19:25:49.050012 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:49.049977    2571 generic.go:356] "Generic (PLEG): container finished" podID="64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d" containerID="20fe938472ffeadb3f7e14812a3495a9f5657110f65a873ad4064acc153cc8b3" exitCode=0
Jul 15 19:25:49.050433 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:49.050067    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl" event={"ID":"64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d","Type":"ContainerDied","Data":"20fe938472ffeadb3f7e14812a3495a9f5657110f65a873ad4064acc153cc8b3"}
Jul 15 19:25:50.191386 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:50.191358    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"
Jul 15 19:25:50.270866 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:50.270830    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d-maas-api-service-ca\") pod \"64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d\" (UID: \"64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d\") "
Jul 15 19:25:50.271242 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:50.271222    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d" (UID: "64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:25:50.372270 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:50.372228    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:25:51.061935 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:51.061899    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl"
Jul 15 19:25:51.062106 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:51.061941    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52712cae-qw4kl" event={"ID":"64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d","Type":"ContainerDied","Data":"14f5c6b5d07df2612529e2bdbbc071e846990a2f8b31a9647f6868a2b458007c"}
Jul 15 19:25:51.062106 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:25:51.061992    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14f5c6b5d07df2612529e2bdbbc071e846990a2f8b31a9647f6868a2b458007c"
Jul 15 19:26:01.608016 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:26:01.607975    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:26:16.363927 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:26:16.363896    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:26:16.371401 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:26:16.371373    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:26:16.489066 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:26:16.489032    2571 scope.go:117] "RemoveContainer" containerID="92be4c20be3c4f4a44bcce7d391716782bdfffb019e1ffcdc0562d5d2332b40c"
Jul 15 19:27:04.662940 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:04.662900    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"]
Jul 15 19:27:04.663514 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:04.663201    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy" containerID="cri-o://325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc" gracePeriod=30
Jul 15 19:27:09.016840 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.016753    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:27:09.493156 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.493116    2571 patch_prober.go:28] interesting pod/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:27:09.493352 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.493184    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:27:09.924372 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.924331    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:27:09.929453 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929430    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-credential-socket\") pod \"7d332db0-78c7-4f39-bbff-f19c22a06a94\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") "
Jul 15 19:27:09.929588 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929465    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-envoy\") pod \"7d332db0-78c7-4f39-bbff-f19c22a06a94\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") "
Jul 15 19:27:09.929588 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929506    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-podinfo\") pod \"7d332db0-78c7-4f39-bbff-f19c22a06a94\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") "
Jul 15 19:27:09.929588 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929535    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-socket\") pod \"7d332db0-78c7-4f39-bbff-f19c22a06a94\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") "
Jul 15 19:27:09.929588 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929551    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-certs\") pod \"7d332db0-78c7-4f39-bbff-f19c22a06a94\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") "
Jul 15 19:27:09.929805 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929613    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc554\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-kube-api-access-hc554\") pod \"7d332db0-78c7-4f39-bbff-f19c22a06a94\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") "
Jul 15 19:27:09.929805 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929638    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-data\") pod \"7d332db0-78c7-4f39-bbff-f19c22a06a94\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") "
Jul 15 19:27:09.929805 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929663    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-token\") pod \"7d332db0-78c7-4f39-bbff-f19c22a06a94\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") "
Jul 15 19:27:09.929805 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929749    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d332db0-78c7-4f39-bbff-f19c22a06a94" (UID: "7d332db0-78c7-4f39-bbff-f19c22a06a94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:27:09.930034 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929845    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d332db0-78c7-4f39-bbff-f19c22a06a94" (UID: "7d332db0-78c7-4f39-bbff-f19c22a06a94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:27:09.930034 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929917    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d332db0-78c7-4f39-bbff-f19c22a06a94-istiod-ca-cert\") pod \"7d332db0-78c7-4f39-bbff-f19c22a06a94\" (UID: \"7d332db0-78c7-4f39-bbff-f19c22a06a94\") "
Jul 15 19:27:09.930034 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.929997    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d332db0-78c7-4f39-bbff-f19c22a06a94" (UID: "7d332db0-78c7-4f39-bbff-f19c22a06a94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:27:09.930309 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.930274    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:27:09.930397 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.930314    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:27:09.930397 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.930330    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:27:09.930507 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.930389    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d332db0-78c7-4f39-bbff-f19c22a06a94-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d332db0-78c7-4f39-bbff-f19c22a06a94" (UID: "7d332db0-78c7-4f39-bbff-f19c22a06a94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:27:09.930878 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.930848    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d332db0-78c7-4f39-bbff-f19c22a06a94" (UID: "7d332db0-78c7-4f39-bbff-f19c22a06a94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:27:09.931908 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.931885    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d332db0-78c7-4f39-bbff-f19c22a06a94" (UID: "7d332db0-78c7-4f39-bbff-f19c22a06a94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:27:09.932008 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.931928    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d332db0-78c7-4f39-bbff-f19c22a06a94" (UID: "7d332db0-78c7-4f39-bbff-f19c22a06a94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:27:09.932008 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.931965    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d332db0-78c7-4f39-bbff-f19c22a06a94" (UID: "7d332db0-78c7-4f39-bbff-f19c22a06a94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:27:09.932101 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:09.932082    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-kube-api-access-hc554" (OuterVolumeSpecName: "kube-api-access-hc554") pod "7d332db0-78c7-4f39-bbff-f19c22a06a94" (UID: "7d332db0-78c7-4f39-bbff-f19c22a06a94"). InnerVolumeSpecName "kube-api-access-hc554". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:27:10.030865 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.030757    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc554\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-kube-api-access-hc554\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:27:10.030865 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.030795    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:27:10.030865 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.030809    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:27:10.030865 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.030821    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d332db0-78c7-4f39-bbff-f19c22a06a94-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:27:10.030865 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.030832    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:27:10.030865 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.030843    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d332db0-78c7-4f39-bbff-f19c22a06a94-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:27:10.496403 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.496358    2571 generic.go:356] "Generic (PLEG): container finished" podID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerID="325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc" exitCode=0
Jul 15 19:27:10.496575 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.496410    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"
Jul 15 19:27:10.496575 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.496438    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" event={"ID":"7d332db0-78c7-4f39-bbff-f19c22a06a94","Type":"ContainerDied","Data":"325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc"}
Jul 15 19:27:10.496575 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.496499    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv" event={"ID":"7d332db0-78c7-4f39-bbff-f19c22a06a94","Type":"ContainerDied","Data":"ca32cf45b86147f1413202cbc8b7e9620f60572715f64a4bfe4f4abd5e02a673"}
Jul 15 19:27:10.496575 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.496523    2571 scope.go:117] "RemoveContainer" containerID="325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc"
Jul 15 19:27:10.506277 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.506258    2571 scope.go:117] "RemoveContainer" containerID="008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669"
Jul 15 19:27:10.514775 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.514755    2571 scope.go:117] "RemoveContainer" containerID="325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc"
Jul 15 19:27:10.515031 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:27:10.515011    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc\": container with ID starting with 325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc not found: ID does not exist" containerID="325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc"
Jul 15 19:27:10.515075 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.515039    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc"} err="failed to get container status \"325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc\": rpc error: code = NotFound desc = could not find container \"325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc\": container with ID starting with 325c9672dce8326aed3652d83703d6e57de891dcaeda6cd7a457b8d65e265cfc not found: ID does not exist"
Jul 15 19:27:10.515075 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.515056    2571 scope.go:117] "RemoveContainer" containerID="008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669"
Jul 15 19:27:10.515335 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:27:10.515317    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669\": container with ID starting with 008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669 not found: ID does not exist" containerID="008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669"
Jul 15 19:27:10.515382 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.515342    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669"} err="failed to get container status \"008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669\": rpc error: code = NotFound desc = could not find container \"008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669\": container with ID starting with 008982d7b2a77af1021e75d08b97afa39e9f070ca550fa38af89852caefdd669 not found: ID does not exist"
Jul 15 19:27:10.520078 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.520054    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"]
Jul 15 19:27:10.526010 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:10.525988    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-52712cae-openshift-default-b64459d6c-74vwv"]
Jul 15 19:27:12.338073 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:12.338027    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" path="/var/lib/kubelet/pods/7d332db0-78c7-4f39-bbff-f19c22a06a94/volumes"
Jul 15 19:27:16.510173 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:16.510134    2571 scope.go:117] "RemoveContainer" containerID="cf5a35ec0d188d7e1e7fa9bf8cfe01670ace83bac7378b16ecefe36a8b6752bb"
Jul 15 19:27:23.091492 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:27:23.091457    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:28:00.064405 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.064363    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"]
Jul 15 19:28:00.064996 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.064973    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy"
Jul 15 19:28:00.065082 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.064999    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy"
Jul 15 19:28:00.065082 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.065050    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d" containerName="revoke-keys"
Jul 15 19:28:00.065082 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.065060    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d" containerName="revoke-keys"
Jul 15 19:28:00.065234 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.065164    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d" containerName="revoke-keys"
Jul 15 19:28:00.065234 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.065179    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy"
Jul 15 19:28:00.065234 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.065190    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy"
Jul 15 19:28:00.068500 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.068475    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.071478 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.071454    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7b6049-openshift-default-dockercfg-75hhc\""
Jul 15 19:28:00.080082 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.080050    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"]
Jul 15 19:28:00.093554 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.093522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-istio-token\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.093703 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.093560    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-data\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.093703 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.093587    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jllp8\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-kube-api-access-jllp8\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.093703 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.093666    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-socket\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.093703 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.093686    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-certs\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.093858 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.093713    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-credential-socket\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.093858 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.093729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2c06c1-825c-4134-b19d-b589901aed47-istio-podinfo\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.093858 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.093759    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2c06c1-825c-4134-b19d-b589901aed47-istiod-ca-cert\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.093858 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.093788    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-envoy\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195159 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jllp8\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-kube-api-access-jllp8\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195378 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-socket\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195378 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195194    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-certs\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195378 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195216    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-credential-socket\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195378 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195234    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2c06c1-825c-4134-b19d-b589901aed47-istio-podinfo\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195378 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195257    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2c06c1-825c-4134-b19d-b589901aed47-istiod-ca-cert\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195378 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-envoy\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195378 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195369    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-istio-token\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195759 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195395    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-data\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195759 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195631    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-socket\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195759 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195653    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-certs\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195759 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195720    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-data\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.195908 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.195838    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-credential-socket\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.196133 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.196116    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2c06c1-825c-4134-b19d-b589901aed47-istiod-ca-cert\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.197569 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.197551    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-envoy\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.197785 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.197767    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2c06c1-825c-4134-b19d-b589901aed47-istio-podinfo\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.204039 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.204011    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-istio-token\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.204182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.204161    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jllp8\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-kube-api-access-jllp8\") pod \"e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") " pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.380186 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.380154    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:00.537052 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.537020    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"]
Jul 15 19:28:00.538024 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:28:00.537994    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2c06c1_825c_4134_b19d_b589901aed47.slice/crio-8b3bfe3521187732b453caa78a1a15d37335971a00bc7fb70da642a3ae19fc90 WatchSource:0}: Error finding container 8b3bfe3521187732b453caa78a1a15d37335971a00bc7fb70da642a3ae19fc90: Status 404 returned error can't find the container with id 8b3bfe3521187732b453caa78a1a15d37335971a00bc7fb70da642a3ae19fc90
Jul 15 19:28:00.540530 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.540497    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:00.540634 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.540566    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:00.540634 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.540595    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:00.757049 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.756948    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" event={"ID":"6c2c06c1-825c-4134-b19d-b589901aed47","Type":"ContainerStarted","Data":"39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d"}
Jul 15 19:28:00.757049 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.757014    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" event={"ID":"6c2c06c1-825c-4134-b19d-b589901aed47","Type":"ContainerStarted","Data":"8b3bfe3521187732b453caa78a1a15d37335971a00bc7fb70da642a3ae19fc90"}
Jul 15 19:28:00.777440 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:00.777387    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" podStartSLOduration=0.777368677 podStartE2EDuration="777.368677ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:28:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:28:00.776485239 +0000 UTC m=+2204.958257911" watchObservedRunningTime="2026-07-15 19:28:00.777368677 +0000 UTC m=+2204.959141347"
Jul 15 19:28:01.380754 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:01.380710    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:01.386058 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:01.386027    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:01.762001 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:01.761900    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:01.762856 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:01.762835    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:07.904773 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.904737    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"]
Jul 15 19:28:07.905179 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.905164    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy"
Jul 15 19:28:07.905179 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.905180    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d332db0-78c7-4f39-bbff-f19c22a06a94" containerName="istio-proxy"
Jul 15 19:28:07.908771 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.908749    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:07.911861 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.911839    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1dfe1f-openshift-default-dockercfg-7bjff\""
Jul 15 19:28:07.923799 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.923767    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"]
Jul 15 19:28:07.973455 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.973417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-certs\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:07.973617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.973500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-envoy\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:07.973617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.973552    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-credential-socket\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:07.973617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.973588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-socket\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:07.973729 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.973681    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzn97\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-kube-api-access-lzn97\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:07.973768 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.973722    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istiod-ca-cert\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:07.973768 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.973752    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-token\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:07.973830 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.973791    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-data\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:07.973865 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:07.973831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-podinfo\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074476 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074439    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-podinfo\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074690 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074501    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-certs\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074690 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-envoy\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074690 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-credential-socket\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074690 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074637    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-socket\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074690 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074672    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzn97\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-kube-api-access-lzn97\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074945 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istiod-ca-cert\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074945 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-token\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074945 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-data\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.074945 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074903    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-certs\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.075155 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.074996    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-credential-socket\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.075155 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.075041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-socket\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.075155 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.075089    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-data\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.075568 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.075551    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istiod-ca-cert\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.076856 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.076828    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-envoy\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.076989 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.076927    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-podinfo\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.083826 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.083796    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-token\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.083952 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.083874    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzn97\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-kube-api-access-lzn97\") pod \"e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") " pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.220155 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.220052    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:08.372419 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.372383    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"]
Jul 15 19:28:08.373969 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:28:08.373935    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf89b4b8_61ac_4d2e_9c85_460d43d8863c.slice/crio-00272430ca49eabbc04a2ad452fbc3734fed92b32c6505a716ebe2c87151bab8 WatchSource:0}: Error finding container 00272430ca49eabbc04a2ad452fbc3734fed92b32c6505a716ebe2c87151bab8: Status 404 returned error can't find the container with id 00272430ca49eabbc04a2ad452fbc3734fed92b32c6505a716ebe2c87151bab8
Jul 15 19:28:08.376170 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.376136    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:08.376254 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.376199    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:08.376254 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.376249    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:08.800341 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.800300    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" event={"ID":"bf89b4b8-61ac-4d2e-9c85-460d43d8863c","Type":"ContainerStarted","Data":"490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec"}
Jul 15 19:28:08.800515 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.800399    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" event={"ID":"bf89b4b8-61ac-4d2e-9c85-460d43d8863c","Type":"ContainerStarted","Data":"00272430ca49eabbc04a2ad452fbc3734fed92b32c6505a716ebe2c87151bab8"}
Jul 15 19:28:08.831363 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:08.831273    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" podStartSLOduration=1.831256577 podStartE2EDuration="1.831256577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:28:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:28:08.82832718 +0000 UTC m=+2213.010099855" watchObservedRunningTime="2026-07-15 19:28:08.831256577 +0000 UTC m=+2213.013029249"
Jul 15 19:28:09.220444 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:09.220391    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:09.225335 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:09.225308    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:09.805209 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:09.805167    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:09.806204 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:09.806180    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:10.203461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:10.203420    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:28:17.803497 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:17.803455    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 19:28:17.803900 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:17.803518    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 19:28:18.855306 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:18.855251    2571 generic.go:356] "Generic (PLEG): container finished" podID="6c2c06c1-825c-4134-b19d-b589901aed47" containerID="39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d" exitCode=0
Jul 15 19:28:18.855745 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:18.855322    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" event={"ID":"6c2c06c1-825c-4134-b19d-b589901aed47","Type":"ContainerDied","Data":"39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d"}
Jul 15 19:28:18.855792 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:18.855746    2571 scope.go:117] "RemoveContainer" containerID="39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d"
Jul 15 19:28:18.856767 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:18.856734    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:18.856885 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:18.856821    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:18.856885 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:18.856872    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:19.865196 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:19.865150    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" event={"ID":"6c2c06c1-825c-4134-b19d-b589901aed47","Type":"ContainerStarted","Data":"84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931"}
Jul 15 19:28:20.380525 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:20.380486    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:20.380830 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:20.380805    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 15 19:28:20.380891 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:20.380859    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 15 19:28:21.381133 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:21.380659    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 15 19:28:21.381133 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:21.380744    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 15 19:28:22.380946 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:22.380895    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 15 19:28:22.381171 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:22.380968    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 15 19:28:23.380687 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:23.380638    2571 patch_prober.go:28] interesting pod/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 15 19:28:23.380915 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:23.380710    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 15 19:28:23.709409 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:23.709322    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:28:24.384984 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:24.384952    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:24.385357 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:24.385333    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:24.385998 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:24.385977    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:28:25.805600 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:25.805552    2571 patch_prober.go:28] interesting pod/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 19:28:25.805989 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:25.805629    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 19:28:27.927322 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:27.927262    2571 generic.go:356] "Generic (PLEG): container finished" podID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerID="490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec" exitCode=0
Jul 15 19:28:27.927852 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:27.927340    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" event={"ID":"bf89b4b8-61ac-4d2e-9c85-460d43d8863c","Type":"ContainerDied","Data":"490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec"}
Jul 15 19:28:27.927926 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:27.927906    2571 scope.go:117] "RemoveContainer" containerID="490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec"
Jul 15 19:28:27.928961 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:27.928927    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:27.929072 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:27.928995    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:27.929072 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:27.929027    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:28:28.936263 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:28.936219    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" event={"ID":"bf89b4b8-61ac-4d2e-9c85-460d43d8863c","Type":"ContainerStarted","Data":"7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c"}
Jul 15 19:28:29.221096 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:29.221019    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:29.221248 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:29.221163    2571 patch_prober.go:28] interesting pod/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 15 19:28:29.221248 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:29.221208    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 15 19:28:30.220515 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:30.220480    2571 patch_prober.go:28] interesting pod/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 15 19:28:30.220919 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:30.220550    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 15 19:28:31.220514 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:31.220477    2571 patch_prober.go:28] interesting pod/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 15 19:28:31.220762 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:31.220533    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 15 19:28:32.220738 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:32.220705    2571 patch_prober.go:28] interesting pod/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 15 19:28:32.220936 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:32.220763    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 15 19:28:33.224713 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:33.224679    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:33.225194 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:33.225095    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:33.225826 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:33.225807    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:28:39.397026 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:39.396941    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:28:50.900893 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:28:50.900849    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:29:04.811173 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:04.811133    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"]
Jul 15 19:29:04.817098 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:04.817064    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"
Jul 15 19:29:04.821754 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:04.821690    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:29:04.822071 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:04.822040    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:29:04.824722 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:04.824698    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"]
Jul 15 19:29:04.963819 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:04.963775    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0925398a-a1fb-482e-a059-70816d254656-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p\" (UID: \"0925398a-a1fb-482e-a059-70816d254656\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"
Jul 15 19:29:05.064833 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:05.064750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0925398a-a1fb-482e-a059-70816d254656-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p\" (UID: \"0925398a-a1fb-482e-a059-70816d254656\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"
Jul 15 19:29:05.065430 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:05.065412    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0925398a-a1fb-482e-a059-70816d254656-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p\" (UID: \"0925398a-a1fb-482e-a059-70816d254656\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"
Jul 15 19:29:05.130646 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:05.130610    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"
Jul 15 19:29:05.266030 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:05.265998    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"]
Jul 15 19:29:05.267821 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:29:05.267789    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0925398a_a1fb_482e_a059_70816d254656.slice/crio-f4163bb710a644484d8ad1c54fcc7273cc28a798951ca21506bee4e572f3b01f WatchSource:0}: Error finding container f4163bb710a644484d8ad1c54fcc7273cc28a798951ca21506bee4e572f3b01f: Status 404 returned error can't find the container with id f4163bb710a644484d8ad1c54fcc7273cc28a798951ca21506bee4e572f3b01f
Jul 15 19:29:06.144755 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:06.144717    2571 generic.go:356] "Generic (PLEG): container finished" podID="0925398a-a1fb-482e-a059-70816d254656" containerID="cdf6e13c82ee18d50410b151237a0c9cc52d42849a3e7c9093c88fbc1280f2c8" exitCode=0
Jul 15 19:29:06.145115 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:06.144797    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p" event={"ID":"0925398a-a1fb-482e-a059-70816d254656","Type":"ContainerDied","Data":"cdf6e13c82ee18d50410b151237a0c9cc52d42849a3e7c9093c88fbc1280f2c8"}
Jul 15 19:29:06.145115 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:06.144854    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p" event={"ID":"0925398a-a1fb-482e-a059-70816d254656","Type":"ContainerStarted","Data":"f4163bb710a644484d8ad1c54fcc7273cc28a798951ca21506bee4e572f3b01f"}
Jul 15 19:29:07.285520 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:07.285496    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"
Jul 15 19:29:07.389117 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:07.389078    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0925398a-a1fb-482e-a059-70816d254656-maas-api-service-ca\") pod \"0925398a-a1fb-482e-a059-70816d254656\" (UID: \"0925398a-a1fb-482e-a059-70816d254656\") "
Jul 15 19:29:07.389490 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:07.389464    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0925398a-a1fb-482e-a059-70816d254656-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0925398a-a1fb-482e-a059-70816d254656" (UID: "0925398a-a1fb-482e-a059-70816d254656"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:29:07.490303 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:07.490202    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0925398a-a1fb-482e-a059-70816d254656-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:08.158751 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:08.158708    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p" event={"ID":"0925398a-a1fb-482e-a059-70816d254656","Type":"ContainerDied","Data":"f4163bb710a644484d8ad1c54fcc7273cc28a798951ca21506bee4e572f3b01f"}
Jul 15 19:29:08.158944 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:08.158767    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4163bb710a644484d8ad1c54fcc7273cc28a798951ca21506bee4e572f3b01f"
Jul 15 19:29:08.158944 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:08.158727    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p"
Jul 15 19:29:09.200885 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:09.200847    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:29:20.000444 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:20.000402    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:29:30.598061 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.598026    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"]
Jul 15 19:29:30.598584 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.598225    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy" containerID="cri-o://84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931" gracePeriod=30
Jul 15 19:29:30.969615 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.969525    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"]
Jul 15 19:29:30.969957 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.969945    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0925398a-a1fb-482e-a059-70816d254656" containerName="revoke-keys"
Jul 15 19:29:30.970011 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.969959    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0925398a-a1fb-482e-a059-70816d254656" containerName="revoke-keys"
Jul 15 19:29:30.970046 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.970036    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0925398a-a1fb-482e-a059-70816d254656" containerName="revoke-keys"
Jul 15 19:29:30.973221 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.973203    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"
Jul 15 19:29:30.976154 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.976129    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:29:30.976329 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.976178    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:29:30.980210 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:30.980183    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"]
Jul 15 19:29:31.114983 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:31.114944    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c71f8a3-a75b-4da7-a42f-04afa8ba4d73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd\" (UID: \"9c71f8a3-a75b-4da7-a42f-04afa8ba4d73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"
Jul 15 19:29:31.216096 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:31.216054    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c71f8a3-a75b-4da7-a42f-04afa8ba4d73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd\" (UID: \"9c71f8a3-a75b-4da7-a42f-04afa8ba4d73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"
Jul 15 19:29:31.216743 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:31.216721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c71f8a3-a75b-4da7-a42f-04afa8ba4d73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd\" (UID: \"9c71f8a3-a75b-4da7-a42f-04afa8ba4d73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"
Jul 15 19:29:31.285987 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:31.285895    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"
Jul 15 19:29:31.422332 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:31.422307    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"]
Jul 15 19:29:31.424785 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:29:31.424755    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c71f8a3_a75b_4da7_a42f_04afa8ba4d73.slice/crio-4d75dc3e9aa7e8b69ebc254288225c61e81e1c23bceee2fea08f5b82ce2116f0 WatchSource:0}: Error finding container 4d75dc3e9aa7e8b69ebc254288225c61e81e1c23bceee2fea08f5b82ce2116f0: Status 404 returned error can't find the container with id 4d75dc3e9aa7e8b69ebc254288225c61e81e1c23bceee2fea08f5b82ce2116f0
Jul 15 19:29:32.311152 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:32.311113    2571 generic.go:356] "Generic (PLEG): container finished" podID="9c71f8a3-a75b-4da7-a42f-04afa8ba4d73" containerID="7235f9d00f3cb6f29c56d6b3bf5aa7cd356a827954ee1c729b85decf37994232" exitCode=0
Jul 15 19:29:32.311564 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:32.311194    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd" event={"ID":"9c71f8a3-a75b-4da7-a42f-04afa8ba4d73","Type":"ContainerDied","Data":"7235f9d00f3cb6f29c56d6b3bf5aa7cd356a827954ee1c729b85decf37994232"}
Jul 15 19:29:32.311564 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:32.311308    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd" event={"ID":"9c71f8a3-a75b-4da7-a42f-04afa8ba4d73","Type":"ContainerStarted","Data":"4d75dc3e9aa7e8b69ebc254288225c61e81e1c23bceee2fea08f5b82ce2116f0"}
Jul 15 19:29:33.452358 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:33.452330    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"
Jul 15 19:29:33.539431 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:33.539389    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c71f8a3-a75b-4da7-a42f-04afa8ba4d73-maas-api-service-ca\") pod \"9c71f8a3-a75b-4da7-a42f-04afa8ba4d73\" (UID: \"9c71f8a3-a75b-4da7-a42f-04afa8ba4d73\") "
Jul 15 19:29:33.539758 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:33.539734    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c71f8a3-a75b-4da7-a42f-04afa8ba4d73-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c71f8a3-a75b-4da7-a42f-04afa8ba4d73" (UID: "9c71f8a3-a75b-4da7-a42f-04afa8ba4d73"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:29:33.640897 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:33.640816    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c71f8a3-a75b-4da7-a42f-04afa8ba4d73-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:34.324096 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:34.324064    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd"
Jul 15 19:29:34.324096 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:34.324090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd" event={"ID":"9c71f8a3-a75b-4da7-a42f-04afa8ba4d73","Type":"ContainerDied","Data":"4d75dc3e9aa7e8b69ebc254288225c61e81e1c23bceee2fea08f5b82ce2116f0"}
Jul 15 19:29:34.324325 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:34.324136    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d75dc3e9aa7e8b69ebc254288225c61e81e1c23bceee2fea08f5b82ce2116f0"
Jul 15 19:29:35.863757 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.863733    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:29:35.966352 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966313    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2c06c1-825c-4134-b19d-b589901aed47-istiod-ca-cert\") pod \"6c2c06c1-825c-4134-b19d-b589901aed47\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") "
Jul 15 19:29:35.966352 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966358    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-socket\") pod \"6c2c06c1-825c-4134-b19d-b589901aed47\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") "
Jul 15 19:29:35.966617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966378    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-data\") pod \"6c2c06c1-825c-4134-b19d-b589901aed47\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") "
Jul 15 19:29:35.966617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966396    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-envoy\") pod \"6c2c06c1-825c-4134-b19d-b589901aed47\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") "
Jul 15 19:29:35.966617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966423    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-credential-socket\") pod \"6c2c06c1-825c-4134-b19d-b589901aed47\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") "
Jul 15 19:29:35.966617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966485    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2c06c1-825c-4134-b19d-b589901aed47-istio-podinfo\") pod \"6c2c06c1-825c-4134-b19d-b589901aed47\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") "
Jul 15 19:29:35.966617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966509    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jllp8\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-kube-api-access-jllp8\") pod \"6c2c06c1-825c-4134-b19d-b589901aed47\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") "
Jul 15 19:29:35.966617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966538    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-istio-token\") pod \"6c2c06c1-825c-4134-b19d-b589901aed47\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") "
Jul 15 19:29:35.966617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966573    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-certs\") pod \"6c2c06c1-825c-4134-b19d-b589901aed47\" (UID: \"6c2c06c1-825c-4134-b19d-b589901aed47\") "
Jul 15 19:29:35.966987 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966776    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c2c06c1-825c-4134-b19d-b589901aed47" (UID: "6c2c06c1-825c-4134-b19d-b589901aed47"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:29:35.967052 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966976    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:35.967052 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966984    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c2c06c1-825c-4134-b19d-b589901aed47" (UID: "6c2c06c1-825c-4134-b19d-b589901aed47"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:29:35.967052 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.966784    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c2c06c1-825c-4134-b19d-b589901aed47-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c2c06c1-825c-4134-b19d-b589901aed47" (UID: "6c2c06c1-825c-4134-b19d-b589901aed47"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:29:35.967196 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.967125    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c2c06c1-825c-4134-b19d-b589901aed47" (UID: "6c2c06c1-825c-4134-b19d-b589901aed47"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:29:35.967364 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.967339    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c2c06c1-825c-4134-b19d-b589901aed47" (UID: "6c2c06c1-825c-4134-b19d-b589901aed47"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:29:35.968825 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.968793    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c2c06c1-825c-4134-b19d-b589901aed47" (UID: "6c2c06c1-825c-4134-b19d-b589901aed47"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:29:35.968936 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.968901    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c2c06c1-825c-4134-b19d-b589901aed47-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c2c06c1-825c-4134-b19d-b589901aed47" (UID: "6c2c06c1-825c-4134-b19d-b589901aed47"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:29:35.969077 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.969054    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c2c06c1-825c-4134-b19d-b589901aed47" (UID: "6c2c06c1-825c-4134-b19d-b589901aed47"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:29:35.969166 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:35.969056    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-kube-api-access-jllp8" (OuterVolumeSpecName: "kube-api-access-jllp8") pod "6c2c06c1-825c-4134-b19d-b589901aed47" (UID: "6c2c06c1-825c-4134-b19d-b589901aed47"). InnerVolumeSpecName "kube-api-access-jllp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:29:36.067520 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.067474    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2c06c1-825c-4134-b19d-b589901aed47-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:36.067520 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.067513    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jllp8\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-kube-api-access-jllp8\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:36.067520 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.067526    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2c06c1-825c-4134-b19d-b589901aed47-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:36.067775 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.067539    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:36.067775 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.067551    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2c06c1-825c-4134-b19d-b589901aed47-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:36.067775 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.067562    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:36.067775 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.067573    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:36.067775 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.067583    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2c06c1-825c-4134-b19d-b589901aed47-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:29:36.338151 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.338113    2571 generic.go:356] "Generic (PLEG): container finished" podID="6c2c06c1-825c-4134-b19d-b589901aed47" containerID="84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931" exitCode=0
Jul 15 19:29:36.338389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.338292    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"
Jul 15 19:29:36.340211 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.340182    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" event={"ID":"6c2c06c1-825c-4134-b19d-b589901aed47","Type":"ContainerDied","Data":"84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931"}
Jul 15 19:29:36.340348 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.340241    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx" event={"ID":"6c2c06c1-825c-4134-b19d-b589901aed47","Type":"ContainerDied","Data":"8b3bfe3521187732b453caa78a1a15d37335971a00bc7fb70da642a3ae19fc90"}
Jul 15 19:29:36.340348 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.340276    2571 scope.go:117] "RemoveContainer" containerID="84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931"
Jul 15 19:29:36.350215 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.350198    2571 scope.go:117] "RemoveContainer" containerID="39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d"
Jul 15 19:29:36.358447 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.358424    2571 scope.go:117] "RemoveContainer" containerID="84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931"
Jul 15 19:29:36.358736 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:29:36.358718    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931\": container with ID starting with 84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931 not found: ID does not exist" containerID="84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931"
Jul 15 19:29:36.358811 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.358749    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931"} err="failed to get container status \"84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931\": rpc error: code = NotFound desc = could not find container \"84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931\": container with ID starting with 84b6c6fa1bb3849bcf675f5d1b07bbd07a6f65b8cc2a851f92b7d6ae8e210931 not found: ID does not exist"
Jul 15 19:29:36.358811 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.358774    2571 scope.go:117] "RemoveContainer" containerID="39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d"
Jul 15 19:29:36.359026 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:29:36.359008    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d\": container with ID starting with 39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d not found: ID does not exist" containerID="39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d"
Jul 15 19:29:36.359079 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.359031    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d"} err="failed to get container status \"39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d\": rpc error: code = NotFound desc = could not find container \"39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d\": container with ID starting with 39b6baa222779ea926d453379a40667db405a4423f39b440f67d62827f7a115d not found: ID does not exist"
Jul 15 19:29:36.365178 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.365152    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"]
Jul 15 19:29:36.369115 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:36.369093    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7b6049-openshift-default-65bfb4c585-brqzx"]
Jul 15 19:29:38.337843 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:38.337809    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" path="/var/lib/kubelet/pods/6c2c06c1-825c-4134-b19d-b589901aed47/volumes"
Jul 15 19:29:44.596436 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:44.596398    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:29:56.754437 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:56.754396    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"]
Jul 15 19:29:56.754861 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:56.754662    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy" containerID="cri-o://7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c" gracePeriod=30
Jul 15 19:29:57.635095 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.635063    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"]
Jul 15 19:29:57.635503 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.635489    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c71f8a3-a75b-4da7-a42f-04afa8ba4d73" containerName="revoke-keys"
Jul 15 19:29:57.635503 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.635504    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c71f8a3-a75b-4da7-a42f-04afa8ba4d73" containerName="revoke-keys"
Jul 15 19:29:57.635602 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.635529    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy"
Jul 15 19:29:57.635602 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.635536    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy"
Jul 15 19:29:57.635602 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.635551    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy"
Jul 15 19:29:57.635602 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.635557    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy"
Jul 15 19:29:57.635726 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.635620    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy"
Jul 15 19:29:57.635726 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.635633    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c71f8a3-a75b-4da7-a42f-04afa8ba4d73" containerName="revoke-keys"
Jul 15 19:29:57.642733 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.642690    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.645759 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.645734    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-67b35f-openshift-default-dockercfg-dbhrm\""
Jul 15 19:29:57.651914 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.651609    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"]
Jul 15 19:29:57.668538 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.668495    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-envoy\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.668687 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.668552    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istiod-ca-cert\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.668687 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.668626    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-certs\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.668687 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.668656    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-socket\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.668811 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.668691    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-259bs\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-kube-api-access-259bs\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.668811 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.668767    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-credential-socket\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.668811 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.668800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-token\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.668923 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.668843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-data\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.668923 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.668905    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-podinfo\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.769959 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.769918    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-socket\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.769959 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.769964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-259bs\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-kube-api-access-259bs\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.769996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-credential-socket\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-token\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770048    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-data\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770069    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-podinfo\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770103    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-envoy\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istiod-ca-cert\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-certs\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770415    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-socket\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770453    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-data\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770921 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-credential-socket\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.770921 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770734    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-certs\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.771003 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.770986    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istiod-ca-cert\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.772392 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.772372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-envoy\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.772653 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.772633    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-podinfo\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.778478 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.778457    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-token\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.778654 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.778637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-259bs\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-kube-api-access-259bs\") pod \"e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") " pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:57.956660 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:57.956564    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:58.105862 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:58.105833    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"]
Jul 15 19:29:58.108082 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:29:58.108047    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced7fc75_47c1_4e35_aaf5_3afd96ac7ebf.slice/crio-7c0c1e2435956e4bf66340698f51e3c64480d38a9da82a22028939429bc9541d WatchSource:0}: Error finding container 7c0c1e2435956e4bf66340698f51e3c64480d38a9da82a22028939429bc9541d: Status 404 returned error can't find the container with id 7c0c1e2435956e4bf66340698f51e3c64480d38a9da82a22028939429bc9541d
Jul 15 19:29:58.110184 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:58.110152    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:29:58.110256 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:58.110218    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:29:58.110256 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:58.110246    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:29:58.462665 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:58.462614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" event={"ID":"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf","Type":"ContainerStarted","Data":"b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f"}
Jul 15 19:29:58.462840 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:58.462680    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" event={"ID":"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf","Type":"ContainerStarted","Data":"7c0c1e2435956e4bf66340698f51e3c64480d38a9da82a22028939429bc9541d"}
Jul 15 19:29:58.482779 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:58.482729    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" podStartSLOduration=1.482712847 podStartE2EDuration="1.482712847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:29:58.481523685 +0000 UTC m=+2322.663296357" watchObservedRunningTime="2026-07-15 19:29:58.482712847 +0000 UTC m=+2322.664485517"
Jul 15 19:29:58.957561 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:58.957524    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:29:59.962310 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:29:59.962266    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:30:00.473248 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:00.473215    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:30:00.474103 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:00.474085    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:30:02.045981 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.045913    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:30:02.114207 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114179    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-credential-socket\") pod \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") "
Jul 15 19:30:02.114396 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114217    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istiod-ca-cert\") pod \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") "
Jul 15 19:30:02.114396 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114239    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-token\") pod \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") "
Jul 15 19:30:02.114396 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114305    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzn97\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-kube-api-access-lzn97\") pod \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") "
Jul 15 19:30:02.114396 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114373    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-envoy\") pod \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") "
Jul 15 19:30:02.114621 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114398    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-data\") pod \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") "
Jul 15 19:30:02.114621 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114453    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-certs\") pod \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") "
Jul 15 19:30:02.114621 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114486    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf89b4b8-61ac-4d2e-9c85-460d43d8863c" (UID: "bf89b4b8-61ac-4d2e-9c85-460d43d8863c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:02.114621 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114528    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-podinfo\") pod \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") "
Jul 15 19:30:02.114621 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114557    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-socket\") pod \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\" (UID: \"bf89b4b8-61ac-4d2e-9c85-460d43d8863c\") "
Jul 15 19:30:02.114879 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114659    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf89b4b8-61ac-4d2e-9c85-460d43d8863c" (UID: "bf89b4b8-61ac-4d2e-9c85-460d43d8863c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:02.114879 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114698    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf89b4b8-61ac-4d2e-9c85-460d43d8863c" (UID: "bf89b4b8-61ac-4d2e-9c85-460d43d8863c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:30:02.114879 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114832    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf89b4b8-61ac-4d2e-9c85-460d43d8863c" (UID: "bf89b4b8-61ac-4d2e-9c85-460d43d8863c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:02.115031 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114925    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:02.115031 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114942    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:02.115031 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114954    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:02.115031 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.114967    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:02.115391 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.115358    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf89b4b8-61ac-4d2e-9c85-460d43d8863c" (UID: "bf89b4b8-61ac-4d2e-9c85-460d43d8863c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:02.116818 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.116795    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf89b4b8-61ac-4d2e-9c85-460d43d8863c" (UID: "bf89b4b8-61ac-4d2e-9c85-460d43d8863c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:30:02.116929 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.116849    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf89b4b8-61ac-4d2e-9c85-460d43d8863c" (UID: "bf89b4b8-61ac-4d2e-9c85-460d43d8863c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:30:02.116979 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.116950    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf89b4b8-61ac-4d2e-9c85-460d43d8863c" (UID: "bf89b4b8-61ac-4d2e-9c85-460d43d8863c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:02.117053 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.117040    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-kube-api-access-lzn97" (OuterVolumeSpecName: "kube-api-access-lzn97") pod "bf89b4b8-61ac-4d2e-9c85-460d43d8863c" (UID: "bf89b4b8-61ac-4d2e-9c85-460d43d8863c"). InnerVolumeSpecName "kube-api-access-lzn97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:30:02.215685 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.215644    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:02.215685 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.215677    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:02.215685 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.215686    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:02.215685 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.215695    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:02.215957 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.215705    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzn97\" (UniqueName: \"kubernetes.io/projected/bf89b4b8-61ac-4d2e-9c85-460d43d8863c-kube-api-access-lzn97\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:02.485398 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.485357    2571 generic.go:356] "Generic (PLEG): container finished" podID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerID="7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c" exitCode=0
Jul 15 19:30:02.485596 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.485408    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"
Jul 15 19:30:02.485596 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.485449    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" event={"ID":"bf89b4b8-61ac-4d2e-9c85-460d43d8863c","Type":"ContainerDied","Data":"7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c"}
Jul 15 19:30:02.485596 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.485509    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl" event={"ID":"bf89b4b8-61ac-4d2e-9c85-460d43d8863c","Type":"ContainerDied","Data":"00272430ca49eabbc04a2ad452fbc3734fed92b32c6505a716ebe2c87151bab8"}
Jul 15 19:30:02.485596 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.485538    2571 scope.go:117] "RemoveContainer" containerID="7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c"
Jul 15 19:30:02.501253 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.501230    2571 scope.go:117] "RemoveContainer" containerID="490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec"
Jul 15 19:30:02.505323 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.505271    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"]
Jul 15 19:30:02.509947 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.509915    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1dfe1f-openshift-default-6867984497-8klvl"]
Jul 15 19:30:02.511461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.511429    2571 scope.go:117] "RemoveContainer" containerID="7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c"
Jul 15 19:30:02.511761 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:30:02.511743    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c\": container with ID starting with 7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c not found: ID does not exist" containerID="7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c"
Jul 15 19:30:02.511809 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.511770    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c"} err="failed to get container status \"7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c\": rpc error: code = NotFound desc = could not find container \"7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c\": container with ID starting with 7033367a1de6e10f1da324e458145f4f1158da38e77b872686eecafc68e90d5c not found: ID does not exist"
Jul 15 19:30:02.511809 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.511788    2571 scope.go:117] "RemoveContainer" containerID="490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec"
Jul 15 19:30:02.512009 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:30:02.511987    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec\": container with ID starting with 490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec not found: ID does not exist" containerID="490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec"
Jul 15 19:30:02.512074 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:02.512020    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec"} err="failed to get container status \"490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec\": rpc error: code = NotFound desc = could not find container \"490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec\": container with ID starting with 490efb07ba8218c916ca1f61a83bfadb46363fb0ee84f3e8071f2e9e80272fec not found: ID does not exist"
Jul 15 19:30:04.340043 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:04.340007    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" path="/var/lib/kubelet/pods/bf89b4b8-61ac-4d2e-9c85-460d43d8863c/volumes"
Jul 15 19:30:05.494359 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.494323    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:30:05.807848 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.807773    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"]
Jul 15 19:30:05.808182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.808170    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy"
Jul 15 19:30:05.808233 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.808184    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy"
Jul 15 19:30:05.808233 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.808197    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy"
Jul 15 19:30:05.808233 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.808202    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy"
Jul 15 19:30:05.808350 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.808274    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c2c06c1-825c-4134-b19d-b589901aed47" containerName="istio-proxy"
Jul 15 19:30:05.808350 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.808297    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy"
Jul 15 19:30:05.808350 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.808305    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf89b4b8-61ac-4d2e-9c85-460d43d8863c" containerName="istio-proxy"
Jul 15 19:30:05.812968 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.812946    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.816261 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.816240    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-97fde9-openshift-default-dockercfg-jq465\""
Jul 15 19:30:05.827929 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.827905    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"]
Jul 15 19:30:05.852622 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.852587    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-certs\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.852816 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.852650    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-data\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.852816 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.852687    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-credential-socket\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.852816 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.852754    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-envoy\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.852816 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.852799    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wlcx\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-kube-api-access-8wlcx\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.853054 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.852851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-podinfo\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.853054 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.852870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-token\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.853054 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.852887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istiod-ca-cert\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.853054 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.852904    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-socket\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954166 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-data\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-credential-socket\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954206    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-envoy\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954231    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wlcx\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-kube-api-access-8wlcx\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954262    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-podinfo\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954305    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-token\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istiod-ca-cert\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-socket\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954753 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-certs\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954753 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-data\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954753 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954663    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-credential-socket\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954917 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954774    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-certs\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.954917 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.954893    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-socket\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.955340 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.955313    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istiod-ca-cert\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.956726 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.956698    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-envoy\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.956919 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.956900    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-podinfo\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.963538 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.963511    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-token\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:05.963643 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:05.963629    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wlcx\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-kube-api-access-8wlcx\") pod \"e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") " pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:06.124113 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:06.124060    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:06.271234 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:06.271205    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"]
Jul 15 19:30:06.272936 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:30:06.272908    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec8e49f_e18e_4d6c_ade5_e774ebb8d179.slice/crio-b8166369bb83efb6c41672792c2abd790c388a4e7cf7264431929f0f0aa77c94 WatchSource:0}: Error finding container b8166369bb83efb6c41672792c2abd790c388a4e7cf7264431929f0f0aa77c94: Status 404 returned error can't find the container with id b8166369bb83efb6c41672792c2abd790c388a4e7cf7264431929f0f0aa77c94
Jul 15 19:30:06.275241 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:06.275194    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:30:06.275350 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:06.275332    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:30:06.275431 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:06.275413    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:30:06.511062 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:06.510961    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" event={"ID":"eec8e49f-e18e-4d6c-ade5-e774ebb8d179","Type":"ContainerStarted","Data":"641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be"}
Jul 15 19:30:06.511062 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:06.511025    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" event={"ID":"eec8e49f-e18e-4d6c-ade5-e774ebb8d179","Type":"ContainerStarted","Data":"b8166369bb83efb6c41672792c2abd790c388a4e7cf7264431929f0f0aa77c94"}
Jul 15 19:30:07.124257 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:07.124225    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:07.129321 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:07.129272    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:07.151653 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:07.151574    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" podStartSLOduration=2.151554436 podStartE2EDuration="2.151554436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:06.537537815 +0000 UTC m=+2330.719310486" watchObservedRunningTime="2026-07-15 19:30:07.151554436 +0000 UTC m=+2331.333327104"
Jul 15 19:30:07.516849 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:07.516756    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:07.517675 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:07.517651    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:13.555036 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:13.554947    2571 generic.go:356] "Generic (PLEG): container finished" podID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerID="b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f" exitCode=0
Jul 15 19:30:13.555570 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:13.555026    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" event={"ID":"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf","Type":"ContainerDied","Data":"b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f"}
Jul 15 19:30:13.555640 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:13.555612    2571 scope.go:117] "RemoveContainer" containerID="b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f"
Jul 15 19:30:13.559858 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:13.559810    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:30:13.559966 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:13.559902    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:30:13.559966 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:13.559949    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:30:14.570355 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:14.570318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" event={"ID":"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf","Type":"ContainerStarted","Data":"989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d"}
Jul 15 19:30:14.958082 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:14.957973    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:30:14.959100 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:14.959067    2571 patch_prober.go:28] interesting pod/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 15 19:30:14.959241 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:14.959166    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 15 19:30:15.474108 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:15.474045    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:30:15.957196 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:15.957156    2571 patch_prober.go:28] interesting pod/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 15 19:30:15.958257 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:15.957827    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 15 19:30:16.965315 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:16.963703    2571 patch_prober.go:28] interesting pod/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 15 19:30:16.965315 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:16.963768    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 15 19:30:17.957582 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:17.957535    2571 patch_prober.go:28] interesting pod/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 15 19:30:17.957787 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:17.957607    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 15 19:30:18.961318 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:18.961249    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:30:18.962360 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:18.962335    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:30:21.170576 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.170532    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"]
Jul 15 19:30:21.173450 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.173430    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"
Jul 15 19:30:21.176307 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.176269    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:30:21.176403 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.176308    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2f4w7\""
Jul 15 19:30:21.183043 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.183016    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"]
Jul 15 19:30:21.338572 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.338526    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fc3a18-d96e-4bd8-ba40-ed57727d3bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc\" (UID: \"71fc3a18-d96e-4bd8-ba40-ed57727d3bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"
Jul 15 19:30:21.440055 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.439957    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fc3a18-d96e-4bd8-ba40-ed57727d3bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc\" (UID: \"71fc3a18-d96e-4bd8-ba40-ed57727d3bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"
Jul 15 19:30:21.440686 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.440665    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fc3a18-d96e-4bd8-ba40-ed57727d3bd5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc\" (UID: \"71fc3a18-d96e-4bd8-ba40-ed57727d3bd5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"
Jul 15 19:30:21.485037 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.484998    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"
Jul 15 19:30:21.622241 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.622209    2571 generic.go:356] "Generic (PLEG): container finished" podID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerID="641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be" exitCode=0
Jul 15 19:30:21.622429 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.622264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" event={"ID":"eec8e49f-e18e-4d6c-ade5-e774ebb8d179","Type":"ContainerDied","Data":"641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be"}
Jul 15 19:30:21.622688 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.622671    2571 scope.go:117] "RemoveContainer" containerID="641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be"
Jul 15 19:30:21.624406 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.623839    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:30:21.624406 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.624012    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:30:21.624406 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.624070    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:30:21.627185 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:21.627161    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"]
Jul 15 19:30:21.629232 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:30:21.629211    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71fc3a18_d96e_4bd8_ba40_ed57727d3bd5.slice/crio-3931fa48dfbb9945f328a42806c0fb25e811ed1527490254032a156108309f60 WatchSource:0}: Error finding container 3931fa48dfbb9945f328a42806c0fb25e811ed1527490254032a156108309f60: Status 404 returned error can't find the container with id 3931fa48dfbb9945f328a42806c0fb25e811ed1527490254032a156108309f60
Jul 15 19:30:22.199714 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:22.199607    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:30:22.517403 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:22.517196    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:22.629617 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:22.629585    2571 generic.go:356] "Generic (PLEG): container finished" podID="71fc3a18-d96e-4bd8-ba40-ed57727d3bd5" containerID="d3abff990224e5363e50a2b95a67ab08d352d5e683926c79ba32b3505deb4da1" exitCode=0
Jul 15 19:30:22.629798 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:22.629654    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc" event={"ID":"71fc3a18-d96e-4bd8-ba40-ed57727d3bd5","Type":"ContainerDied","Data":"d3abff990224e5363e50a2b95a67ab08d352d5e683926c79ba32b3505deb4da1"}
Jul 15 19:30:22.629798 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:22.629709    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc" event={"ID":"71fc3a18-d96e-4bd8-ba40-ed57727d3bd5","Type":"ContainerStarted","Data":"3931fa48dfbb9945f328a42806c0fb25e811ed1527490254032a156108309f60"}
Jul 15 19:30:22.631586 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:22.631566    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" event={"ID":"eec8e49f-e18e-4d6c-ade5-e774ebb8d179","Type":"ContainerStarted","Data":"a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b"}
Jul 15 19:30:23.124880 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:23.124831    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:23.126119 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:23.126089    2571 patch_prober.go:28] interesting pod/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 15 19:30:23.126229 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:23.126144    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 15 19:30:23.819872 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:23.819843    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"
Jul 15 19:30:23.966908 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:23.966812    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fc3a18-d96e-4bd8-ba40-ed57727d3bd5-maas-api-service-ca\") pod \"71fc3a18-d96e-4bd8-ba40-ed57727d3bd5\" (UID: \"71fc3a18-d96e-4bd8-ba40-ed57727d3bd5\") "
Jul 15 19:30:23.967228 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:23.967204    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71fc3a18-d96e-4bd8-ba40-ed57727d3bd5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "71fc3a18-d96e-4bd8-ba40-ed57727d3bd5" (UID: "71fc3a18-d96e-4bd8-ba40-ed57727d3bd5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:30:24.068214 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:24.068169    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fc3a18-d96e-4bd8-ba40-ed57727d3bd5-maas-api-service-ca\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:24.124514 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:24.124476    2571 patch_prober.go:28] interesting pod/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 15 19:30:24.124695 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:24.124537    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 15 19:30:24.650639 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:24.650541    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc"
Jul 15 19:30:24.651094 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:24.651066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc" event={"ID":"71fc3a18-d96e-4bd8-ba40-ed57727d3bd5","Type":"ContainerDied","Data":"3931fa48dfbb9945f328a42806c0fb25e811ed1527490254032a156108309f60"}
Jul 15 19:30:24.651189 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:24.651154    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3931fa48dfbb9945f328a42806c0fb25e811ed1527490254032a156108309f60"
Jul 15 19:30:25.125205 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:25.125171    2571 patch_prober.go:28] interesting pod/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 15 19:30:25.125624 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:25.125233    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 15 19:30:26.125300 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:26.125240    2571 patch_prober.go:28] interesting pod/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 15 19:30:26.125680 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:26.125319    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 15 19:30:27.129264 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:27.129226    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:27.129832 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:27.129805    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:27.130598 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:27.130578    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:30:34.700599 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:34.700550    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:30:46.982736 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:46.982694    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"]
Jul 15 19:30:46.983229 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:46.982970    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy" containerID="cri-o://989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d" gracePeriod=30
Jul 15 19:30:48.964616 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:48.964576    2571 patch_prober.go:28] interesting pod/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:30:48.965013 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:48.964656    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:30:52.251103 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.251034    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:30:52.369130 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369084    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-certs\") pod \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") "
Jul 15 19:30:52.369309 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369147    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-podinfo\") pod \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") "
Jul 15 19:30:52.369309 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369178    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-envoy\") pod \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") "
Jul 15 19:30:52.369309 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369228    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-data\") pod \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") "
Jul 15 19:30:52.369309 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369260    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-token\") pod \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") "
Jul 15 19:30:52.369547 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369313    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-socket\") pod \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") "
Jul 15 19:30:52.369547 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369341    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-259bs\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-kube-api-access-259bs\") pod \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") "
Jul 15 19:30:52.369547 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369368    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istiod-ca-cert\") pod \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") "
Jul 15 19:30:52.369547 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369479    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" (UID: "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:52.369745 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369625    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-credential-socket\") pod \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\" (UID: \"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf\") "
Jul 15 19:30:52.369926 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369616    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" (UID: "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:52.369985 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369814    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" (UID: "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:52.369985 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.369827    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" (UID: "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:30:52.370088 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.370049    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:52.370088 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.370070    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:52.370182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.370085    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:52.370182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.370099    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:52.370302 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.370246    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-data" (OuterVolumeSpecName: "istio-data") pod "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" (UID: "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:52.371370 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.371349    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" (UID: "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:30:52.371505 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.371483    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-token" (OuterVolumeSpecName: "istio-token") pod "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" (UID: "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:30:52.371972 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.371945    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" (UID: "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:30:52.371972 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.371956    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-kube-api-access-259bs" (OuterVolumeSpecName: "kube-api-access-259bs") pod "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" (UID: "ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf"). InnerVolumeSpecName "kube-api-access-259bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:30:52.470947 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.470904    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:52.470947 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.470942    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-259bs\" (UniqueName: \"kubernetes.io/projected/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-kube-api-access-259bs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:52.471159 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.470957    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:52.471159 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.470971    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:52.471159 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.470986    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:30:52.812099 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.812063    2571 generic.go:356] "Generic (PLEG): container finished" podID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerID="989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d" exitCode=0
Jul 15 19:30:52.812276 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.812109    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"
Jul 15 19:30:52.812276 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.812150    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" event={"ID":"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf","Type":"ContainerDied","Data":"989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d"}
Jul 15 19:30:52.812276 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.812213    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb" event={"ID":"ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf","Type":"ContainerDied","Data":"7c0c1e2435956e4bf66340698f51e3c64480d38a9da82a22028939429bc9541d"}
Jul 15 19:30:52.812276 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.812244    2571 scope.go:117] "RemoveContainer" containerID="989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d"
Jul 15 19:30:52.823068 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.823049    2571 scope.go:117] "RemoveContainer" containerID="b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f"
Jul 15 19:30:52.831661 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.831642    2571 scope.go:117] "RemoveContainer" containerID="989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d"
Jul 15 19:30:52.831938 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:30:52.831920    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d\": container with ID starting with 989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d not found: ID does not exist" containerID="989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d"
Jul 15 19:30:52.831987 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.831948    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d"} err="failed to get container status \"989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d\": rpc error: code = NotFound desc = could not find container \"989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d\": container with ID starting with 989960497d2546e3a4e1edbf3c5b43e7682806d0cf16f1bff38f9cd95d2d215d not found: ID does not exist"
Jul 15 19:30:52.831987 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.831967    2571 scope.go:117] "RemoveContainer" containerID="b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f"
Jul 15 19:30:52.832192 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:30:52.832174    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f\": container with ID starting with b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f not found: ID does not exist" containerID="b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f"
Jul 15 19:30:52.832247 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.832201    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f"} err="failed to get container status \"b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f\": rpc error: code = NotFound desc = could not find container \"b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f\": container with ID starting with b98cc67d66199cbce7dc81fa1fb28d9ac61e0098924d39381815b46189723d2f not found: ID does not exist"
Jul 15 19:30:52.837215 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.837187    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"]
Jul 15 19:30:52.841655 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:52.841629    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-67b35f-openshift-default-779bfdd785-dfwjb"]
Jul 15 19:30:54.339125 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:30:54.339093    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" path="/var/lib/kubelet/pods/ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf/volumes"
Jul 15 19:31:01.287391 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:01.287355    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:31:13.166822 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:13.166786    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"]
Jul 15 19:31:13.167254 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:13.167034    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy" containerID="cri-o://a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b" gracePeriod=30
Jul 15 19:31:14.098432 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.098394    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"]
Jul 15 19:31:14.098798 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.098787    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy"
Jul 15 19:31:14.098859 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.098799    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy"
Jul 15 19:31:14.098859 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.098816    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71fc3a18-d96e-4bd8-ba40-ed57727d3bd5" containerName="revoke-keys"
Jul 15 19:31:14.098859 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.098822    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="71fc3a18-d96e-4bd8-ba40-ed57727d3bd5" containerName="revoke-keys"
Jul 15 19:31:14.098962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.098884    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="71fc3a18-d96e-4bd8-ba40-ed57727d3bd5" containerName="revoke-keys"
Jul 15 19:31:14.098962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.098895    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy"
Jul 15 19:31:14.098962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.098901    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy"
Jul 15 19:31:14.105487 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.105452    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.109139 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.109114    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-257300-openshift-default-dockercfg-qr9ph\""
Jul 15 19:31:14.117873 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.117842    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"]
Jul 15 19:31:14.177055 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.177015    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttmfv\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-kube-api-access-ttmfv\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.177461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.177064    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc459105-6d53-4d6c-b499-f47206348e78-istiod-ca-cert\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.177461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.177141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-socket\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.177461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.177173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-data\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.177461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.177190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-istio-token\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.177461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.177271    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-credential-socket\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.177461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.177369    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-envoy\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.177461 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.177386    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc459105-6d53-4d6c-b499-f47206348e78-istio-podinfo\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.177968 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.177461    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-certs\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.278957 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.278913    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-socket\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.278957 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.278958    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-data\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279226 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.278984    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-istio-token\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279226 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-credential-socket\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279226 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-envoy\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279226 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279122    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc459105-6d53-4d6c-b499-f47206348e78-istio-podinfo\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279226 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279154    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-certs\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279527 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279237    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttmfv\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-kube-api-access-ttmfv\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279527 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc459105-6d53-4d6c-b499-f47206348e78-istiod-ca-cert\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279527 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279444    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-data\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279527 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-socket\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279729 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279641    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-certs\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279784 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279767    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-credential-socket\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.279909 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.279890    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc459105-6d53-4d6c-b499-f47206348e78-istiod-ca-cert\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.281485 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.281455    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-envoy\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.281679 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.281659    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc459105-6d53-4d6c-b499-f47206348e78-istio-podinfo\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.289672 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.289643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-istio-token\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.289781 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.289743    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttmfv\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-kube-api-access-ttmfv\") pod \"e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") " pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.419076 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.418993    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:14.571931 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:31:14.571885    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc459105_6d53_4d6c_b499_f47206348e78.slice/crio-fa9fb0936ae6b9a9a715d0706e15813b16e6f0360155a582959c3fe10532c1d6 WatchSource:0}: Error finding container fa9fb0936ae6b9a9a715d0706e15813b16e6f0360155a582959c3fe10532c1d6: Status 404 returned error can't find the container with id fa9fb0936ae6b9a9a715d0706e15813b16e6f0360155a582959c3fe10532c1d6
Jul 15 19:31:14.572045 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.572009    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"]
Jul 15 19:31:14.574204 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.574162    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:14.574271 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.574251    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:14.574346 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.574310    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:14.947042 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.946996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" event={"ID":"fc459105-6d53-4d6c-b499-f47206348e78","Type":"ContainerStarted","Data":"ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea"}
Jul 15 19:31:14.947254 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.947065    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" event={"ID":"fc459105-6d53-4d6c-b499-f47206348e78","Type":"ContainerStarted","Data":"fa9fb0936ae6b9a9a715d0706e15813b16e6f0360155a582959c3fe10532c1d6"}
Jul 15 19:31:14.970340 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:14.970267    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" podStartSLOduration=0.970247464 podStartE2EDuration="970.247464ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:31:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:31:14.967209878 +0000 UTC m=+2399.148982547" watchObservedRunningTime="2026-07-15 19:31:14.970247464 +0000 UTC m=+2399.152020133"
Jul 15 19:31:15.419906 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:15.419863    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:15.424780 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:15.424753    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:15.952594 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:15.952564    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:15.953647 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:15.953630    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:16.400007 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:16.399977    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:31:16.410324 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:16.410296    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:31:18.427685 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.427614    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:31:18.516682 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.516641    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-token\") pod \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") "
Jul 15 19:31:18.516881 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.516689    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-certs\") pod \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") "
Jul 15 19:31:18.516881 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.516745    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-data\") pod \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") "
Jul 15 19:31:18.516881 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.516778    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istiod-ca-cert\") pod \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") "
Jul 15 19:31:18.516881 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.516811    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-envoy\") pod \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") "
Jul 15 19:31:18.516881 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.516854    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-podinfo\") pod \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") "
Jul 15 19:31:18.517154 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.516899    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wlcx\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-kube-api-access-8wlcx\") pod \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") "
Jul 15 19:31:18.517154 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.516996    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-credential-socket\") pod \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") "
Jul 15 19:31:18.517154 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517055    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eec8e49f-e18e-4d6c-ade5-e774ebb8d179" (UID: "eec8e49f-e18e-4d6c-ade5-e774ebb8d179"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:31:18.517366 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517218    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eec8e49f-e18e-4d6c-ade5-e774ebb8d179" (UID: "eec8e49f-e18e-4d6c-ade5-e774ebb8d179"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:31:18.517428 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517396    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eec8e49f-e18e-4d6c-ade5-e774ebb8d179" (UID: "eec8e49f-e18e-4d6c-ade5-e774ebb8d179"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:31:18.517483 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517429    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-socket\") pod \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\" (UID: \"eec8e49f-e18e-4d6c-ade5-e774ebb8d179\") "
Jul 15 19:31:18.517648 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517625    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eec8e49f-e18e-4d6c-ade5-e774ebb8d179" (UID: "eec8e49f-e18e-4d6c-ade5-e774ebb8d179"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:31:18.517786 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517760    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-data" (OuterVolumeSpecName: "istio-data") pod "eec8e49f-e18e-4d6c-ade5-e774ebb8d179" (UID: "eec8e49f-e18e-4d6c-ade5-e774ebb8d179"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:31:18.517869 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517819    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:31:18.517869 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517840    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:31:18.517869 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517854    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:31:18.517985 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.517869    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:31:18.519056 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.519035    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eec8e49f-e18e-4d6c-ade5-e774ebb8d179" (UID: "eec8e49f-e18e-4d6c-ade5-e774ebb8d179"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:31:18.519144 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.519107    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-token" (OuterVolumeSpecName: "istio-token") pod "eec8e49f-e18e-4d6c-ade5-e774ebb8d179" (UID: "eec8e49f-e18e-4d6c-ade5-e774ebb8d179"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:31:18.519378 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.519358    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eec8e49f-e18e-4d6c-ade5-e774ebb8d179" (UID: "eec8e49f-e18e-4d6c-ade5-e774ebb8d179"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:31:18.519547 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.519528    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-kube-api-access-8wlcx" (OuterVolumeSpecName: "kube-api-access-8wlcx") pod "eec8e49f-e18e-4d6c-ade5-e774ebb8d179" (UID: "eec8e49f-e18e-4d6c-ade5-e774ebb8d179"). InnerVolumeSpecName "kube-api-access-8wlcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:31:18.619389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.619352    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:31:18.619389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.619384    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:31:18.619389 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.619395    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:31:18.619638 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.619403    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:31:18.619638 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.619411    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wlcx\" (UniqueName: \"kubernetes.io/projected/eec8e49f-e18e-4d6c-ade5-e774ebb8d179-kube-api-access-8wlcx\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:31:18.971499 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.971455    2571 generic.go:356] "Generic (PLEG): container finished" podID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerID="a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b" exitCode=0
Jul 15 19:31:18.971701 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.971503    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"
Jul 15 19:31:18.971701 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.971535    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" event={"ID":"eec8e49f-e18e-4d6c-ade5-e774ebb8d179","Type":"ContainerDied","Data":"a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b"}
Jul 15 19:31:18.971701 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.971604    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5" event={"ID":"eec8e49f-e18e-4d6c-ade5-e774ebb8d179","Type":"ContainerDied","Data":"b8166369bb83efb6c41672792c2abd790c388a4e7cf7264431929f0f0aa77c94"}
Jul 15 19:31:18.971701 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.971635    2571 scope.go:117] "RemoveContainer" containerID="a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b"
Jul 15 19:31:18.981893 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.981873    2571 scope.go:117] "RemoveContainer" containerID="641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be"
Jul 15 19:31:18.990756 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.990738    2571 scope.go:117] "RemoveContainer" containerID="a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b"
Jul 15 19:31:18.991059 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:31:18.991041    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b\": container with ID starting with a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b not found: ID does not exist" containerID="a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b"
Jul 15 19:31:18.991161 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.991069    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b"} err="failed to get container status \"a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b\": rpc error: code = NotFound desc = could not find container \"a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b\": container with ID starting with a42c5588109c436feb53bc3dda0446dc9baded4e911d82f037c4b85c218cd97b not found: ID does not exist"
Jul 15 19:31:18.991161 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.991088    2571 scope.go:117] "RemoveContainer" containerID="641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be"
Jul 15 19:31:18.991447 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:31:18.991416    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be\": container with ID starting with 641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be not found: ID does not exist" containerID="641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be"
Jul 15 19:31:18.991522 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.991458    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be"} err="failed to get container status \"641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be\": rpc error: code = NotFound desc = could not find container \"641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be\": container with ID starting with 641fa31fc15bc8b5c498abe8cf9d570ca2c73548f631cf90941461af3a08e4be not found: ID does not exist"
Jul 15 19:31:18.994302 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.994267    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"]
Jul 15 19:31:18.998737 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:18.998709    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-97fde9-openshift-default-64687f5985-bmmb5"]
Jul 15 19:31:20.339093 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:20.339059    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" path="/var/lib/kubelet/pods/eec8e49f-e18e-4d6c-ade5-e774ebb8d179/volumes"
Jul 15 19:31:21.701909 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:21.701870    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:31:22.201578 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.201544    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"]
Jul 15 19:31:22.201942 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.201928    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy"
Jul 15 19:31:22.202012 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.201942    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced7fc75-47c1-4e35-aaf5-3afd96ac7ebf" containerName="istio-proxy"
Jul 15 19:31:22.202012 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.201956    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy"
Jul 15 19:31:22.202012 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.201963    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy"
Jul 15 19:31:22.202012 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.201976    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy"
Jul 15 19:31:22.202012 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.201982    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy"
Jul 15 19:31:22.202293 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.202038    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy"
Jul 15 19:31:22.206718 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.206691    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.209712 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.209689    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-0dc297-openshift-default-dockercfg-sgzwx\""
Jul 15 19:31:22.218870 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.218846    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"]
Jul 15 19:31:22.354195 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.354157    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzxtd\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-kube-api-access-hzxtd\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.354410 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.354249    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-socket\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.354410 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.354313    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-istio-token\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.354410 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.354349    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e20a529-b41f-424f-bba9-124200571b26-istio-podinfo\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.354410 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.354378    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-data\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.354616 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.354431    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-credential-socket\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.354616 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.354475    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-envoy\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.354616 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.354556    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e20a529-b41f-424f-bba9-124200571b26-istiod-ca-cert\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.354767 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.354672    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-certs\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.455852 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.455751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-certs\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.455852 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.455825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzxtd\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-kube-api-access-hzxtd\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456059 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.455858    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-socket\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456059 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.455876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-istio-token\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456059 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.455896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e20a529-b41f-424f-bba9-124200571b26-istio-podinfo\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456059 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.455925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-data\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456059 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.455975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-credential-socket\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456059 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.456018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-envoy\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456059 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.456053    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e20a529-b41f-424f-bba9-124200571b26-istiod-ca-cert\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456474 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.456216    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-certs\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456474 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.456237    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-socket\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456474 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.456411    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-data\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456474 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.456433    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-credential-socket\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.456711 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.456694    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e20a529-b41f-424f-bba9-124200571b26-istiod-ca-cert\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.458358 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.458340    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-envoy\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.458464 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.458448    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e20a529-b41f-424f-bba9-124200571b26-istio-podinfo\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.464411 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.464387    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzxtd\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-kube-api-access-hzxtd\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.464523 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.464503    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-istio-token\") pod \"e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") " pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.517345 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.517310    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:22.670903 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.670763    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"]
Jul 15 19:31:22.673471 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:31:22.673441    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e20a529_b41f_424f_bba9_124200571b26.slice/crio-1babbd44dc694e75e7b6b994154c0063e9672bcec92f5b1e6956fb16b69ea422 WatchSource:0}: Error finding container 1babbd44dc694e75e7b6b994154c0063e9672bcec92f5b1e6956fb16b69ea422: Status 404 returned error can't find the container with id 1babbd44dc694e75e7b6b994154c0063e9672bcec92f5b1e6956fb16b69ea422
Jul 15 19:31:22.679339 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.679300    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:22.679420 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.679385    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:22.679462 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.679427    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:22.996357 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.996248    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" event={"ID":"9e20a529-b41f-424f-bba9-124200571b26","Type":"ContainerStarted","Data":"1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a"}
Jul 15 19:31:22.996357 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:22.996325    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" event={"ID":"9e20a529-b41f-424f-bba9-124200571b26","Type":"ContainerStarted","Data":"1babbd44dc694e75e7b6b994154c0063e9672bcec92f5b1e6956fb16b69ea422"}
Jul 15 19:31:23.035221 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:23.035157    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" podStartSLOduration=1.035135969 podStartE2EDuration="1.035135969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:31:23.033319985 +0000 UTC m=+2407.215092657" watchObservedRunningTime="2026-07-15 19:31:23.035135969 +0000 UTC m=+2407.216908640"
Jul 15 19:31:23.518368 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:23.518325    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:23.523220 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:23.523189    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:24.002410 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:24.002377    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:24.003532 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:24.003506    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:30.954096 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:30.954057    2571 patch_prober.go:28] interesting pod/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 15 19:31:30.954540 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:30.954140    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 15 19:31:31.040460 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:31.040420    2571 generic.go:356] "Generic (PLEG): container finished" podID="fc459105-6d53-4d6c-b499-f47206348e78" containerID="ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea" exitCode=0
Jul 15 19:31:31.040638 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:31.040492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" event={"ID":"fc459105-6d53-4d6c-b499-f47206348e78","Type":"ContainerDied","Data":"ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea"}
Jul 15 19:31:31.040919 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:31.040903    2571 scope.go:117] "RemoveContainer" containerID="ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea"
Jul 15 19:31:31.042081 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:31.042049    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:31.042176 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:31.042118    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:31.042176 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:31.042147    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:32.053226 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:32.053187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" event={"ID":"fc459105-6d53-4d6c-b499-f47206348e78","Type":"ContainerStarted","Data":"499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d"}
Jul 15 19:31:32.419193 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:32.419134    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:32.419479 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:32.419398    2571 patch_prober.go:28] interesting pod/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 15 19:31:32.419479 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:32.419445    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 15 19:31:33.419974 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:33.419940    2571 patch_prober.go:28] interesting pod/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 15 19:31:33.420387 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:33.419998    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 15 19:31:34.420161 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:34.420124    2571 patch_prober.go:28] interesting pod/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 15 19:31:34.420584 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:34.420181    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 15 19:31:35.419493 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:35.419453    2571 patch_prober.go:28] interesting pod/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 15 19:31:35.419675 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:35.419509    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 15 19:31:36.100030 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:36.099993    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:31:36.424509 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:36.424416    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:36.424800 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:36.424778    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:36.425430 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:36.425407    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:31:44.127202 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:44.127166    2571 generic.go:356] "Generic (PLEG): container finished" podID="9e20a529-b41f-424f-bba9-124200571b26" containerID="1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a" exitCode=0
Jul 15 19:31:44.127613 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:44.127243    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" event={"ID":"9e20a529-b41f-424f-bba9-124200571b26","Type":"ContainerDied","Data":"1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a"}
Jul 15 19:31:44.127737 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:44.127722    2571 scope.go:117] "RemoveContainer" containerID="1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a"
Jul 15 19:31:44.128840 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:44.128808    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:44.128914 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:44.128895    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:44.128955 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:44.128943    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 19:31:45.134786 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:45.134747    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" event={"ID":"9e20a529-b41f-424f-bba9-124200571b26","Type":"ContainerStarted","Data":"3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15"}
Jul 15 19:31:45.517958 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:45.517864    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:45.518146 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:45.518119    2571 patch_prober.go:28] interesting pod/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 15 19:31:45.518229 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:45.518183    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 15 19:31:46.518795 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:46.518757    2571 patch_prober.go:28] interesting pod/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 15 19:31:46.519189 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:46.518814    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 15 19:31:47.518048 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:47.518009    2571 patch_prober.go:28] interesting pod/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 15 19:31:47.518234 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:47.518069    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 15 19:31:48.518034 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:48.517993    2571 patch_prober.go:28] interesting pod/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 15 19:31:48.518511 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:48.518053    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 15 19:31:48.610371 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:48.610335    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:31:49.522797 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:49.522762    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:49.523405 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:49.523142    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:31:49.523930 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:31:49.523904    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:32:10.700101 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:32:10.700058    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:32:29.024711 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:32:29.024673    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:32:46.408182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:32:46.408147    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:33:01.302040 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:33:01.302004    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:33:18.297932 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:33:18.297884    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:33:35.691177 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:33:35.691138    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:33:53.788454 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:33:53.788415    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:34:11.093939 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:34:11.093896    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:34:26.801184 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:34:26.801146    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:34:45.394160 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:34:45.394074    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:35:05.703215 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:35:05.703171    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:35:26.925837 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:35:26.925802    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:35:45.606635 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:35:45.606594    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:36:04.607548 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:36:04.607503    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:36:16.434869 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:36:16.434836    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:36:16.447424 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:36:16.447397    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6gmn_7ad7dc16-b990-45fc-a39b-1639612de7b3/ovn-acl-logging/0.log"
Jul 15 19:36:34.309475 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:36:34.309432    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:36:55.610887 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:36:55.610843    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:37:11.903144 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:37:11.903103    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:37:27.208800 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:37:27.208758    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:37:54.107652 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:37:54.107571    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:38:05.507777 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:05.507746    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"]
Jul 15 19:38:05.508243 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:05.507974    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy" containerID="cri-o://499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d" gracePeriod=30
Jul 15 19:38:06.427269 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:06.427231    2571 patch_prober.go:28] interesting pod/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:38:06.427463 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:06.427315    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:38:10.769218 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.769150    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:38:10.848021 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.847984    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-istio-token\") pod \"fc459105-6d53-4d6c-b499-f47206348e78\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") "
Jul 15 19:38:10.848204 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848032    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc459105-6d53-4d6c-b499-f47206348e78-istio-podinfo\") pod \"fc459105-6d53-4d6c-b499-f47206348e78\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") "
Jul 15 19:38:10.848204 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848064    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-socket\") pod \"fc459105-6d53-4d6c-b499-f47206348e78\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") "
Jul 15 19:38:10.848204 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848180    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-certs\") pod \"fc459105-6d53-4d6c-b499-f47206348e78\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") "
Jul 15 19:38:10.848417 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848248    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-envoy\") pod \"fc459105-6d53-4d6c-b499-f47206348e78\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") "
Jul 15 19:38:10.848417 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848298    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-credential-socket\") pod \"fc459105-6d53-4d6c-b499-f47206348e78\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") "
Jul 15 19:38:10.848417 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848332    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc459105-6d53-4d6c-b499-f47206348e78-istiod-ca-cert\") pod \"fc459105-6d53-4d6c-b499-f47206348e78\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") "
Jul 15 19:38:10.848417 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848368    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc459105-6d53-4d6c-b499-f47206348e78" (UID: "fc459105-6d53-4d6c-b499-f47206348e78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:10.848417 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848396    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttmfv\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-kube-api-access-ttmfv\") pod \"fc459105-6d53-4d6c-b499-f47206348e78\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") "
Jul 15 19:38:10.848657 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848423    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-data\") pod \"fc459105-6d53-4d6c-b499-f47206348e78\" (UID: \"fc459105-6d53-4d6c-b499-f47206348e78\") "
Jul 15 19:38:10.848657 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848506    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc459105-6d53-4d6c-b499-f47206348e78" (UID: "fc459105-6d53-4d6c-b499-f47206348e78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:10.848657 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848589    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc459105-6d53-4d6c-b499-f47206348e78" (UID: "fc459105-6d53-4d6c-b499-f47206348e78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:10.848851 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848830    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:10.849017 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848996    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:10.849094 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.849021    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:10.849094 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.848866    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc459105-6d53-4d6c-b499-f47206348e78-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc459105-6d53-4d6c-b499-f47206348e78" (UID: "fc459105-6d53-4d6c-b499-f47206348e78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:38:10.849462 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.849432    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc459105-6d53-4d6c-b499-f47206348e78" (UID: "fc459105-6d53-4d6c-b499-f47206348e78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:10.850445 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.850420    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc459105-6d53-4d6c-b499-f47206348e78" (UID: "fc459105-6d53-4d6c-b499-f47206348e78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:38:10.850816 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.850767    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc459105-6d53-4d6c-b499-f47206348e78-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc459105-6d53-4d6c-b499-f47206348e78" (UID: "fc459105-6d53-4d6c-b499-f47206348e78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:38:10.850896 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.850852    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc459105-6d53-4d6c-b499-f47206348e78" (UID: "fc459105-6d53-4d6c-b499-f47206348e78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:10.850896 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.850855    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-kube-api-access-ttmfv" (OuterVolumeSpecName: "kube-api-access-ttmfv") pod "fc459105-6d53-4d6c-b499-f47206348e78" (UID: "fc459105-6d53-4d6c-b499-f47206348e78"). InnerVolumeSpecName "kube-api-access-ttmfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:38:10.950301 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.950247    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:10.950301 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.950299    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc459105-6d53-4d6c-b499-f47206348e78-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:10.950494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.950310    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttmfv\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-kube-api-access-ttmfv\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:10.950494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.950321    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc459105-6d53-4d6c-b499-f47206348e78-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:10.950494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.950330    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc459105-6d53-4d6c-b499-f47206348e78-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:10.950494 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:10.950337    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc459105-6d53-4d6c-b499-f47206348e78-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:11.318826 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.318769    2571 generic.go:356] "Generic (PLEG): container finished" podID="fc459105-6d53-4d6c-b499-f47206348e78" containerID="499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d" exitCode=0
Jul 15 19:38:11.318826 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.318815    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"
Jul 15 19:38:11.319125 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.318852    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" event={"ID":"fc459105-6d53-4d6c-b499-f47206348e78","Type":"ContainerDied","Data":"499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d"}
Jul 15 19:38:11.319125 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.318918    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss" event={"ID":"fc459105-6d53-4d6c-b499-f47206348e78","Type":"ContainerDied","Data":"fa9fb0936ae6b9a9a715d0706e15813b16e6f0360155a582959c3fe10532c1d6"}
Jul 15 19:38:11.319125 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.318950    2571 scope.go:117] "RemoveContainer" containerID="499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d"
Jul 15 19:38:11.328230 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.328210    2571 scope.go:117] "RemoveContainer" containerID="ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea"
Jul 15 19:38:11.336475 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.336452    2571 scope.go:117] "RemoveContainer" containerID="499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d"
Jul 15 19:38:11.336748 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:38:11.336729    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d\": container with ID starting with 499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d not found: ID does not exist" containerID="499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d"
Jul 15 19:38:11.336798 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.336756    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d"} err="failed to get container status \"499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d\": rpc error: code = NotFound desc = could not find container \"499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d\": container with ID starting with 499ae12fdf558dc718117e0bf5fb33a39d6722d414a72991dacfc19c4170571d not found: ID does not exist"
Jul 15 19:38:11.336798 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.336773    2571 scope.go:117] "RemoveContainer" containerID="ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea"
Jul 15 19:38:11.337014 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:38:11.336996    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea\": container with ID starting with ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea not found: ID does not exist" containerID="ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea"
Jul 15 19:38:11.337062 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.337020    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea"} err="failed to get container status \"ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea\": rpc error: code = NotFound desc = could not find container \"ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea\": container with ID starting with ac5f666b2132ec047be7ef167ad08f982cd52098ebe7447dd71741f8be12a8ea not found: ID does not exist"
Jul 15 19:38:11.342716 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.342687    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"]
Jul 15 19:38:11.349114 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:11.349091    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-257300-openshift-default-5ff9d49679-kp8ss"]
Jul 15 19:38:12.338180 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:12.338150    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc459105-6d53-4d6c-b499-f47206348e78" path="/var/lib/kubelet/pods/fc459105-6d53-4d6c-b499-f47206348e78/volumes"
Jul 15 19:38:19.697603 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:19.697557    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9hjrw"]
Jul 15 19:38:31.747112 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:31.747071    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"]
Jul 15 19:38:31.747740 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:31.747397    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy" containerID="cri-o://3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15" gracePeriod=30
Jul 15 19:38:34.525483 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:34.525445    2571 patch_prober.go:28] interesting pod/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:38:34.525946 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:34.525528    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:38:36.997787 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:36.997762    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:38:37.107988 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.107947    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-certs\") pod \"9e20a529-b41f-424f-bba9-124200571b26\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") "
Jul 15 19:38:37.108182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108008    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-envoy\") pod \"9e20a529-b41f-424f-bba9-124200571b26\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") "
Jul 15 19:38:37.108182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108053    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzxtd\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-kube-api-access-hzxtd\") pod \"9e20a529-b41f-424f-bba9-124200571b26\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") "
Jul 15 19:38:37.108182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108076    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-credential-socket\") pod \"9e20a529-b41f-424f-bba9-124200571b26\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") "
Jul 15 19:38:37.108182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108102    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-socket\") pod \"9e20a529-b41f-424f-bba9-124200571b26\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") "
Jul 15 19:38:37.108182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108133    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e20a529-b41f-424f-bba9-124200571b26-istio-podinfo\") pod \"9e20a529-b41f-424f-bba9-124200571b26\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") "
Jul 15 19:38:37.108182 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108174    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e20a529-b41f-424f-bba9-124200571b26-istiod-ca-cert\") pod \"9e20a529-b41f-424f-bba9-124200571b26\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") "
Jul 15 19:38:37.108532 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108234    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-istio-token\") pod \"9e20a529-b41f-424f-bba9-124200571b26\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") "
Jul 15 19:38:37.108532 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108309    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e20a529-b41f-424f-bba9-124200571b26" (UID: "9e20a529-b41f-424f-bba9-124200571b26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:37.108532 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108319    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-data\") pod \"9e20a529-b41f-424f-bba9-124200571b26\" (UID: \"9e20a529-b41f-424f-bba9-124200571b26\") "
Jul 15 19:38:37.108532 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108497    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e20a529-b41f-424f-bba9-124200571b26" (UID: "9e20a529-b41f-424f-bba9-124200571b26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:37.108771 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108663    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e20a529-b41f-424f-bba9-124200571b26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e20a529-b41f-424f-bba9-124200571b26" (UID: "9e20a529-b41f-424f-bba9-124200571b26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:38:37.108829 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108766    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-certs\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:37.108829 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108785    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-credential-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:37.108829 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108801    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e20a529-b41f-424f-bba9-124200571b26-istiod-ca-cert\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:37.108985 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.108885    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e20a529-b41f-424f-bba9-124200571b26" (UID: "9e20a529-b41f-424f-bba9-124200571b26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:37.109239 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.109200    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e20a529-b41f-424f-bba9-124200571b26" (UID: "9e20a529-b41f-424f-bba9-124200571b26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:37.110454 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.110404    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e20a529-b41f-424f-bba9-124200571b26" (UID: "9e20a529-b41f-424f-bba9-124200571b26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:38:37.110454 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.110411    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-kube-api-access-hzxtd" (OuterVolumeSpecName: "kube-api-access-hzxtd") pod "9e20a529-b41f-424f-bba9-124200571b26" (UID: "9e20a529-b41f-424f-bba9-124200571b26"). InnerVolumeSpecName "kube-api-access-hzxtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:38:37.110596 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.110482    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e20a529-b41f-424f-bba9-124200571b26" (UID: "9e20a529-b41f-424f-bba9-124200571b26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:38:37.110596 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.110496    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e20a529-b41f-424f-bba9-124200571b26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e20a529-b41f-424f-bba9-124200571b26" (UID: "9e20a529-b41f-424f-bba9-124200571b26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 19:38:37.209795 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.209762    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-envoy\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:37.209795 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.209792    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzxtd\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-kube-api-access-hzxtd\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:37.209795 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.209801    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-workload-socket\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:37.210019 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.209812    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e20a529-b41f-424f-bba9-124200571b26-istio-podinfo\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:37.210019 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.209821    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e20a529-b41f-424f-bba9-124200571b26-istio-token\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:37.210019 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.209830    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e20a529-b41f-424f-bba9-124200571b26-istio-data\") on node \"ip-10-0-130-233.ec2.internal\" DevicePath \"\""
Jul 15 19:38:37.465101 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.465000    2571 generic.go:356] "Generic (PLEG): container finished" podID="9e20a529-b41f-424f-bba9-124200571b26" containerID="3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15" exitCode=0
Jul 15 19:38:37.465101 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.465053    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"
Jul 15 19:38:37.465101 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.465081    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" event={"ID":"9e20a529-b41f-424f-bba9-124200571b26","Type":"ContainerDied","Data":"3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15"}
Jul 15 19:38:37.465386 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.465138    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq" event={"ID":"9e20a529-b41f-424f-bba9-124200571b26","Type":"ContainerDied","Data":"1babbd44dc694e75e7b6b994154c0063e9672bcec92f5b1e6956fb16b69ea422"}
Jul 15 19:38:37.465386 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.465152    2571 scope.go:117] "RemoveContainer" containerID="3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15"
Jul 15 19:38:37.474655 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.474634    2571 scope.go:117] "RemoveContainer" containerID="1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a"
Jul 15 19:38:37.482779 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.482761    2571 scope.go:117] "RemoveContainer" containerID="3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15"
Jul 15 19:38:37.483026 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:38:37.483009    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15\": container with ID starting with 3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15 not found: ID does not exist" containerID="3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15"
Jul 15 19:38:37.483079 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.483033    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15"} err="failed to get container status \"3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15\": rpc error: code = NotFound desc = could not find container \"3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15\": container with ID starting with 3c49cb429c357c7ae21e4d6339acc2266a0c8a739596f5b98458df4ea940bb15 not found: ID does not exist"
Jul 15 19:38:37.483079 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.483049    2571 scope.go:117] "RemoveContainer" containerID="1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a"
Jul 15 19:38:37.483276 ip-10-0-130-233 kubenswrapper[2571]: E0715 19:38:37.483257    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a\": container with ID starting with 1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a not found: ID does not exist" containerID="1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a"
Jul 15 19:38:37.483363 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.483305    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a"} err="failed to get container status \"1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a\": rpc error: code = NotFound desc = could not find container \"1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a\": container with ID starting with 1759d2bbb2bf24d94773a4bce3282a2ae83451ef20590d56588594a85f9eea4a not found: ID does not exist"
Jul 15 19:38:37.495064 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.495028    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"]
Jul 15 19:38:37.504889 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:37.504865    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-0dc297-openshift-default-55b9b6f9b7-6vkcq"]
Jul 15 19:38:38.245432 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:38.245401    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6sp5x_bff758f2-65ad-4bb5-bf70-cf5c0696ae2b/manager/0.log"
Jul 15 19:38:38.337644 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:38.337613    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e20a529-b41f-424f-bba9-124200571b26" path="/var/lib/kubelet/pods/9e20a529-b41f-424f-bba9-124200571b26/volumes"
Jul 15 19:38:39.026454 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:39.026423    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbd7b8848-lg8n8_e815ea84-51c8-4fe4-8f6b-5e1ac8970f76/copy-manifests/0.log"
Jul 15 19:38:39.033969 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:39.033945    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbd7b8848-lg8n8_e815ea84-51c8-4fe4-8f6b-5e1ac8970f76/manager/0.log"
Jul 15 19:38:39.697528 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:39.697495    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735715-g69rn_547f8329-38e3-4fa3-bb4f-65efa6ad887e/cleanup/0.log"
Jul 15 19:38:39.932525 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:39.932494    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-109e9634-s4sxp_0fc1514e-94ce-4e2a-b5e5-8ff79649b9db/revoke-keys/0.log"
Jul 15 19:38:40.049222 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:40.049145    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-ba1e3d30-bsjqj_0267e6cb-201b-4287-a48c-57b1a4339f5e/revoke-keys/0.log"
Jul 15 19:38:40.169215 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:40.169184    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-67b35f-2ptcc_71fc3a18-d96e-4bd8-ba40-ed57727d3bd5/revoke-keys/0.log"
Jul 15 19:38:40.423082 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:40.423051    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-b5322848-s99z7_ce30a9ec-ca6a-4cf6-8390-728a01f8e800/revoke-keys/0.log"
Jul 15 19:38:40.543208 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:40.543174    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-7b6049-xlw6p_0925398a-a1fb-482e-a059-70816d254656/revoke-keys/0.log"
Jul 15 19:38:40.663981 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:40.663952    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-1dfe1f-7bnfd_9c71f8a3-a75b-4da7-a42f-04afa8ba4d73/revoke-keys/0.log"
Jul 15 19:38:40.781637 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:40.781558    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-9df5bb53-zkhxb_e1881091-dd2d-47f7-88e7-c7aeaea49001/revoke-keys/0.log"
Jul 15 19:38:40.900653 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:40.900622    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-23ae53ab-2cblw_704db709-1b5e-4a16-ac14-e81e7d691dea/revoke-keys/0.log"
Jul 15 19:38:41.016674 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:41.016644    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-52712cae-qw4kl_64afc338-8a2e-4d7e-b3f6-bb3c3593bb2d/revoke-keys/0.log"
Jul 15 19:38:43.032928 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:43.032878    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wpdvl_063d99fe-4f12-4a02-b029-73789be0b1f9/manager/0.log"
Jul 15 19:38:43.273699 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:43.273665    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sdwfw_dca295e6-7064-4f19-8248-4d11e8d77485/registry-server/0.log"
Jul 15 19:38:43.408780 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:43.408743    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-44v4p_0cb924dd-7f17-4b5c-84a7-2419e4614428/manager/0.log"
Jul 15 19:38:43.551335 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:43.551276    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9hjrw_305d2bfb-740a-4d74-9a4a-b13a0209b000/limitador/0.log"
Jul 15 19:38:43.700150 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:43.700062    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gv466_03fb04ac-cf0f-44d4-9c3e-b720effac277/manager/0.log"
Jul 15 19:38:44.072996 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:44.072966    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48z8vs_8cd0793f-32a0-4e44-8782-86b6f80aa768/istio-proxy/0.log"
Jul 15 19:38:44.192130 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:44.192097    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ldb6d_ac5b283e-68aa-4d14-8665-8f8f0353d34f/discovery/0.log"
Jul 15 19:38:44.429419 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:44.429333    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbd849f4d-qthtj_f5013abd-f4a5-4a01-8ec9-c669f898cdcd/kube-auth-proxy/0.log"
Jul 15 19:38:44.551886 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:44.551850    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j8c9d_dcf006fd-11fe-40d0-be77-35608b4413ee/istio-proxy/1.log"
Jul 15 19:38:55.605217 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:55.605182    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sgnm6_770ec833-12f2-442d-8108-0eeec52dea3a/global-pull-secret-syncer/0.log"
Jul 15 19:38:55.732425 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:55.732394    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l9dbk_427e95a8-c850-44bd-b203-06dc475f06b2/konnectivity-agent/0.log"
Jul 15 19:38:55.785641 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:38:55.785606    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-233.ec2.internal_27d6e657e0fc42c84018a1763a94d169/haproxy/0.log"
Jul 15 19:39:00.811662 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:00.811632    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wpdvl_063d99fe-4f12-4a02-b029-73789be0b1f9/manager/0.log"
Jul 15 19:39:00.910113 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:00.910078    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sdwfw_dca295e6-7064-4f19-8248-4d11e8d77485/registry-server/0.log"
Jul 15 19:39:01.086068 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:01.086038    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-44v4p_0cb924dd-7f17-4b5c-84a7-2419e4614428/manager/0.log"
Jul 15 19:39:01.128983 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:01.128951    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9hjrw_305d2bfb-740a-4d74-9a4a-b13a0209b000/limitador/0.log"
Jul 15 19:39:01.199546 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:01.196530    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gv466_03fb04ac-cf0f-44d4-9c3e-b720effac277/manager/0.log"
Jul 15 19:39:02.857026 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:02.856995    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa298d10-3a9b-444a-9d61-8774f20d764d/alertmanager/0.log"
Jul 15 19:39:02.888042 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:02.888010    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa298d10-3a9b-444a-9d61-8774f20d764d/config-reloader/0.log"
Jul 15 19:39:02.915469 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:02.915439    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa298d10-3a9b-444a-9d61-8774f20d764d/kube-rbac-proxy-web/0.log"
Jul 15 19:39:02.936827 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:02.936804    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa298d10-3a9b-444a-9d61-8774f20d764d/kube-rbac-proxy/0.log"
Jul 15 19:39:02.959904 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:02.959883    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa298d10-3a9b-444a-9d61-8774f20d764d/kube-rbac-proxy-metric/0.log"
Jul 15 19:39:02.984103 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:02.984044    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa298d10-3a9b-444a-9d61-8774f20d764d/prom-label-proxy/0.log"
Jul 15 19:39:03.009993 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.009956    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fa298d10-3a9b-444a-9d61-8774f20d764d/init-config-reloader/0.log"
Jul 15 19:39:03.079849 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.079821    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-bl898_21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb/kube-state-metrics/0.log"
Jul 15 19:39:03.101089 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.101062    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-bl898_21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb/kube-rbac-proxy-main/0.log"
Jul 15 19:39:03.126034 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.126002    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-bl898_21f058ef-b9ed-4ba2-a73e-4b9ca2ceadeb/kube-rbac-proxy-self/0.log"
Jul 15 19:39:03.167084 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.167040    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b574d89d9-q4nhx_d07bad1c-c9a0-4c3a-99cd-a56ea597f779/metrics-server/0.log"
Jul 15 19:39:03.200758 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.200721    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-g8fdf_ad119ff4-df1b-4027-8ae3-407b8fd15ecd/monitoring-plugin/0.log"
Jul 15 19:39:03.241155 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.241090    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4sdqn_19889de1-41fa-427f-b542-e330fdc5090e/node-exporter/0.log"
Jul 15 19:39:03.276542 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.276517    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4sdqn_19889de1-41fa-427f-b542-e330fdc5090e/kube-rbac-proxy/0.log"
Jul 15 19:39:03.305863 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.305838    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4sdqn_19889de1-41fa-427f-b542-e330fdc5090e/init-textfile/0.log"
Jul 15 19:39:03.625063 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.625037    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc3a3213-e98c-45eb-9647-d6abd4165d7a/prometheus/0.log"
Jul 15 19:39:03.653538 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.653514    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc3a3213-e98c-45eb-9647-d6abd4165d7a/config-reloader/0.log"
Jul 15 19:39:03.679945 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.679915    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc3a3213-e98c-45eb-9647-d6abd4165d7a/thanos-sidecar/0.log"
Jul 15 19:39:03.704583 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.704552    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc3a3213-e98c-45eb-9647-d6abd4165d7a/kube-rbac-proxy-web/0.log"
Jul 15 19:39:03.729936 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.729902    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc3a3213-e98c-45eb-9647-d6abd4165d7a/kube-rbac-proxy/0.log"
Jul 15 19:39:03.753958 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.753925    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc3a3213-e98c-45eb-9647-d6abd4165d7a/kube-rbac-proxy-thanos/0.log"
Jul 15 19:39:03.780659 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.780629    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc3a3213-e98c-45eb-9647-d6abd4165d7a/init-config-reloader/0.log"
Jul 15 19:39:03.871424 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:03.871346    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-x69gv_7f24e5c7-3af1-4207-9716-800dc82fb233/prometheus-operator-admission-webhook/0.log"
Jul 15 19:39:04.019241 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:04.019202    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5955df595c-cp9qk_c7b4f414-50a3-480a-a93c-45adc8f73305/thanos-query/0.log"
Jul 15 19:39:04.049651 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:04.049624    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5955df595c-cp9qk_c7b4f414-50a3-480a-a93c-45adc8f73305/kube-rbac-proxy-web/0.log"
Jul 15 19:39:04.077227 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:04.077194    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5955df595c-cp9qk_c7b4f414-50a3-480a-a93c-45adc8f73305/kube-rbac-proxy/0.log"
Jul 15 19:39:04.100773 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:04.100744    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5955df595c-cp9qk_c7b4f414-50a3-480a-a93c-45adc8f73305/prom-label-proxy/0.log"
Jul 15 19:39:04.124427 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:04.124366    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5955df595c-cp9qk_c7b4f414-50a3-480a-a93c-45adc8f73305/kube-rbac-proxy-rules/0.log"
Jul 15 19:39:04.149951 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:04.149924    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5955df595c-cp9qk_c7b4f414-50a3-480a-a93c-45adc8f73305/kube-rbac-proxy-metrics/0.log"
Jul 15 19:39:05.810306 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810248    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"]
Jul 15 19:39:05.810682 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810659    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy"
Jul 15 19:39:05.810682 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810673    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy"
Jul 15 19:39:05.810682 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810683    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy"
Jul 15 19:39:05.810784 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810689    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy"
Jul 15 19:39:05.810784 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810696    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy"
Jul 15 19:39:05.810784 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810703    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy"
Jul 15 19:39:05.810784 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810710    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy"
Jul 15 19:39:05.810784 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810715    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy"
Jul 15 19:39:05.810784 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810784    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec8e49f-e18e-4d6c-ade5-e774ebb8d179" containerName="istio-proxy"
Jul 15 19:39:05.810962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810792    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy"
Jul 15 19:39:05.810962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810798    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e20a529-b41f-424f-bba9-124200571b26" containerName="istio-proxy"
Jul 15 19:39:05.810962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810805    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy"
Jul 15 19:39:05.810962 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.810813    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc459105-6d53-4d6c-b499-f47206348e78" containerName="istio-proxy"
Jul 15 19:39:05.814093 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.814077    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.817097 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.817071    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6vp87\"/\"default-dockercfg-ttwfw\""
Jul 15 19:39:05.817223 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.817137    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vp87\"/\"kube-root-ca.crt\""
Jul 15 19:39:05.818236 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.818217    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vp87\"/\"openshift-service-ca.crt\""
Jul 15 19:39:05.831124 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.831100    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"]
Jul 15 19:39:05.869531 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.869500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5s4z\" (UniqueName: \"kubernetes.io/projected/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-kube-api-access-k5s4z\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.869717 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.869555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-sys\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.869717 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.869618    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-lib-modules\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.869717 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.869686    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-proc\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.869717 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.869710    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-podres\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.971186 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.971149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5s4z\" (UniqueName: \"kubernetes.io/projected/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-kube-api-access-k5s4z\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.971368 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.971205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-sys\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.971368 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.971228    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-lib-modules\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.971368 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.971262    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-proc\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.971368 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.971277    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-podres\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.971368 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.971317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-sys\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.971563 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.971421    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-podres\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.971563 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.971433    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-lib-modules\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.971563 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.971475    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-proc\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:05.981123 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:05.981095    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5s4z\" (UniqueName: \"kubernetes.io/projected/a5dd7ff1-7361-491c-8be7-ec7c3a82052d-kube-api-access-k5s4z\") pod \"perf-node-gather-daemonset-fz6dr\" (UID: \"a5dd7ff1-7361-491c-8be7-ec7c3a82052d\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:06.124073 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:06.124034    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:06.255695 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:06.255664    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"]
Jul 15 19:39:06.257661 ip-10-0-130-233 kubenswrapper[2571]: W0715 19:39:06.257632    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda5dd7ff1_7361_491c_8be7_ec7c3a82052d.slice/crio-ce7a378bd30b0df80d53587e02374ca64100a297c9b73ee72b6821fad8cd1713 WatchSource:0}: Error finding container ce7a378bd30b0df80d53587e02374ca64100a297c9b73ee72b6821fad8cd1713: Status 404 returned error can't find the container with id ce7a378bd30b0df80d53587e02374ca64100a297c9b73ee72b6821fad8cd1713
Jul 15 19:39:06.618795 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:06.618757    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr" event={"ID":"a5dd7ff1-7361-491c-8be7-ec7c3a82052d","Type":"ContainerStarted","Data":"89c8648da972eb12fb419841032653508099bb63c3b013648c15404a843a4348"}
Jul 15 19:39:06.618972 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:06.618824    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:06.618972 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:06.618843    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr" event={"ID":"a5dd7ff1-7361-491c-8be7-ec7c3a82052d","Type":"ContainerStarted","Data":"ce7a378bd30b0df80d53587e02374ca64100a297c9b73ee72b6821fad8cd1713"}
Jul 15 19:39:06.637901 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:06.637850    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr" podStartSLOduration=1.637834062 podStartE2EDuration="1.637834062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:39:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:06.63547791 +0000 UTC m=+2870.817250583" watchObservedRunningTime="2026-07-15 19:39:06.637834062 +0000 UTC m=+2870.819606746"
Jul 15 19:39:08.275769 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:08.275681    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l66rv_8e2bc8cd-8875-4c41-abaf-f3260f3a96be/dns/0.log"
Jul 15 19:39:08.297842 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:08.297817    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l66rv_8e2bc8cd-8875-4c41-abaf-f3260f3a96be/kube-rbac-proxy/0.log"
Jul 15 19:39:08.426345 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:08.426317    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8f7cx_bda29dcc-2bcd-41cf-9222-9bdd6d736afa/dns-node-resolver/0.log"
Jul 15 19:39:09.183556 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:09.183515    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sckqh_f2ec0d0f-67af-4da1-bc2a-7eca409852d0/node-ca/0.log"
Jul 15 19:39:10.134531 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:10.134500    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48z8vs_8cd0793f-32a0-4e44-8782-86b6f80aa768/istio-proxy/0.log"
Jul 15 19:39:10.251867 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:10.251831    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ldb6d_ac5b283e-68aa-4d14-8665-8f8f0353d34f/discovery/0.log"
Jul 15 19:39:10.300391 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:10.300356    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbd849f4d-qthtj_f5013abd-f4a5-4a01-8ec9-c669f898cdcd/kube-auth-proxy/0.log"
Jul 15 19:39:10.330732 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:10.330703    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j8c9d_dcf006fd-11fe-40d0-be77-35608b4413ee/istio-proxy/0.log"
Jul 15 19:39:10.358320 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:10.358296    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j8c9d_dcf006fd-11fe-40d0-be77-35608b4413ee/istio-proxy/1.log"
Jul 15 19:39:11.235599 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:11.235570    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7ldd8_3a038d65-4618-4f97-889f-009deb195006/serve-healthcheck-canary/0.log"
Jul 15 19:39:11.892517 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:11.892490    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dms9z_8908c39a-e77d-4ffb-9a4c-20861d71dc39/kube-rbac-proxy/0.log"
Jul 15 19:39:11.916093 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:11.916066    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dms9z_8908c39a-e77d-4ffb-9a4c-20861d71dc39/exporter/0.log"
Jul 15 19:39:11.940380 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:11.940356    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dms9z_8908c39a-e77d-4ffb-9a4c-20861d71dc39/extractor/0.log"
Jul 15 19:39:12.634000 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:12.633972    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-fz6dr"
Jul 15 19:39:14.478625 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:14.478587    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6sp5x_bff758f2-65ad-4bb5-bf70-cf5c0696ae2b/manager/0.log"
Jul 15 19:39:15.022638 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:15.022608    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbd7b8848-lg8n8_e815ea84-51c8-4fe4-8f6b-5e1ac8970f76/manager/0.log"
Jul 15 19:39:15.049646 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:15.049552    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbd7b8848-lg8n8_e815ea84-51c8-4fe4-8f6b-5e1ac8970f76/copy-manifests/0.log"
Jul 15 19:39:16.483658 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:16.483626    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tbsb4_2fa7a1d4-463a-41cd-835a-69bd24426176/openshift-lws-operator/0.log"
Jul 15 19:39:16.754141 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:16.754110    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48z8vs_8cd0793f-32a0-4e44-8782-86b6f80aa768/istio-proxy/0.log"
Jul 15 19:39:16.874481 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:16.874449    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ldb6d_ac5b283e-68aa-4d14-8665-8f8f0353d34f/discovery/0.log"
Jul 15 19:39:16.903392 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:16.903366    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbd849f4d-qthtj_f5013abd-f4a5-4a01-8ec9-c669f898cdcd/kube-auth-proxy/0.log"
Jul 15 19:39:16.923816 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:16.923739    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j8c9d_dcf006fd-11fe-40d0-be77-35608b4413ee/istio-proxy/0.log"
Jul 15 19:39:16.954363 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:16.954338    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j8c9d_dcf006fd-11fe-40d0-be77-35608b4413ee/istio-proxy/1.log"
Jul 15 19:39:18.203175 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:18.203141    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48z8vs_8cd0793f-32a0-4e44-8782-86b6f80aa768/istio-proxy/0.log"
Jul 15 19:39:18.315168 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:18.315129    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ldb6d_ac5b283e-68aa-4d14-8665-8f8f0353d34f/discovery/0.log"
Jul 15 19:39:18.350253 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:18.350219    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbd849f4d-qthtj_f5013abd-f4a5-4a01-8ec9-c669f898cdcd/kube-auth-proxy/0.log"
Jul 15 19:39:18.375767 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:18.375736    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j8c9d_dcf006fd-11fe-40d0-be77-35608b4413ee/istio-proxy/0.log"
Jul 15 19:39:18.405746 ip-10-0-130-233 kubenswrapper[2571]: I0715 19:39:18.405712    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j8c9d_dcf006fd-11fe-40d0-be77-35608b4413ee/istio-proxy/1.log"