Jul 24 17:08:21.110596 ip-10-0-130-142 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 17:08:21.110608 ip-10-0-130-142 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 17:08:21.110615 ip-10-0-130-142 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 17:08:21.110891 ip-10-0-130-142 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 17:08:31.168623 ip-10-0-130-142 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 17:08:31.168642 ip-10-0-130-142 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1dcc21f775c54f3cacb6141f75f35054 --
Jul 24 17:10:07.246143 ip-10-0-130-142 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 17:10:07.699539 ip-10-0-130-142 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:10:07.699539 ip-10-0-130-142 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 17:10:07.699539 ip-10-0-130-142 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:10:07.699539 ip-10-0-130-142 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 17:10:07.699539 ip-10-0-130-142 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:10:07.701279 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.701152    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 17:10:07.706556 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706537    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:10:07.706556 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706556    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:10:07.706556 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706560    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706563    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706567    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706570    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706573    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706575    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706580    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706583    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706586    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706589    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706592    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706600    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706604    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706607    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706610    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706613    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706615    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706618    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706621    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:10:07.706668 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706623    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706626    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706628    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706631    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706634    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706636    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706639    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706641    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706644    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706647    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706649    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706654    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706659    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706662    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706666    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706669    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706672    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706674    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706677    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:10:07.707154 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706680    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706683    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706685    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706688    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706691    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706694    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706697    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706699    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706702    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706705    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706709    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706712    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706714    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706717    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706719    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706722    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706724    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706728    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706730    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706733    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:10:07.707616 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706735    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706738    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706740    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706743    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706746    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706749    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706751    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706754    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706757    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706760    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706762    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706765    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706768    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706771    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706773    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706776    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706778    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706781    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706784    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706786    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:10:07.708165 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706811    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706815    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706818    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706821    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706823    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706826    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706829    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706832    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706836    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706840    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706843    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706847    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706850    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706853    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706856    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706858    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706862    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706864    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.706868    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:10:07.708649 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708401    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708409    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708413    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708418    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708422    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708426    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708429    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708432    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708435    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708438    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708440    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708443    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708447    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708449    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708452    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708455    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708458    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708461    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708464    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:10:07.709135 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708466    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708469    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708472    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708474    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708477    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708479    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708482    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708485    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708487    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708489    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708492    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708496    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708499    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708501    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708504    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708506    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708509    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708512    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708515    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:10:07.709614 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708518    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708520    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708523    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708526    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708528    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708531    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708533    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708536    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708539    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708542    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708545    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708547    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708550    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708553    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708555    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708558    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708560    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708563    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708566    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708569    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:10:07.710112 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708571    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708575    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708578    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708582    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708585    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708588    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708590    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708593    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708596    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708599    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708601    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708603    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708606    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708610    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708613    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708615    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708619    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708621    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708624    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708626    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:10:07.710606 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708629    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708632    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708635    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708637    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708641    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708643    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708646    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708648    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708651    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708655    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708658    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708661    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708664    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708667    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708669    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708672    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708675    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708677    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708680    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708683    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:10:07.711126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.708685    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709095    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709101    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709104    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709109    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709113    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709117    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709120    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709123    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709126    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709129    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709131    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709134    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709137    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709139    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709142    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709145    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709147    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709150    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:10:07.711705 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709153    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709155    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709158    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709161    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709164    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709166    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709169    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709171    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709175    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709179    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709182    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709185    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709188    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709190    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709193    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709195    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709198    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709201    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709204    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709207    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:10:07.712192 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709209    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709212    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709214    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709217    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709220    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709222    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709224    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709227    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709229    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709232    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709234    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709237    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709240    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709243    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709245    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709248    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709250    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709253    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709255    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709258    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:10:07.712681 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709260    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709263    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709266    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709268    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709271    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709274    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709276    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709279    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709281    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709284    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709287    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709289    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709292    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709295    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709297    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709299    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709302    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709304    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709307    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709309    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:10:07.713228 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709312    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709315    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709317    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709320    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709322    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709325    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709328    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709331    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709333    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709336    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709339    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709341    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709346    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709349    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709353    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709356    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709359    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709362    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709365    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:10:07.713725 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709368    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.709370    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709458    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709469    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709481    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709486    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709491    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709494    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709498    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709503    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709506    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709509    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709512    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709516    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709519    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709522    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709525    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709528    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709531    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709534    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709538    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709540    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709543    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709547    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 17:10:07.714217 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709550    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709556    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709559    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709562    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709565    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709568    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709571    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709574    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709577    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709580    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709585    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709589    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709591    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709594    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709597    2563 flags.go:64] FLAG: --enable-server="true"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709601    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709605    2563 flags.go:64] FLAG: --event-burst="100"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709608    2563 flags.go:64] FLAG: --event-qps="50"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709611    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709615    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709618    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709621    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709624    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709628    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709631    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 24 17:10:07.714822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709633    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709636    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709639    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709642    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709645    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709648    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709650    2563 flags.go:64] FLAG: --feature-gates=""
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709654    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709658    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709661    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709664    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709668    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709670    2563 flags.go:64] FLAG: --help="false"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709673    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-130-142.ec2.internal"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709676    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709679    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709683    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709687    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709690    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709693    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709696    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709699    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709702    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 17:10:07.715438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709705    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709708    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709711    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709714    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709717    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709720    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709722    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709725    2563 flags.go:64] FLAG: --lock-file=""
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709728    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709731    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709734    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709740    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709742    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709745    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709748    2563 flags.go:64] FLAG: --logging-format="text"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709751    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709754    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709757    2563 flags.go:64] FLAG: --manifest-url=""
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709760    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709764    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709767    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709771    2563 flags.go:64] FLAG: --max-pods="110"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709774    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709777    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709780    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 17:10:07.716041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709782    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709786    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709808    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709811    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709819    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709822    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709826    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709828    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709832    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709838    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709841    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709844    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709847    2563 flags.go:64] FLAG: --port="10250"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709850    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709853    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f71dfacbb7d1dc9c"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709856    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709859    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709862    2563 flags.go:64] FLAG: --register-node="true"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709865    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709868    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709871    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709874    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709877    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709881    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709883    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 17:10:07.716685 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709887    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709890    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709893    2563 flags.go:64] FLAG: --runonce="false"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709895    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709898    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709901    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709904    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709907    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709911    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709914    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709917    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709920    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709922    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709925    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709928    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709931    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709934    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709937    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709943    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709945    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709948    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709952    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709955    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709958    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709960    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 17:10:07.717387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709963    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709966    2563 flags.go:64] FLAG: --v="2"
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709970    2563 flags.go:64] FLAG: --version="false"
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709974    2563 flags.go:64] FLAG: --vmodule=""
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709978    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.709981    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710117    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710121    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710124    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710127    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710130    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710133    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710136    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710139    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710142    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710145    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710148    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710150    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710153    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710155    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710157    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:10:07.718019 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710160    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710162    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710165    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710168    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710170    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710173    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710177    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710180    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710183    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710185    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710188    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710191    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710194    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710197    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710201    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710204    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710206    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710209    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710211    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:10:07.718531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710214    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710216    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710219    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710221    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710224    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710226    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710229    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710231    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710234    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710237    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710239    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710242    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710244    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710247    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710250    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710252    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710255    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710257    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710261    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710265    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:10:07.719017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710268    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710271    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710274    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710277    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710279    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710282    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710285    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710290    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710293    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710296    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710299    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710301    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710303    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710306    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710309    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710312    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710315    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710317    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710320    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:10:07.719514 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710322    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710325    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710327    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710330    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710332    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710335    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710337    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710340    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710342    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710346    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710350    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710353    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710355    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710358    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710360    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710362    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710365    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710368    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710370    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710373    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:10:07.720009 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710377    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710379    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710382    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710384    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710387    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.710389    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.711150    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.719103    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.719119    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.720086    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.720093    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720179    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720187    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:10:07.720500 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720191    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720195    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720199    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720202    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720205    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720208    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720211    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720214    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720216    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720219    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720228    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720231    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720234    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720237    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720239    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720253    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720257    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720261    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720264    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720267    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:10:07.720934 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720269    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720272    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720275    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720278    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720281    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720283    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720287    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720290    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720292    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720295    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720297    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720300    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720303    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720305    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720308    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720311    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720313    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720316    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720318    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720321    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:10:07.721420 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720323    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720326    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720328    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720337    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720340    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720342    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720345    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720347    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720349    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720352    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720354    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720357    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720359    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720362    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720364    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720367    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720370    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720372    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720375    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720384    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:10:07.721944 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720387    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720389    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720392    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720394    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720397    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720399    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720402    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720404    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720407    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720409    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720412    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720414    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720417    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720419    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720422    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720424    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720432    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720435    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720437    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720439    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:10:07.722422 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720442    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720445    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720448    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720451    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720453    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720456    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720458    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720461    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720463    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720466    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720468    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720472    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720475    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720477    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720481    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720485    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:10:07.723081 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720488    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.720493    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720664    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720669    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720672    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720675    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720678    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720680    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720683    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720685    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720688    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720691    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720693    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720701    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720704    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:10:07.723694 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720710    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720713    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720715    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720717    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720720    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720722    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720725    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720728    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720730    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720733    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720735    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720738    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720741    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720744    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720746    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720749    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720751    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720754    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720756    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720760    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:10:07.724201 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720764    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720766    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720769    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720772    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720775    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720777    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720780    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720782    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720785    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720787    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720806    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720817    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720820    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720823    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720825    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720828    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720830    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720833    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720836    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:10:07.724688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720838    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720841    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720843    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720846    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720848    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720851    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720854    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720856    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720859    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720861    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720864    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720866    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720869    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720872    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720874    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720876    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720879    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720881    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720884    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720886    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:10:07.725178 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720889    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720891    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720893    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720896    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720898    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720908    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720911    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720913    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720917    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720920    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720923    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720926    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720928    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720931    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720933    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720936    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720938    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720941    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720944    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:10:07.725700 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720947    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:10:07.726242 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720949    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:10:07.726242 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720952    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:10:07.726242 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720954    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:10:07.726242 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720957    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:10:07.726242 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720959    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:10:07.726242 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720961    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:10:07.726242 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:07.720964    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:10:07.726242 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.720969    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:10:07.726242 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.721096    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 17:10:07.726600 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.726582    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 17:10:07.728234 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.728221    2563 server.go:1019] "Starting client certificate rotation"
Jul 24 17:10:07.728334 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.728317    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:10:07.728379 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.728352    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:10:07.731238 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.731224    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:10:07.735583 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.735561    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:10:07.749251 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.749229    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 24 17:10:07.751631 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.751616    2563 log.go:25] "Validated CRI v1 image API"
Jul 24 17:10:07.752405 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.752388    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 17:10:07.755143 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.755123    2563 fs.go:135] Filesystem UUIDs: map[3f0f381d-5937-4603-992a-ff5b71f176a0:/dev/nvme0n1p3 481c29e8-80af-421a-ad16-3e66b687c85e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 24 17:10:07.755206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.755143    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 17:10:07.761156 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.761033    2563 manager.go:216] Machine: {Timestamp:2026-07-24 17:10:07.75953628 +0000 UTC m=+0.387414122 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093616 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c204558e4cf063e899a584089dd85 SystemUUID:ec2c2045-58e4-cf06-3e89-9a584089dd85 BootID:1dcc21f7-75c5-4f3c-acb6-141f75f35054 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8c:72:bc:b7:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8c:72:bc:b7:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:37:55:ea:bf:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 17:10:07.761156 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.761149    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 17:10:07.761298 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.761238    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 17:10:07.761334 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.761303    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:10:07.764684 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.764658    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 17:10:07.764847 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.764692    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 17:10:07.765593 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.765583    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 17:10:07.765626 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.765596    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 17:10:07.765626 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.765603    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:10:07.766471 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.766460    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:10:07.768230 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.768219    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 17:10:07.772716 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.772702    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:10:07.772920 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.772910    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 17:10:07.772958 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.772946    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 17:10:07.772990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.772960    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 17:10:07.772990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.772984    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 17:10:07.773040 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.772998    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 24 17:10:07.773040 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.773010    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 17:10:07.773382 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.773371    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:10:07.773415 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.773390    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:10:07.777172 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.777148    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 17:10:07.779040 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.779023    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 17:10:07.779115 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.779054    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 17:10:07.781231 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781217    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 17:10:07.781289 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781236    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 17:10:07.781289 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781243    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 17:10:07.781289 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781249    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 17:10:07.781289 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781258    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 17:10:07.781289 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781264    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 17:10:07.781289 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781273    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 17:10:07.781289 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781278    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 17:10:07.781289 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781285    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 17:10:07.781289 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781290    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 17:10:07.781646 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781300    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 17:10:07.781646 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.781305    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 17:10:07.782142 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.782121    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 17:10:07.782142 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.782134    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 17:10:07.782655 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.782632    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 17:10:07.782710 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.782635    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 17:10:07.785439 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.785423    2563 server.go:1268] "Started kubelet"
Jul 24 17:10:07.785527 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.785503    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 17:10:07.785764 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.785652    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 17:10:07.785764 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.785726    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 17:10:07.786333 ip-10-0-130-142 systemd[1]: Started Kubernetes Kubelet.
Jul 24 17:10:07.787491 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.787477    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 17:10:07.790410 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.790392    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 17:10:07.792050 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.792026    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 17:10:07.793155 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.793140    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 17:10:07.794172 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.793173    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-142.ec2.internal.18c548ec7805bcf5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-142.ec2.internal,UID:ip-10-0-130-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-142.ec2.internal,},FirstTimestamp:2026-07-24 17:10:07.785393397 +0000 UTC m=+0.413271241,LastTimestamp:2026-07-24 17:10:07.785393397 +0000 UTC m=+0.413271241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-142.ec2.internal,}"
Jul 24 17:10:07.798970 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.798950    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 17:10:07.799050 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.798955    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 17:10:07.799115 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.799079    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:07.799751 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.799736    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 17:10:07.799853 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.799738    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 17:10:07.799853 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.799774    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 17:10:07.799935 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.799876    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 17:10:07.799935 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.799884    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 17:10:07.800045 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.800030    2563 factory.go:153] Registering CRI-O factory
Jul 24 17:10:07.800089 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.800049    2563 factory.go:223] Registration of the crio container factory successfully
Jul 24 17:10:07.800125 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.800097    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 17:10:07.800125 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.800103    2563 factory.go:55] Registering systemd factory
Jul 24 17:10:07.800125 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.800109    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 24 17:10:07.800225 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.800133    2563 factory.go:103] Registering Raw factory
Jul 24 17:10:07.800225 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.800149    2563 manager.go:1196] Started watching for new ooms in manager
Jul 24 17:10:07.800599 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.800582    2563 manager.go:349] Starting recovery of all containers
Jul 24 17:10:07.801295 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.801050    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 17:10:07.801295 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.801161    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 17:10:07.805721 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.805694    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7qw85"
Jul 24 17:10:07.808580 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.808551    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 17:10:07.811677 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.811660    2563 manager.go:354] Recovery completed
Jul 24 17:10:07.813095 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.813067    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7qw85"
Jul 24 17:10:07.817892 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.817753    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:10:07.819548 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.819532    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:10:07.819633 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.819567    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:10:07.819633 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.819583    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:10:07.820175 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.820155    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:10:07.820271 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.820156    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 17:10:07.820271 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.820208    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 17:10:07.820271 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.820230    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:10:07.821732 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.821177    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:10:07.821732 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.821213    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:10:07.821732 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.821231    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:10:07.822923 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.822908    2563 policy_none.go:49] "None policy: Start"
Jul 24 17:10:07.822997 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.822929    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 17:10:07.822997 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.822943    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 17:10:07.825322 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.825310    2563 policy_none.go:47] "Start"
Jul 24 17:10:07.865395 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.865378    2563 manager.go:337] "Starting Device Plugin manager"
Jul 24 17:10:07.865508 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.865422    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 17:10:07.865508 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.865432    2563 server.go:87] "Starting device plugin registration server"
Jul 24 17:10:07.865701 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.865687    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 17:10:07.865751 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.865707    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 17:10:07.865832 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.865817    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 17:10:07.865929 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.865918    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 17:10:07.865975 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.865933    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 17:10:07.866489 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.866463    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 17:10:07.866562 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.866518    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:07.883675 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.882711    2563 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2601 into the system container \"/system.slice\": <nil>"
Jul 24 17:10:07.930139 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.930107    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 17:10:07.931970 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.930151    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 17:10:07.931970 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.930174    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 17:10:07.931970 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.930213    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 17:10:07.932185 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.932171    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:10:07.966336 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.966280    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:10:07.967143 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.967127    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:10:07.967235 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.967162    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:10:07.967235 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.967176    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:10:07.967235 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.967204    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-142.ec2.internal"
Jul 24 17:10:07.975824 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:07.975809    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-142.ec2.internal"
Jul 24 17:10:07.975909 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.975833    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-142.ec2.internal\": node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:07.997324 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:07.997304    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.030843 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.030785    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal"]
Jul 24 17:10:08.030975 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.030915    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:10:08.032713 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.032696    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:10:08.032835 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.032730    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:10:08.032835 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.032743    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:10:08.034913 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.034896    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:10:08.035023 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.035009    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.035084 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.035042    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:10:08.035678 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.035660    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:10:08.035753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.035692    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:10:08.035753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.035707    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:10:08.035753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.035716    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:10:08.035753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.035735    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:10:08.035753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.035744    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:10:08.037880 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.037862    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.037959 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.037892    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:10:08.038837 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.038814    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:10:08.038934 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.038847    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:10:08.038934 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.038860    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:10:08.060378 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.060357    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-142.ec2.internal\" not found" node="ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.064872 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.064855    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-142.ec2.internal\" not found" node="ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.097410 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.097395    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.198341 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.198314    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.201662 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.201643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6815e1a3ddf63c201106b77d621717d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"6815e1a3ddf63c201106b77d621717d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.201716 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.201681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b391d4f348573e91689bb0c2ff5339e9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-142.ec2.internal\" (UID: \"b391d4f348573e91689bb0c2ff5339e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.201716 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.201702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6815e1a3ddf63c201106b77d621717d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"6815e1a3ddf63c201106b77d621717d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.299082 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.298989    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.302297 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.302278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b391d4f348573e91689bb0c2ff5339e9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-142.ec2.internal\" (UID: \"b391d4f348573e91689bb0c2ff5339e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.302362 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.302310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6815e1a3ddf63c201106b77d621717d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"6815e1a3ddf63c201106b77d621717d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.302362 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.302332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6815e1a3ddf63c201106b77d621717d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"6815e1a3ddf63c201106b77d621717d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.302458 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.302391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b391d4f348573e91689bb0c2ff5339e9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-142.ec2.internal\" (UID: \"b391d4f348573e91689bb0c2ff5339e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.302458 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.302411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6815e1a3ddf63c201106b77d621717d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"6815e1a3ddf63c201106b77d621717d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.302458 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.302396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6815e1a3ddf63c201106b77d621717d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"6815e1a3ddf63c201106b77d621717d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.362423 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.362380    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.368668 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.368648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:08.399778 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.399752    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.500157 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.500120    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.600560 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.600498    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.700987 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.700956    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.727267 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.727245    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 17:10:08.727395 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.727379    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:10:08.800239 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.800217    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:10:08.801139 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.801118    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.819906 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.819846    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 17:05:08 +0000 UTC" deadline="2028-03-05 09:40:13.728267842 +0000 UTC"
Jul 24 17:10:08.819906 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.819873    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14152h30m4.908398494s"
Jul 24 17:10:08.901318 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:08.901253    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:08.949866 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:08.949851    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:10:09.002132 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:09.002094    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:09.102706 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:09.102677    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found"
Jul 24 17:10:09.149716 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.149689    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:10:09.200252 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.200222    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:09.216383 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.216365    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:10:09.218380 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.218363    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal"
Jul 24 17:10:09.226225 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.226211    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:10:09.272309 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.272281    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:10:09.720753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.720719    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:10:09.774525 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.774493    2563 apiserver.go:52] "Watching apiserver"
Jul 24 17:10:09.787759 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.787729    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 17:10:09.789257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.789225    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-5d4ts","openshift-multus/network-metrics-daemon-bwpql","openshift-network-operator/iptables-alerter-2b7zl","kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal","openshift-multus/multus-n4rll","openshift-network-diagnostics/network-check-target-pmglx","openshift-ovn-kubernetes/ovnkube-node-dx9mm","kube-system/global-pull-secret-syncer-rcw58","kube-system/konnectivity-agent-f9t7x","openshift-cluster-node-tuning-operator/tuned-2fw2p","openshift-dns/node-resolver-prz4f","openshift-image-registry/node-ca-vl76g"]
Jul 24 17:10:09.792534 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.792183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:09.792534 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:09.792302    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:09.794728 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.794280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.796980 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.796589    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.797914 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.797296    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 17:10:09.797914 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.797518    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 17:10:09.797914 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.797722    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-56wmj\""
Jul 24 17:10:09.799798 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.798925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.799798 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.799513    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:10:09.799798 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.799615    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 17:10:09.800122 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.799862    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 17:10:09.800122 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.799991    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 17:10:09.802706 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.801699    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.802706 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.802111    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 17:10:09.802706 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.802211    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 17:10:09.802706 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.802501    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-svz4n\""
Jul 24 17:10:09.802706 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.802516    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rhhrp\""
Jul 24 17:10:09.803079 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.802772    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 17:10:09.803882 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.803862    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:09.803989 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:09.803924    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:09.804733 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.804715    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 17:10:09.804864 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.804843    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dclm7\""
Jul 24 17:10:09.805290 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.805272    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 17:10:09.805290 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.805285    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 17:10:09.806407 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.806388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.809153 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.809128    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 17:10:09.809354 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.809339    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 17:10:09.809610 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.809594    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 17:10:09.809825 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.809808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d9fj6\""
Jul 24 17:10:09.810443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.810428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.811002 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.810975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a539260-c108-464f-a64c-4d43ab4b71f6-dbus\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:09.811092 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:09.811092 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c19bdf11-ed75-4696-abb0-8d3bc5b77315-iptables-alerter-script\") pod \"iptables-alerter-2b7zl\" (UID: \"c19bdf11-ed75-4696-abb0-8d3bc5b77315\") " pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.811092 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c19bdf11-ed75-4696-abb0-8d3bc5b77315-host-slash\") pod \"iptables-alerter-2b7zl\" (UID: \"c19bdf11-ed75-4696-abb0-8d3bc5b77315\") " pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.811302 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rnf7\" (UniqueName: \"kubernetes.io/projected/c19bdf11-ed75-4696-abb0-8d3bc5b77315-kube-api-access-6rnf7\") pod \"iptables-alerter-2b7zl\" (UID: \"c19bdf11-ed75-4696-abb0-8d3bc5b77315\") " pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.811302 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3-serviceca\") pod \"node-ca-vl76g\" (UID: \"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3\") " pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.811302 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811271    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 17:10:09.811474 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811308    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 17:10:09.811540 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811531    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 17:10:09.811687 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811668    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:09.811753 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:09.811738    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:09.811874 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mr9\" (UniqueName: \"kubernetes.io/projected/1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3-kube-api-access-f4mr9\") pod \"node-ca-vl76g\" (UID: \"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3\") " pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.811958 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-socket-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.811958 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-registration-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.811958 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-sys-fs\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.812076 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.811979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a539260-c108-464f-a64c-4d43ab4b71f6-kubelet-config\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:09.812076 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.812014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.812076 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.812061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hv54\" (UniqueName: \"kubernetes.io/projected/bb32ddd1-1311-4384-b03b-f478d1ec09ca-kube-api-access-9hv54\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.812226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.812092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3a5d168-84a4-42e0-926f-939504b0eae7-hosts-file\") pod \"node-resolver-prz4f\" (UID: \"a3a5d168-84a4-42e0-926f-939504b0eae7\") " pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.812226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.812123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccf6g\" (UniqueName: \"kubernetes.io/projected/a3a5d168-84a4-42e0-926f-939504b0eae7-kube-api-access-ccf6g\") pod \"node-resolver-prz4f\" (UID: \"a3a5d168-84a4-42e0-926f-939504b0eae7\") " pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.812226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.812148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-device-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.812226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.812176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.812226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.812195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a5d168-84a4-42e0-926f-939504b0eae7-tmp-dir\") pod \"node-resolver-prz4f\" (UID: \"a3a5d168-84a4-42e0-926f-939504b0eae7\") " pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.812226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.812218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3-host\") pod \"node-ca-vl76g\" (UID: \"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3\") " pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.813076 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.813056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 17:10:09.813384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.813367    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 17:10:09.813486 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.813472    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 17:10:09.813683 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.813666    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4qgk5\""
Jul 24 17:10:09.813753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.813711    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 17:10:09.814056 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.814021    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:10:09.814309 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.814291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:09.817137 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.817115    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 17:10:09.817299 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.817241    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 17:10:09.817373 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.817334    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-krf2t\""
Jul 24 17:10:09.817512 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.817478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:09.819539 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.819483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.820520 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.820182    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 17:10:09.820520 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.820311    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 17:10:09.821053 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.821037    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zsq7g\""
Jul 24 17:10:09.822622 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.822130    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:10:09.822622 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.822363    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-25h47\""
Jul 24 17:10:09.822622 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.822444    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 17:10:09.834504 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.834445    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ccvk8"
Jul 24 17:10:09.843451 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.843425    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ccvk8"
Jul 24 17:10:09.901836 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.901792    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 17:10:09.912896 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.912861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-var-lib-kubelet\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.913054 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.912902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-tmp\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.913054 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.912924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9rzv\" (UniqueName: \"kubernetes.io/projected/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-kube-api-access-r9rzv\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.913054 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.912969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a539260-c108-464f-a64c-4d43ab4b71f6-dbus\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:09.913054 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mr9\" (UniqueName: \"kubernetes.io/projected/1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3-kube-api-access-f4mr9\") pod \"node-ca-vl76g\" (UID: \"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3\") " pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.913256 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-os-release\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.913256 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a539260-c108-464f-a64c-4d43ab4b71f6-dbus\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:09.913256 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913193    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-run-netns\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.913256 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-hostroot\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.913256 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-run-systemd\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.913516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-socket-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.913516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-registration-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.913516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a539260-c108-464f-a64c-4d43ab4b71f6-kubelet-config\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:09.913516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-systemd-units\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.913516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-cni-binary-copy\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.913516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913467    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-socket-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.913516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hv54\" (UniqueName: \"kubernetes.io/projected/bb32ddd1-1311-4384-b03b-f478d1ec09ca-kube-api-access-9hv54\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.913842 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-node-log\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.913842 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a539260-c108-464f-a64c-4d43ab4b71f6-kubelet-config\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:09.913842 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-system-cni-dir\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.913842 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-registration-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.913842 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-cnibin\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.913842 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:09.913842 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-run\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.914171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.914171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a5d168-84a4-42e0-926f-939504b0eae7-tmp-dir\") pod \"node-resolver-prz4f\" (UID: \"a3a5d168-84a4-42e0-926f-939504b0eae7\") " pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.914171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-var-lib-openvswitch\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.914171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.913972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-etc-openvswitch\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.914171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-log-socket\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.914171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-kubernetes\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.914171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c19bdf11-ed75-4696-abb0-8d3bc5b77315-iptables-alerter-script\") pod \"iptables-alerter-2b7zl\" (UID: \"c19bdf11-ed75-4696-abb0-8d3bc5b77315\") " pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.914171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c19bdf11-ed75-4696-abb0-8d3bc5b77315-host-slash\") pod \"iptables-alerter-2b7zl\" (UID: \"c19bdf11-ed75-4696-abb0-8d3bc5b77315\") " pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.914171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rnf7\" (UniqueName: \"kubernetes.io/projected/c19bdf11-ed75-4696-abb0-8d3bc5b77315-kube-api-access-6rnf7\") pod \"iptables-alerter-2b7zl\" (UID: \"c19bdf11-ed75-4696-abb0-8d3bc5b77315\") " pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3-serviceca\") pod \"node-ca-vl76g\" (UID: \"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3\") " pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a5d168-84a4-42e0-926f-939504b0eae7-tmp-dir\") pod \"node-resolver-prz4f\" (UID: \"a3a5d168-84a4-42e0-926f-939504b0eae7\") " pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-slash\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-env-overrides\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c19bdf11-ed75-4696-abb0-8d3bc5b77315-host-slash\") pod \"iptables-alerter-2b7zl\" (UID: \"c19bdf11-ed75-4696-abb0-8d3bc5b77315\") " pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-var-lib-cni-multus\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-daemon-config\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-run-ovn-kubernetes\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-etc-selinux\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-cni-netd\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nc9h\" (UniqueName: \"kubernetes.io/projected/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-kube-api-access-9nc9h\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-var-lib-kubelet\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.914516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-run-multus-certs\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2296e0ea-43c7-4caa-a363-d2362de86050-konnectivity-ca\") pod \"konnectivity-agent-f9t7x\" (UID: \"2296e0ea-43c7-4caa-a363-d2362de86050\") " pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-modprobe-d\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-conf-dir\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29tf\" (UniqueName: \"kubernetes.io/projected/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-kube-api-access-q29tf\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-tuned\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3-host\") pod \"node-ca-vl76g\" (UID: \"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3\") " pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-cni-bin\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-run-k8s-cni-cncf-io\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b05cebf-84b5-4f82-b8a2-883175c86b8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3-host\") pod \"node-ca-vl76g\" (UID: \"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3\") " pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.914943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-run-netns\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:09.915041    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-run-openvswitch\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:09.915207 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:09.915144    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret podName:9a539260-c108-464f-a64c-4d43ab4b71f6 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:10.415102175 +0000 UTC m=+3.042980034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret") pod "global-pull-secret-syncer-rcw58" (UID: "9a539260-c108-464f-a64c-4d43ab4b71f6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b05cebf-84b5-4f82-b8a2-883175c86b8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-sysctl-d\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-etc-kubernetes\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-sysctl-conf\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-run-ovn\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-var-lib-cni-bin\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2296e0ea-43c7-4caa-a363-d2362de86050-agent-certs\") pod \"konnectivity-agent-f9t7x\" (UID: \"2296e0ea-43c7-4caa-a363-d2362de86050\") " pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-systemd\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-lib-modules\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-device-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-ovn-node-metrics-cert\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-ovnkube-script-lib\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915575    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c19bdf11-ed75-4696-abb0-8d3bc5b77315-iptables-alerter-script\") pod \"iptables-alerter-2b7zl\" (UID: \"c19bdf11-ed75-4696-abb0-8d3bc5b77315\") " pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-device-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.915990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-cni-dir\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-sysconfig\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-sys-fs\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-cnibin\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b05cebf-84b5-4f82-b8a2-883175c86b8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3-serviceca\") pod \"node-ca-vl76g\" (UID: \"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3\") " pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-host\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-sys-fs\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3a5d168-84a4-42e0-926f-939504b0eae7-hosts-file\") pod \"node-resolver-prz4f\" (UID: \"a3a5d168-84a4-42e0-926f-939504b0eae7\") " pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb32ddd1-1311-4384-b03b-f478d1ec09ca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccf6g\" (UniqueName: \"kubernetes.io/projected/a3a5d168-84a4-42e0-926f-939504b0eae7-kube-api-access-ccf6g\") pod \"node-resolver-prz4f\" (UID: \"a3a5d168-84a4-42e0-926f-939504b0eae7\") " pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3a5d168-84a4-42e0-926f-939504b0eae7-hosts-file\") pod \"node-resolver-prz4f\" (UID: \"a3a5d168-84a4-42e0-926f-939504b0eae7\") " pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-kubelet\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.915981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-ovnkube-config\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.916007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-socket-dir-parent\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:09.917140 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.916031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snjbf\" (UniqueName: \"kubernetes.io/projected/58ffc242-7629-4e3b-885d-fad30fe0923b-kube-api-access-snjbf\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:09.918091 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.916054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-os-release\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:09.918091 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.916079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-system-cni-dir\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:09.918091 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.916105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4cvv\" (UniqueName: \"kubernetes.io/projected/5b05cebf-84b5-4f82-b8a2-883175c86b8f-kube-api-access-x4cvv\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:09.918091 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.916129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-sys\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:09.921122 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.921086    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 17:10:09.925134 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.925116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4mr9\" (UniqueName: \"kubernetes.io/projected/1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3-kube-api-access-f4mr9\") pod \"node-ca-vl76g\" (UID: \"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3\") " pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:09.926049 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.926025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rnf7\" (UniqueName: \"kubernetes.io/projected/c19bdf11-ed75-4696-abb0-8d3bc5b77315-kube-api-access-6rnf7\") pod \"iptables-alerter-2b7zl\" (UID: \"c19bdf11-ed75-4696-abb0-8d3bc5b77315\") " pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:09.926457 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.926410    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hv54\" (UniqueName: \"kubernetes.io/projected/bb32ddd1-1311-4384-b03b-f478d1ec09ca-kube-api-access-9hv54\") pod \"aws-ebs-csi-driver-node-pmf65\" (UID: \"bb32ddd1-1311-4384-b03b-f478d1ec09ca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:09.926604 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.926582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccf6g\" (UniqueName: \"kubernetes.io/projected/a3a5d168-84a4-42e0-926f-939504b0eae7-kube-api-access-ccf6g\") pod \"node-resolver-prz4f\" (UID: \"a3a5d168-84a4-42e0-926f-939504b0eae7\") " pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:09.935866 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.935807    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" event={"ID":"6815e1a3ddf63c201106b77d621717d0","Type":"ContainerStarted","Data":"257810c88a5e5f780a8ef42b88af078cf9e4dd69c49edbf1fb75b46a3c19d4d9"}
Jul 24 17:10:09.937100 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:09.937043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" event={"ID":"b391d4f348573e91689bb0c2ff5339e9","Type":"ContainerStarted","Data":"6d99b761cb42ce9c206650bdf37dfca5ca9ffdf7b8326fbf8883a833bdcea53c"}
Jul 24 17:10:10.017474 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-sys\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.017474 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-var-lib-kubelet\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.017474 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-tmp\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.017474 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9rzv\" (UniqueName: \"kubernetes.io/projected/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-kube-api-access-r9rzv\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.017474 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-os-release\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.017474 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-run-netns\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-hostroot\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-run-systemd\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-systemd-units\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-cni-binary-copy\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-node-log\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-system-cni-dir\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-cnibin\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-run\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-var-lib-openvswitch\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-etc-openvswitch\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-log-socket\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-kubernetes\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.017817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-slash\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-env-overrides\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-var-lib-cni-multus\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-daemon-config\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-run-ovn-kubernetes\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.017978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-cni-netd\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nc9h\" (UniqueName: \"kubernetes.io/projected/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-kube-api-access-9nc9h\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-var-lib-kubelet\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-run-multus-certs\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2296e0ea-43c7-4caa-a363-d2362de86050-konnectivity-ca\") pod \"konnectivity-agent-f9t7x\" (UID: \"2296e0ea-43c7-4caa-a363-d2362de86050\") " pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-modprobe-d\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-conf-dir\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q29tf\" (UniqueName: \"kubernetes.io/projected/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-kube-api-access-q29tf\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-tuned\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-cni-bin\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-run-k8s-cni-cncf-io\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b05cebf-84b5-4f82-b8a2-883175c86b8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.018384 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-run-netns\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-run-openvswitch\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b05cebf-84b5-4f82-b8a2-883175c86b8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-sysctl-d\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-etc-kubernetes\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-sysctl-conf\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-run-ovn\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-var-lib-cni-bin\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2296e0ea-43c7-4caa-a363-d2362de86050-agent-certs\") pod \"konnectivity-agent-f9t7x\" (UID: \"2296e0ea-43c7-4caa-a363-d2362de86050\") " pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-systemd\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-lib-modules\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-ovn-node-metrics-cert\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-ovnkube-script-lib\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-cni-dir\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:10.018969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-sysconfig\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-cnibin\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b05cebf-84b5-4f82-b8a2-883175c86b8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-host\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-kubelet\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-ovnkube-config\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-socket-dir-parent\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snjbf\" (UniqueName: \"kubernetes.io/projected/58ffc242-7629-4e3b-885d-fad30fe0923b-kube-api-access-snjbf\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-os-release\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-system-cni-dir\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.018784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4cvv\" (UniqueName: \"kubernetes.io/projected/5b05cebf-84b5-4f82-b8a2-883175c86b8f-kube-api-access-x4cvv\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.019168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-sys\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.019616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.019245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-var-lib-kubelet\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.020407 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.019922    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-cni-bin\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.020407 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.019997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-run-k8s-cni-cncf-io\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.020521 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.020464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b05cebf-84b5-4f82-b8a2-883175c86b8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.020579 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.020521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-run-netns\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.020579 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.020552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-run-openvswitch\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.020674 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.020627    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:10.020674 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.020674    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs podName:58ffc242-7629-4e3b-885d-fad30fe0923b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:10.52066113 +0000 UTC m=+3.148538961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs") pod "network-metrics-daemon-bwpql" (UID: "58ffc242-7629-4e3b-885d-fad30fe0923b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.020907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-cni-dir\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-socket-dir-parent\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-var-lib-cni-bin\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-os-release\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021373    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-ovnkube-config\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-etc-kubernetes\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-sysctl-d\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-cnibin\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b05cebf-84b5-4f82-b8a2-883175c86b8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021467    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-cni-netd\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-os-release\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-kubernetes\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-slash\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-systemd\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-var-lib-cni-multus\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-lib-modules\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b05cebf-84b5-4f82-b8a2-883175c86b8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.023128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.021988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-host\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-kubelet\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-env-overrides\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-sysctl-conf\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-tmp\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-daemon-config\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-system-cni-dir\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-run-ovn\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-run-ovn-kubernetes\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-node-log\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-tuned\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-systemd-units\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-run-systemd\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-run-netns\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-run\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-system-cni-dir\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.024202 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.022784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-cni-binary-copy\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025305    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b05cebf-84b5-4f82-b8a2-883175c86b8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-sysconfig\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-etc-openvswitch\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-var-lib-openvswitch\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2296e0ea-43c7-4caa-a363-d2362de86050-konnectivity-ca\") pod \"konnectivity-agent-f9t7x\" (UID: \"2296e0ea-43c7-4caa-a363-d2362de86050\") " pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-cnibin\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-hostroot\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-log-socket\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-var-lib-kubelet\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-host-run-multus-certs\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-multus-conf-dir\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-ovnkube-script-lib\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025843    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-ovn-node-metrics-cert\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.025859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-etc-modprobe-d\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.029316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.026037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2296e0ea-43c7-4caa-a363-d2362de86050-agent-certs\") pod \"konnectivity-agent-f9t7x\" (UID: \"2296e0ea-43c7-4caa-a363-d2362de86050\") " pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:10.031873 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.031582    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:10:10.031873 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.031607    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:10:10.031873 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.031621    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5sfj6 for pod openshift-network-diagnostics/network-check-target-pmglx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:10.031873 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.031683    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6 podName:952af373-0793-4ff5-a4be-22907b42836a nodeName:}" failed. No retries permitted until 2026-07-24 17:10:10.5316647 +0000 UTC m=+3.159542548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5sfj6" (UniqueName: "kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6") pod "network-check-target-pmglx" (UID: "952af373-0793-4ff5-a4be-22907b42836a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:10.034655 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.034608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nc9h\" (UniqueName: \"kubernetes.io/projected/adb8bb0a-03c5-44a5-82ad-65d3e308ca00-kube-api-access-9nc9h\") pod \"ovnkube-node-dx9mm\" (UID: \"adb8bb0a-03c5-44a5-82ad-65d3e308ca00\") " pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.035367 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.035347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9rzv\" (UniqueName: \"kubernetes.io/projected/ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49-kube-api-access-r9rzv\") pod \"tuned-2fw2p\" (UID: \"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49\") " pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.035513 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.035473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4cvv\" (UniqueName: \"kubernetes.io/projected/5b05cebf-84b5-4f82-b8a2-883175c86b8f-kube-api-access-x4cvv\") pod \"multus-additional-cni-plugins-5d4ts\" (UID: \"5b05cebf-84b5-4f82-b8a2-883175c86b8f\") " pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.036028 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.035993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snjbf\" (UniqueName: \"kubernetes.io/projected/58ffc242-7629-4e3b-885d-fad30fe0923b-kube-api-access-snjbf\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:10.036368 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.036346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29tf\" (UniqueName: \"kubernetes.io/projected/e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3-kube-api-access-q29tf\") pod \"multus-n4rll\" (UID: \"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3\") " pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.110088 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.110049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-prz4f"
Jul 24 17:10:10.119458 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.119427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2b7zl"
Jul 24 17:10:10.131953 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.131931    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vl76g"
Jul 24 17:10:10.136903 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.136882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65"
Jul 24 17:10:10.145805 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.145784    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:10.151797 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.151777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n4rll"
Jul 24 17:10:10.159630 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.159610    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5d4ts"
Jul 24 17:10:10.167609 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.167592    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:10.174525 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.174505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2fw2p"
Jul 24 17:10:10.423027 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.422984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:10.423282 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.423141    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:10.423282 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.423221    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret podName:9a539260-c108-464f-a64c-4d43ab4b71f6 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:11.423199141 +0000 UTC m=+4.051076998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret") pod "global-pull-secret-syncer-rcw58" (UID: "9a539260-c108-464f-a64c-4d43ab4b71f6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:10.524403 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.524360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:10.524574 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.524545    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:10.524641 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.524626    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs podName:58ffc242-7629-4e3b-885d-fad30fe0923b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:11.524604952 +0000 UTC m=+4.152482800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs") pod "network-metrics-daemon-bwpql" (UID: "58ffc242-7629-4e3b-885d-fad30fe0923b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:10.625471 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.625432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:10.625677 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.625607    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:10:10.625677 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.625634    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:10:10.625677 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.625648    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5sfj6 for pod openshift-network-diagnostics/network-check-target-pmglx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:10.625854 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:10.625727    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6 podName:952af373-0793-4ff5-a4be-22907b42836a nodeName:}" failed. No retries permitted until 2026-07-24 17:10:11.625703356 +0000 UTC m=+4.253581194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sfj6" (UniqueName: "kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6") pod "network-check-target-pmglx" (UID: "952af373-0793-4ff5-a4be-22907b42836a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:10.847753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.847710    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:05:10 +0000 UTC" deadline="2028-04-09 00:20:12.084970606 +0000 UTC"
Jul 24 17:10:10.847753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:10.847745    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14983h10m1.23722983s"
Jul 24 17:10:11.018577 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:11.018335    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb8bb0a_03c5_44a5_82ad_65d3e308ca00.slice/crio-16e19352e46c955b259b41e7bf7aff2f6e4bfd19228947be1380c9bece55852c WatchSource:0}: Error finding container 16e19352e46c955b259b41e7bf7aff2f6e4bfd19228947be1380c9bece55852c: Status 404 returned error can't find the container with id 16e19352e46c955b259b41e7bf7aff2f6e4bfd19228947be1380c9bece55852c
Jul 24 17:10:11.023495 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:11.023465    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad09ae97_5035_40ee_9f5f_3ab7ca3d8f49.slice/crio-bf08057eb5eeee8396cf20ad70856ef0d54852306672879e61c791b39379ba3e WatchSource:0}: Error finding container bf08057eb5eeee8396cf20ad70856ef0d54852306672879e61c791b39379ba3e: Status 404 returned error can't find the container with id bf08057eb5eeee8396cf20ad70856ef0d54852306672879e61c791b39379ba3e
Jul 24 17:10:11.024230 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:11.024198    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2296e0ea_43c7_4caa_a363_d2362de86050.slice/crio-002cedd2e3eaa83688dc4ae11cf9fcfe785eec73d80d16ec063b0abe93515f55 WatchSource:0}: Error finding container 002cedd2e3eaa83688dc4ae11cf9fcfe785eec73d80d16ec063b0abe93515f55: Status 404 returned error can't find the container with id 002cedd2e3eaa83688dc4ae11cf9fcfe785eec73d80d16ec063b0abe93515f55
Jul 24 17:10:11.025036 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:11.025011    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode413578a_3b5d_40e5_b7f5_24c3f4d6e0d3.slice/crio-85de2f4b938a1944ac62c29447e90f5c1509f9bd720fbe12fda2101dc1ee4ee6 WatchSource:0}: Error finding container 85de2f4b938a1944ac62c29447e90f5c1509f9bd720fbe12fda2101dc1ee4ee6: Status 404 returned error can't find the container with id 85de2f4b938a1944ac62c29447e90f5c1509f9bd720fbe12fda2101dc1ee4ee6
Jul 24 17:10:11.026461 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:11.026440    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b05cebf_84b5_4f82_b8a2_883175c86b8f.slice/crio-bf945af1baf489b801ce44732fe16831fd0f7057e5028776f8553ff2545301ac WatchSource:0}: Error finding container bf945af1baf489b801ce44732fe16831fd0f7057e5028776f8553ff2545301ac: Status 404 returned error can't find the container with id bf945af1baf489b801ce44732fe16831fd0f7057e5028776f8553ff2545301ac
Jul 24 17:10:11.031866 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:11.031840    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a5d168_84a4_42e0_926f_939504b0eae7.slice/crio-024902f1222017b58860cf56e26ac477aa8d8752badc7898790eb55aeb55438e WatchSource:0}: Error finding container 024902f1222017b58860cf56e26ac477aa8d8752badc7898790eb55aeb55438e: Status 404 returned error can't find the container with id 024902f1222017b58860cf56e26ac477aa8d8752badc7898790eb55aeb55438e
Jul 24 17:10:11.032702 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:11.032681    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb32ddd1_1311_4384_b03b_f478d1ec09ca.slice/crio-79048e67261018e41566fbaf816959e8380ede997286b0f63f54e2c735baae4b WatchSource:0}: Error finding container 79048e67261018e41566fbaf816959e8380ede997286b0f63f54e2c735baae4b: Status 404 returned error can't find the container with id 79048e67261018e41566fbaf816959e8380ede997286b0f63f54e2c735baae4b
Jul 24 17:10:11.033638 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:11.033536    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e840b99_c2f4_4033_a7d9_bcbb7b1bfdd3.slice/crio-3ec50c599b4972fa5f32c38c642803b5866d76c80ae1e1eef7dc0bf8848b50d4 WatchSource:0}: Error finding container 3ec50c599b4972fa5f32c38c642803b5866d76c80ae1e1eef7dc0bf8848b50d4: Status 404 returned error can't find the container with id 3ec50c599b4972fa5f32c38c642803b5866d76c80ae1e1eef7dc0bf8848b50d4
Jul 24 17:10:11.034836 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:11.034738    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19bdf11_ed75_4696_abb0_8d3bc5b77315.slice/crio-8f9582a58549c1eaf34935c22e0304ccfbc111eb4c8e7e0d5b28989f8f598cd9 WatchSource:0}: Error finding container 8f9582a58549c1eaf34935c22e0304ccfbc111eb4c8e7e0d5b28989f8f598cd9: Status 404 returned error can't find the container with id 8f9582a58549c1eaf34935c22e0304ccfbc111eb4c8e7e0d5b28989f8f598cd9
Jul 24 17:10:11.436966 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.432909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:11.436966 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.433136    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:11.436966 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.433206    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret podName:9a539260-c108-464f-a64c-4d43ab4b71f6 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:13.433182749 +0000 UTC m=+6.061060583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret") pod "global-pull-secret-syncer-rcw58" (UID: "9a539260-c108-464f-a64c-4d43ab4b71f6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:11.534310 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.534214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:11.534477 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.534409    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:11.534537 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.534497    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs podName:58ffc242-7629-4e3b-885d-fad30fe0923b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:13.534472646 +0000 UTC m=+6.162350479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs") pod "network-metrics-daemon-bwpql" (UID: "58ffc242-7629-4e3b-885d-fad30fe0923b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:11.635600 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.635552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:11.635777 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.635752    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:10:11.635777 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.635774    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:10:11.635960 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.635789    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5sfj6 for pod openshift-network-diagnostics/network-check-target-pmglx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:11.635960 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.635874    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6 podName:952af373-0793-4ff5-a4be-22907b42836a nodeName:}" failed. No retries permitted until 2026-07-24 17:10:13.63583328 +0000 UTC m=+6.263711115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sfj6" (UniqueName: "kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6") pod "network-check-target-pmglx" (UID: "952af373-0793-4ff5-a4be-22907b42836a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:11.848829 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.848691    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:05:10 +0000 UTC" deadline="2028-04-18 11:09:22.046796878 +0000 UTC"
Jul 24 17:10:11.848829 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.848749    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15209h59m10.198053075s"
Jul 24 17:10:11.932042 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.932006    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:11.932219 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.932157    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:11.932728 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.932683    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:11.932807 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.932780    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:11.933094 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.933051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:11.933181 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:11.933161    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:11.960818 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.960750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" event={"ID":"b391d4f348573e91689bb0c2ff5339e9","Type":"ContainerStarted","Data":"0b65ae50c1b70295acd177d8cb5dccdec5a0431f39f9197ea6fcf6578feb2b94"}
Jul 24 17:10:11.972644 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.972609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2b7zl" event={"ID":"c19bdf11-ed75-4696-abb0-8d3bc5b77315","Type":"ContainerStarted","Data":"8f9582a58549c1eaf34935c22e0304ccfbc111eb4c8e7e0d5b28989f8f598cd9"}
Jul 24 17:10:11.987130 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.987075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vl76g" event={"ID":"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3","Type":"ContainerStarted","Data":"3ec50c599b4972fa5f32c38c642803b5866d76c80ae1e1eef7dc0bf8848b50d4"}
Jul 24 17:10:11.997585 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:11.997522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-prz4f" event={"ID":"a3a5d168-84a4-42e0-926f-939504b0eae7","Type":"ContainerStarted","Data":"024902f1222017b58860cf56e26ac477aa8d8752badc7898790eb55aeb55438e"}
Jul 24 17:10:12.018522 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:12.018484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d4ts" event={"ID":"5b05cebf-84b5-4f82-b8a2-883175c86b8f","Type":"ContainerStarted","Data":"bf945af1baf489b801ce44732fe16831fd0f7057e5028776f8553ff2545301ac"}
Jul 24 17:10:12.032141 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:12.032044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n4rll" event={"ID":"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3","Type":"ContainerStarted","Data":"85de2f4b938a1944ac62c29447e90f5c1509f9bd720fbe12fda2101dc1ee4ee6"}
Jul 24 17:10:12.043194 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:12.043115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f9t7x" event={"ID":"2296e0ea-43c7-4caa-a363-d2362de86050","Type":"ContainerStarted","Data":"002cedd2e3eaa83688dc4ae11cf9fcfe785eec73d80d16ec063b0abe93515f55"}
Jul 24 17:10:12.062188 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:12.062090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65" event={"ID":"bb32ddd1-1311-4384-b03b-f478d1ec09ca","Type":"ContainerStarted","Data":"79048e67261018e41566fbaf816959e8380ede997286b0f63f54e2c735baae4b"}
Jul 24 17:10:12.065812 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:12.065737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2fw2p" event={"ID":"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49","Type":"ContainerStarted","Data":"bf08057eb5eeee8396cf20ad70856ef0d54852306672879e61c791b39379ba3e"}
Jul 24 17:10:12.070960 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:12.070931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" event={"ID":"adb8bb0a-03c5-44a5-82ad-65d3e308ca00","Type":"ContainerStarted","Data":"16e19352e46c955b259b41e7bf7aff2f6e4bfd19228947be1380c9bece55852c"}
Jul 24 17:10:12.085745 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:12.085713    2563 generic.go:356] "Generic (PLEG): container finished" podID="6815e1a3ddf63c201106b77d621717d0" containerID="b12571a36a0049beef913ba1c8c049964f3dba16e4e23c00a9ced65ab110a637" exitCode=0
Jul 24 17:10:12.085911 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:12.085759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" event={"ID":"6815e1a3ddf63c201106b77d621717d0","Type":"ContainerDied","Data":"b12571a36a0049beef913ba1c8c049964f3dba16e4e23c00a9ced65ab110a637"}
Jul 24 17:10:12.104725 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:12.104659    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" podStartSLOduration=3.104639245 podStartE2EDuration="3.104639245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:11.981005884 +0000 UTC m=+4.608883757" watchObservedRunningTime="2026-07-24 17:10:12.104639245 +0000 UTC m=+4.732517103"
Jul 24 17:10:13.096162 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:13.096030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" event={"ID":"6815e1a3ddf63c201106b77d621717d0","Type":"ContainerStarted","Data":"9cda8063a3ea460659f5eff75ace428cadb7cceb57ae0485ba7e3ef98b239c80"}
Jul 24 17:10:13.113568 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:13.113511    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" podStartSLOduration=4.113490345 podStartE2EDuration="4.113490345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:13.112845377 +0000 UTC m=+5.740723236" watchObservedRunningTime="2026-07-24 17:10:13.113490345 +0000 UTC m=+5.741368204"
Jul 24 17:10:13.454122 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:13.453480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:13.454122 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.453682    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:13.454122 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.453753    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret podName:9a539260-c108-464f-a64c-4d43ab4b71f6 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:17.453731463 +0000 UTC m=+10.081609295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret") pod "global-pull-secret-syncer-rcw58" (UID: "9a539260-c108-464f-a64c-4d43ab4b71f6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:13.554507 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:13.554468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:13.554688 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.554652    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:13.554775 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.554721    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs podName:58ffc242-7629-4e3b-885d-fad30fe0923b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:17.554701109 +0000 UTC m=+10.182578956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs") pod "network-metrics-daemon-bwpql" (UID: "58ffc242-7629-4e3b-885d-fad30fe0923b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:13.655577 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:13.655532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:13.655786 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.655726    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:10:13.655786 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.655742    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:10:13.655786 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.655754    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5sfj6 for pod openshift-network-diagnostics/network-check-target-pmglx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:13.656085 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.655828    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6 podName:952af373-0793-4ff5-a4be-22907b42836a nodeName:}" failed. No retries permitted until 2026-07-24 17:10:17.655805899 +0000 UTC m=+10.283683752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sfj6" (UniqueName: "kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6") pod "network-check-target-pmglx" (UID: "952af373-0793-4ff5-a4be-22907b42836a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:13.932629 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:13.931907    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:13.932629 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.932044    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:13.932629 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:13.932410    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:13.932629 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.932505    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:13.933447 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:13.933046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:13.933447 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:13.933146    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:15.931921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:15.931891    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:15.932371 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:15.931929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:15.932371 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:15.932010    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:15.932371 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:15.932069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:15.932371 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:15.932184    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:15.932371 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:15.932265    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:17.491571 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:17.490978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:17.491571 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.491144    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:17.491571 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.491230    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret podName:9a539260-c108-464f-a64c-4d43ab4b71f6 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:25.491210617 +0000 UTC m=+18.119088452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret") pod "global-pull-secret-syncer-rcw58" (UID: "9a539260-c108-464f-a64c-4d43ab4b71f6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:17.591510 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:17.591481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:17.591649 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.591607    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:17.591690 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.591663    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs podName:58ffc242-7629-4e3b-885d-fad30fe0923b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:25.591649592 +0000 UTC m=+18.219527422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs") pod "network-metrics-daemon-bwpql" (UID: "58ffc242-7629-4e3b-885d-fad30fe0923b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:17.692255 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:17.692222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:17.692421 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.692368    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:10:17.692421 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.692385    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:10:17.692421 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.692394    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5sfj6 for pod openshift-network-diagnostics/network-check-target-pmglx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:17.692542 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.692440    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6 podName:952af373-0793-4ff5-a4be-22907b42836a nodeName:}" failed. No retries permitted until 2026-07-24 17:10:25.692426953 +0000 UTC m=+18.320304784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sfj6" (UniqueName: "kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6") pod "network-check-target-pmglx" (UID: "952af373-0793-4ff5-a4be-22907b42836a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:17.932036 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:17.932001    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:17.932185 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:17.932093    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:17.932185 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.932122    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:17.932185 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.932164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:17.932347 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:17.932217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:17.932347 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:17.932319    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:19.933375 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:19.933335    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:19.933848 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:19.933498    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:19.933963 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:19.933945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:19.934057 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:19.934038    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:19.934116 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:19.934090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:19.934184 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:19.934166    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:21.931077 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:21.931043    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:21.931512 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:21.931044    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:21.931512 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:21.931160    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:21.931512 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:21.931164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:21.931512 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:21.931245    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:21.931512 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:21.931312    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:23.931200 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:23.931164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:23.931654 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:23.931286    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:23.931654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:23.931164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:23.931654 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:23.931367    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:23.931654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:23.931164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:23.931654 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:23.931447    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:25.556512 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:25.556473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:25.557096 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.556638    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:25.557096 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.556723    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret podName:9a539260-c108-464f-a64c-4d43ab4b71f6 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:41.556701103 +0000 UTC m=+34.184578956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret") pod "global-pull-secret-syncer-rcw58" (UID: "9a539260-c108-464f-a64c-4d43ab4b71f6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:25.657260 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:25.657221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:25.657404 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.657381    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:25.657464 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.657457    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs podName:58ffc242-7629-4e3b-885d-fad30fe0923b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:41.657433157 +0000 UTC m=+34.285310989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs") pod "network-metrics-daemon-bwpql" (UID: "58ffc242-7629-4e3b-885d-fad30fe0923b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:25.757993 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:25.757957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:25.758149 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.758113    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:10:25.758149 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.758136    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:10:25.758149 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.758146    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5sfj6 for pod openshift-network-diagnostics/network-check-target-pmglx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:25.758254 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.758198    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6 podName:952af373-0793-4ff5-a4be-22907b42836a nodeName:}" failed. No retries permitted until 2026-07-24 17:10:41.758183895 +0000 UTC m=+34.386061726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sfj6" (UniqueName: "kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6") pod "network-check-target-pmglx" (UID: "952af373-0793-4ff5-a4be-22907b42836a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:25.930807 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:25.930765    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:25.930980 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:25.930765    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:25.930980 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.930921    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:25.930980 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:25.930769    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:25.930980 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.930955    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:25.931178 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:25.931037    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:27.932020 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:27.931983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:27.932424 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:27.932109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:27.932424 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:27.932106    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:27.932424 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:27.932232    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:27.932424 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:27.932288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:27.932424 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:27.932380    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:29.930632 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:29.930597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:29.930632 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:29.930634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:29.931203 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:29.930598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:29.931203 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:29.930724    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:29.931203 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:29.930776    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:29.931203 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:29.930869    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:31.143446 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.143092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n4rll" event={"ID":"e413578a-3b5d-40e5-b7f5-24c3f4d6e0d3","Type":"ContainerStarted","Data":"678e8e481bbe988a83f364278b43d6f99141de6aeaf03573ac2374b9d443515a"}
Jul 24 17:10:31.144574 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.144554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f9t7x" event={"ID":"2296e0ea-43c7-4caa-a363-d2362de86050","Type":"ContainerStarted","Data":"3f9aba2858afac17bb57470e87288960864941360b6fe7f6cece439d2736a466"}
Jul 24 17:10:31.145918 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.145895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65" event={"ID":"bb32ddd1-1311-4384-b03b-f478d1ec09ca","Type":"ContainerStarted","Data":"acd0a6fb2f869b33266ef238a15924a563b30ebb1f6b08bece82025b6f5b129b"}
Jul 24 17:10:31.147335 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.147310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2fw2p" event={"ID":"ad09ae97-5035-40ee-9f5f-3ab7ca3d8f49","Type":"ContainerStarted","Data":"c5311a6a68c78ed08a282a4f8c116180db6ac68605e9979899262ecd57d4f203"}
Jul 24 17:10:31.149995 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.149975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" event={"ID":"adb8bb0a-03c5-44a5-82ad-65d3e308ca00","Type":"ContainerStarted","Data":"00e7def028ecd39020ae6bd902985fa16b7c3920c35f2d476ad37df25ca5e9ad"}
Jul 24 17:10:31.150096 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.150030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" event={"ID":"adb8bb0a-03c5-44a5-82ad-65d3e308ca00","Type":"ContainerStarted","Data":"243bbe5421943828a1c9e6f04d504968fe94fc83a80649f969aa2c60944a0ff1"}
Jul 24 17:10:31.150096 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.150060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" event={"ID":"adb8bb0a-03c5-44a5-82ad-65d3e308ca00","Type":"ContainerStarted","Data":"f75fa1064a7260d5a7ca95c336083c05e05cf454ea731c26aa6ef324ba95b702"}
Jul 24 17:10:31.150096 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.150088    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" event={"ID":"adb8bb0a-03c5-44a5-82ad-65d3e308ca00","Type":"ContainerStarted","Data":"529d226be0a73891bc26384fbc85875f9b83e214ddef5f5e4ca74f754c575735"}
Jul 24 17:10:31.150219 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.150112    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" event={"ID":"adb8bb0a-03c5-44a5-82ad-65d3e308ca00","Type":"ContainerStarted","Data":"42825270a83fc0f242053b7dde79e64036a558cd0c56476336c6956dab9ddf6a"}
Jul 24 17:10:31.150219 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.150138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" event={"ID":"adb8bb0a-03c5-44a5-82ad-65d3e308ca00","Type":"ContainerStarted","Data":"7b88b23f918a2bbbe082f1db5b2dcb9e30258d110562ab8081fdb572da8005ae"}
Jul 24 17:10:31.151276 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.151255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vl76g" event={"ID":"1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3","Type":"ContainerStarted","Data":"263dca35eb7c3fb84fcfc046b580069582865d3a6b9412b17d39a2672d9530ed"}
Jul 24 17:10:31.155327 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.152474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-prz4f" event={"ID":"a3a5d168-84a4-42e0-926f-939504b0eae7","Type":"ContainerStarted","Data":"aca97bf84676e5bef74362fcef1d2b15275ba3d2b53cb474803196fe072682a4"}
Jul 24 17:10:31.156648 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.156626    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b05cebf-84b5-4f82-b8a2-883175c86b8f" containerID="9061b532b9e5d2eef464c1cb50544762924047d737b9f2390aac4c99759fb96e" exitCode=0
Jul 24 17:10:31.156741 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.156656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d4ts" event={"ID":"5b05cebf-84b5-4f82-b8a2-883175c86b8f","Type":"ContainerDied","Data":"9061b532b9e5d2eef464c1cb50544762924047d737b9f2390aac4c99759fb96e"}
Jul 24 17:10:31.160836 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.160781    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n4rll" podStartSLOduration=3.904328076 podStartE2EDuration="23.160770194s" totalImagesPullingTime="19.256442118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:31.160379801 +0000 UTC m=+23.788257654" watchObservedRunningTime="2026-07-24 17:10:31.160770194 +0000 UTC m=+23.788648046"
Jul 24 17:10:31.194699 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.194663    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f9t7x" podStartSLOduration=8.101186056 podStartE2EDuration="23.194651615s" totalImagesPullingTime="15.093465559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:31.194204979 +0000 UTC m=+23.822082825" watchObservedRunningTime="2026-07-24 17:10:31.194651615 +0000 UTC m=+23.822529467"
Jul 24 17:10:31.210330 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.210291    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2fw2p" podStartSLOduration=3.986308916 podStartE2EDuration="23.210281061s" totalImagesPullingTime="19.223972145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:31.210278584 +0000 UTC m=+23.838156436" watchObservedRunningTime="2026-07-24 17:10:31.210281061 +0000 UTC m=+23.838158913"
Jul 24 17:10:31.228358 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.228261    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vl76g" podStartSLOduration=4.058005179 podStartE2EDuration="23.228247739s" totalImagesPullingTime="19.17024256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:31.226726797 +0000 UTC m=+23.854604649" watchObservedRunningTime="2026-07-24 17:10:31.228247739 +0000 UTC m=+23.856125587"
Jul 24 17:10:31.253977 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.253943    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-prz4f" podStartSLOduration=4.051425114 podStartE2EDuration="23.253931445s" totalImagesPullingTime="19.202506331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:31.250822028 +0000 UTC m=+23.878699881" watchObservedRunningTime="2026-07-24 17:10:31.253931445 +0000 UTC m=+23.881809297"
Jul 24 17:10:31.930731 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.930426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:31.930731 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.930452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:31.930731 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:31.930531    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:31.930731 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:31.930547    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:31.930731 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:31.930598    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:31.930731 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:31.930710    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:32.069866 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:32.069842    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 17:10:32.160810 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:32.160766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2b7zl" event={"ID":"c19bdf11-ed75-4696-abb0-8d3bc5b77315","Type":"ContainerStarted","Data":"d5ca2914408837b2710479ae5b4bb7ed4c87f4c63d08f0a891dcf3e775702d3f"}
Jul 24 17:10:32.163297 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:32.163268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65" event={"ID":"bb32ddd1-1311-4384-b03b-f478d1ec09ca","Type":"ContainerStarted","Data":"8f27ac1921be91f9ad2fcd2ce1195e0ef83a569d6982316762c5f6c8bc3a1d9c"}
Jul 24 17:10:32.176945 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:32.176907    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2b7zl" podStartSLOduration=5.006670517 podStartE2EDuration="24.176890543s" totalImagesPullingTime="19.170220026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:32.176530562 +0000 UTC m=+24.804408414" watchObservedRunningTime="2026-07-24 17:10:32.176890543 +0000 UTC m=+24.804768397"
Jul 24 17:10:32.881132 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:32.881049    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T17:10:32.069860375Z","UUID":"14892967-c1ed-4f82-a66d-faef4ce0fc47","Handler":null,"Name":"","Endpoint":""}
Jul 24 17:10:32.882763 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:32.882743    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 17:10:32.882933 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:32.882780    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 17:10:33.169180 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:33.169147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" event={"ID":"adb8bb0a-03c5-44a5-82ad-65d3e308ca00","Type":"ContainerStarted","Data":"093107c422a0542fa2cedfa89de0c0a9d93ac6221368c45df35e1ae6baec8cc2"}
Jul 24 17:10:33.669818 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:33.669655    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:33.670225 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:33.670207    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:33.930862 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:33.930838    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:33.931004 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:33.930896    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:33.931004 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:33.930900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:33.931004 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:33.930988    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:33.931105 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:33.931014    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:33.931105 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:33.931073    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:34.173680 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:34.173639    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65" event={"ID":"bb32ddd1-1311-4384-b03b-f478d1ec09ca","Type":"ContainerStarted","Data":"4b2c1360308a0905f8bbe474083f451d684464a9934c2efe8f40258e2ee2c413"}
Jul 24 17:10:34.191941 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:34.191846    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmf65" podStartSLOduration=4.043621762 podStartE2EDuration="26.191831955s" totalImagesPullingTime="22.148210193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:34.190231704 +0000 UTC m=+26.818109557" watchObservedRunningTime="2026-07-24 17:10:34.191831955 +0000 UTC m=+26.819709807"
Jul 24 17:10:35.180007 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:35.179977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" event={"ID":"adb8bb0a-03c5-44a5-82ad-65d3e308ca00","Type":"ContainerStarted","Data":"4ed252756dcf57a1285a92b669a5a2555178c7b73ef07dabf6085f5170edbc20"}
Jul 24 17:10:35.215364 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:35.213328    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm" podStartSLOduration=7.923237946 podStartE2EDuration="27.213303308s" totalImagesPullingTime="19.290065362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:35.212516937 +0000 UTC m=+27.840394788" watchObservedRunningTime="2026-07-24 17:10:35.213303308 +0000 UTC m=+27.841181164"
Jul 24 17:10:35.931189 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:35.930671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:35.931189 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:35.930685    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:35.931189 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:35.930684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:35.931189 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:35.930827    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:35.931189 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:35.930965    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:35.931189 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:35.931040    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:36.182867 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:36.182772    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:36.183288 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:36.182877    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:36.183288 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:36.182926    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:36.200736 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:36.200711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:36.201031 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:36.201009    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:10:36.683424 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:36.683395    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:36.683627 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:36.683538    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 17:10:36.684049 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:36.684027    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f9t7x"
Jul 24 17:10:37.186478 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:37.186451    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b05cebf-84b5-4f82-b8a2-883175c86b8f" containerID="8160dcc40c12a6f71f2b3580a31168a65a2ec952ec6092d84e9683f39721e4fe" exitCode=0
Jul 24 17:10:37.186905 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:37.186549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d4ts" event={"ID":"5b05cebf-84b5-4f82-b8a2-883175c86b8f","Type":"ContainerDied","Data":"8160dcc40c12a6f71f2b3580a31168a65a2ec952ec6092d84e9683f39721e4fe"}
Jul 24 17:10:37.316620 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:37.316589    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rcw58"]
Jul 24 17:10:37.316761 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:37.316732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:37.316863 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:37.316840    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:37.319834 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:37.319785    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pmglx"]
Jul 24 17:10:37.319958 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:37.319905    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:37.320030 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:37.320003    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:37.320493 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:37.320468    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bwpql"]
Jul 24 17:10:37.320650 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:37.320576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:37.320703 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:37.320681    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:38.930930 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:38.930906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:38.931287 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:38.930946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:38.931287 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:38.931041    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:38.931287 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:38.931085    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:38.931287 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:38.931155    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:38.931287 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:38.931216    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:39.191896 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:39.191827    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b05cebf-84b5-4f82-b8a2-883175c86b8f" containerID="95a8160adf35bd55a1b24d3654693b022ea4f0d7c95b7db43a76c8add883aa85" exitCode=0
Jul 24 17:10:39.191896 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:39.191865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d4ts" event={"ID":"5b05cebf-84b5-4f82-b8a2-883175c86b8f","Type":"ContainerDied","Data":"95a8160adf35bd55a1b24d3654693b022ea4f0d7c95b7db43a76c8add883aa85"}
Jul 24 17:10:40.196489 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:40.196279    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b05cebf-84b5-4f82-b8a2-883175c86b8f" containerID="934fdfce3485d10819e6152e6b45ef7b203c7139e54297ec27207950db93dcb4" exitCode=0
Jul 24 17:10:40.196973 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:40.196364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d4ts" event={"ID":"5b05cebf-84b5-4f82-b8a2-883175c86b8f","Type":"ContainerDied","Data":"934fdfce3485d10819e6152e6b45ef7b203c7139e54297ec27207950db93dcb4"}
Jul 24 17:10:40.930719 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:40.930683    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:40.930719 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:40.930710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:40.930996 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:40.930710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:40.930996 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:40.930825    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:40.930996 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:40.930913    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:40.931131 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:40.931028    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:41.576786 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:41.576704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:41.577352 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:41.576877    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:41.577352 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:41.576944    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret podName:9a539260-c108-464f-a64c-4d43ab4b71f6 nodeName:}" failed. No retries permitted until 2026-07-24 17:11:13.576926241 +0000 UTC m=+66.204804085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret") pod "global-pull-secret-syncer-rcw58" (UID: "9a539260-c108-464f-a64c-4d43ab4b71f6") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:10:41.677307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:41.677274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:41.677445 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:41.677388    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:41.677445 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:41.677438    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs podName:58ffc242-7629-4e3b-885d-fad30fe0923b nodeName:}" failed. No retries permitted until 2026-07-24 17:11:13.677425108 +0000 UTC m=+66.305302938 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs") pod "network-metrics-daemon-bwpql" (UID: "58ffc242-7629-4e3b-885d-fad30fe0923b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:10:41.777898 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:41.777866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:41.778070 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:41.778034    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:10:41.778070 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:41.778056    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:10:41.778070 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:41.778070    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5sfj6 for pod openshift-network-diagnostics/network-check-target-pmglx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:41.778234 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:41.778130    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6 podName:952af373-0793-4ff5-a4be-22907b42836a nodeName:}" failed. No retries permitted until 2026-07-24 17:11:13.778111549 +0000 UTC m=+66.405989385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sfj6" (UniqueName: "kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6") pod "network-check-target-pmglx" (UID: "952af373-0793-4ff5-a4be-22907b42836a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:10:42.930403 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:42.930369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:42.930930 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:42.930492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:42.930930 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:42.930505    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmglx" podUID="952af373-0793-4ff5-a4be-22907b42836a"
Jul 24 17:10:42.930930 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:42.930524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:42.930930 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:42.930586    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rcw58" podUID="9a539260-c108-464f-a64c-4d43ab4b71f6"
Jul 24 17:10:42.930930 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:42.930696    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwpql" podUID="58ffc242-7629-4e3b-885d-fad30fe0923b"
Jul 24 17:10:43.182961 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.182923    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeReady"
Jul 24 17:10:43.183158 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.183096    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 17:10:43.242542 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.242512    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-qz8rp"]
Jul 24 17:10:43.245053 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.244984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.246146 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.246015    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"]
Jul 24 17:10:43.248342 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.248319    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 24 17:10:43.248436 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.248329    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 24 17:10:43.248436 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.248372    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.248436 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.248408    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.249201 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.249179    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"]
Jul 24 17:10:43.249308 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.249289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:43.251870 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.251855    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"]
Jul 24 17:10:43.251978 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.251963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.252724 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.252701    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 24 17:10:43.252724 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.252703    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.254165 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.254148    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.254249 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.254165    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-g6bkr\""
Jul 24 17:10:43.254408 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.254393    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 24 17:10:43.254995 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.254979    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-h424t"]
Jul 24 17:10:43.255084 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.255073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.255947 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.255931    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.256991 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.256975    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.257082 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.257025    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 24 17:10:43.257082 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.257065    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h5bnz\""
Jul 24 17:10:43.257195 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.257136    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 24 17:10:43.257276 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.257261    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2dpqf\""
Jul 24 17:10:43.257634 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.257617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 24 17:10:43.257713 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.257692    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"]
Jul 24 17:10:43.257834 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.257820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.258233 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.258215    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8kncp\""
Jul 24 17:10:43.258485 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.258471    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.258630 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.258616    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 24 17:10:43.258942 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.258930    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.260425 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.260376    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7fdb95cfb7-czwhl"]
Jul 24 17:10:43.260530 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.260483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:43.261015 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.260995    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gcr7n\""
Jul 24 17:10:43.261137 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.261016    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.261137 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.260999    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 24 17:10:43.261137 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.261019    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 24 17:10:43.261370 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.261261    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.262711 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.262698    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 24 17:10:43.263410 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.263393    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"]
Jul 24 17:10:43.263516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.263503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.266396 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.266359    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-685d778d68-xht5f"]
Jul 24 17:10:43.266509 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.266472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.266815 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.266772    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 24 17:10:43.268154 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.267614    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 24 17:10:43.268154 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.267845    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cjp5p\""
Jul 24 17:10:43.268154 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.267881    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.268762 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.268712    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.269255 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.269234    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 24 17:10:43.270278 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.270238    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 24 17:10:43.270546 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.270495    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-98l9k\""
Jul 24 17:10:43.270864 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.270783    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 24 17:10:43.271822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.271194    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 24 17:10:43.272946 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.272047    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.275872 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.275852    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d"]
Jul 24 17:10:43.278968 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.278852    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jc776\""
Jul 24 17:10:43.278968 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.278900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.279672 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.279648    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 24 17:10:43.280123 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.280099    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 24 17:10:43.281779 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.281752    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"]
Jul 24 17:10:43.281893 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.281821    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"]
Jul 24 17:10:43.281893 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.281843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-qz8rp"]
Jul 24 17:10:43.281893 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.281862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"]
Jul 24 17:10:43.281893 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.281886    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"]
Jul 24 17:10:43.282053 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.281905    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d"]
Jul 24 17:10:43.282053 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.281929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d"
Jul 24 17:10:43.282647 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.282631    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 17:10:43.282853 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.282633    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.282941 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.282896    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 17:10:43.283000 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.282684    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"]
Jul 24 17:10:43.283235 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.283216    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 17:10:43.283315 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.283301    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g65mg\""
Jul 24 17:10:43.283623 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.283406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fdb95cfb7-czwhl"]
Jul 24 17:10:43.284205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.284185    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-685d778d68-xht5f"]
Jul 24 17:10:43.284816 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.284781    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.284956 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.284935    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.285026 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.284991    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7"]
Jul 24 17:10:43.286707 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.286681    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8tqk2\""
Jul 24 17:10:43.288222 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.288198    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j8hqc"]
Jul 24 17:10:43.288696 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.288333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7"
Jul 24 17:10:43.289503 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.289485    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 17:10:43.291475 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.291455    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vj8m9\""
Jul 24 17:10:43.291597 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.291532    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.291669 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.291455    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.293400 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.293380    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g6grh"]
Jul 24 17:10:43.293875 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.293576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.295867 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.295850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 17:10:43.296458 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.296426    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 17:10:43.296711 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.296456    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cpjrs\""
Jul 24 17:10:43.296985 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.296970    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-h424t"]
Jul 24 17:10:43.297033 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.297003    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7"]
Jul 24 17:10:43.297033 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.297024    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6grh"]
Jul 24 17:10:43.297156 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.297097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6grh"
Jul 24 17:10:43.299786 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.299770    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g5d6l\""
Jul 24 17:10:43.300042 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.299923    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 17:10:43.300042 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.299941    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 17:10:43.300185 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.300171    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 17:10:43.306667 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.306643    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8hqc"]
Jul 24 17:10:43.388327 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ktkk\" (UniqueName: \"kubernetes.io/projected/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-kube-api-access-8ktkk\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.388327 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nws94\" (UniqueName: \"kubernetes.io/projected/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-kube-api-access-nws94\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-687xh\" (UniqueName: \"kubernetes.io/projected/e7799dec-999d-473b-9520-596631542053-kube-api-access-687xh\") pod \"service-ca-operator-5d6c75f84f-gw86m\" (UID: \"e7799dec-999d-473b-9520-596631542053\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4117eff4-ef14-4caa-836b-1c377499a2c7-serving-cert\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhm8f\" (UniqueName: \"kubernetes.io/projected/b04a360e-6ddc-4772-b74c-23b4e0e4f6ef-kube-api-access-lhm8f\") pod \"ingress-canary-g6grh\" (UID: \"b04a360e-6ddc-4772-b74c-23b4e0e4f6ef\") " pod="openshift-ingress-canary/ingress-canary-g6grh"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-default-certificate\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aefcb407-941b-458d-a730-9dcd9cfa4546-config\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388559    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7x48\" (UniqueName: \"kubernetes.io/projected/4117eff4-ef14-4caa-836b-1c377499a2c7-kube-api-access-d7x48\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3f934e78-0a38-43f9-9e4b-145cba4c780b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h28qq\" (UniqueName: \"kubernetes.io/projected/bd972454-db03-460f-930e-70f7d8982857-kube-api-access-h28qq\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-image-registry-private-configuration\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.388654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p72vx\" (UniqueName: \"kubernetes.io/projected/96201cf2-414e-4660-b819-d8598262234b-kube-api-access-p72vx\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zct84\" (UID: \"96201cf2-414e-4660-b819-d8598262234b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7799dec-999d-473b-9520-596631542053-config\") pod \"service-ca-operator-5d6c75f84f-gw86m\" (UID: \"e7799dec-999d-473b-9520-596631542053\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4117eff4-ef14-4caa-836b-1c377499a2c7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll45t\" (UniqueName: \"kubernetes.io/projected/aefcb407-941b-458d-a730-9dcd9cfa4546-kube-api-access-ll45t\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd972454-db03-460f-930e-70f7d8982857-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-certificates\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-trusted-ca\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.388996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b164e94-9a0b-490a-b256-77a42b0dc2f8-ca-trust-extracted\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-stats-auth\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7799dec-999d-473b-9520-596631542053-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gw86m\" (UID: \"e7799dec-999d-473b-9520-596631542053\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389193    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4117eff4-ef14-4caa-836b-1c377499a2c7-tmp\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.389357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4117eff4-ef14-4caa-836b-1c377499a2c7-service-ca-bundle\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbq2v\" (UniqueName: \"kubernetes.io/projected/46f5e6cd-84b7-41e4-b0cc-502e64bf5bf5-kube-api-access-xbq2v\") pod \"network-check-source-7d88cb55d8-75wz7\" (UID: \"46f5e6cd-84b7-41e4-b0cc-502e64bf5bf5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5phc\" (UniqueName: \"kubernetes.io/projected/91a715da-e2ce-46ea-9b92-0a0b5290ea02-kube-api-access-g5phc\") pod \"volume-data-source-validator-549c6d54cf-b9v5d\" (UID: \"91a715da-e2ce-46ea-9b92-0a0b5290ea02\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96201cf2-414e-4660-b819-d8598262234b-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zct84\" (UID: \"96201cf2-414e-4660-b819-d8598262234b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-config-volume\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-bound-sa-token\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4117eff4-ef14-4caa-836b-1c377499a2c7-snapshots\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22wsm\" (UniqueName: \"kubernetes.io/projected/9d06e44e-82c7-434e-b132-c55253507247-kube-api-access-22wsm\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96201cf2-414e-4660-b819-d8598262234b-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zct84\" (UID: \"96201cf2-414e-4660-b819-d8598262234b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-tmp-dir\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b04a360e-6ddc-4772-b74c-23b4e0e4f6ef-cert\") pod \"ingress-canary-g6grh\" (UID: \"b04a360e-6ddc-4772-b74c-23b4e0e4f6ef\") " pod="openshift-ingress-canary/ingress-canary-g6grh"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aefcb407-941b-458d-a730-9dcd9cfa4546-serving-cert\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-installation-pull-secrets\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.390313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aefcb407-941b-458d-a730-9dcd9cfa4546-trusted-ca\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.390969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.389851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxtzh\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-kube-api-access-kxtzh\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.490966 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.490882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-tmp-dir\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.490966 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.490917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b04a360e-6ddc-4772-b74c-23b4e0e4f6ef-cert\") pod \"ingress-canary-g6grh\" (UID: \"b04a360e-6ddc-4772-b74c-23b4e0e4f6ef\") " pod="openshift-ingress-canary/ingress-canary-g6grh"
Jul 24 17:10:43.490966 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.490935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aefcb407-941b-458d-a730-9dcd9cfa4546-serving-cert\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.491284 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-tmp-dir\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.491350 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-installation-pull-secrets\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.491350 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aefcb407-941b-458d-a730-9dcd9cfa4546-trusted-ca\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.491443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxtzh\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-kube-api-access-kxtzh\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.491443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ktkk\" (UniqueName: \"kubernetes.io/projected/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-kube-api-access-8ktkk\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.491443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nws94\" (UniqueName: \"kubernetes.io/projected/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-kube-api-access-nws94\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:43.491443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-687xh\" (UniqueName: \"kubernetes.io/projected/e7799dec-999d-473b-9520-596631542053-kube-api-access-687xh\") pod \"service-ca-operator-5d6c75f84f-gw86m\" (UID: \"e7799dec-999d-473b-9520-596631542053\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.491443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4117eff4-ef14-4caa-836b-1c377499a2c7-serving-cert\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.491659 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.491659 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhm8f\" (UniqueName: \"kubernetes.io/projected/b04a360e-6ddc-4772-b74c-23b4e0e4f6ef-kube-api-access-lhm8f\") pod \"ingress-canary-g6grh\" (UID: \"b04a360e-6ddc-4772-b74c-23b4e0e4f6ef\") " pod="openshift-ingress-canary/ingress-canary-g6grh"
Jul 24 17:10:43.491659 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-default-certificate\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.491659 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aefcb407-941b-458d-a730-9dcd9cfa4546-config\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.491659 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.491650    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.491987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7x48\" (UniqueName: \"kubernetes.io/projected/4117eff4-ef14-4caa-836b-1c377499a2c7-kube-api-access-d7x48\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3f934e78-0a38-43f9-9e4b-145cba4c780b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h28qq\" (UniqueName: \"kubernetes.io/projected/bd972454-db03-460f-930e-70f7d8982857-kube-api-access-h28qq\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-image-registry-private-configuration\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p72vx\" (UniqueName: \"kubernetes.io/projected/96201cf2-414e-4660-b819-d8598262234b-kube-api-access-p72vx\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zct84\" (UID: \"96201cf2-414e-4660-b819-d8598262234b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aefcb407-941b-458d-a730-9dcd9cfa4546-config\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7799dec-999d-473b-9520-596631542053-config\") pod \"service-ca-operator-5d6c75f84f-gw86m\" (UID: \"e7799dec-999d-473b-9520-596631542053\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.492257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4117eff4-ef14-4caa-836b-1c377499a2c7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll45t\" (UniqueName: \"kubernetes.io/projected/aefcb407-941b-458d-a730-9dcd9cfa4546-kube-api-access-ll45t\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd972454-db03-460f-930e-70f7d8982857-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-certificates\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-trusted-ca\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492390    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aefcb407-941b-458d-a730-9dcd9cfa4546-trusted-ca\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b164e94-9a0b-490a-b256-77a42b0dc2f8-ca-trust-extracted\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-stats-auth\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7799dec-999d-473b-9520-596631542053-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gw86m\" (UID: \"e7799dec-999d-473b-9520-596631542053\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4117eff4-ef14-4caa-836b-1c377499a2c7-tmp\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4117eff4-ef14-4caa-836b-1c377499a2c7-service-ca-bundle\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbq2v\" (UniqueName: \"kubernetes.io/projected/46f5e6cd-84b7-41e4-b0cc-502e64bf5bf5-kube-api-access-xbq2v\") pod \"network-check-source-7d88cb55d8-75wz7\" (UID: \"46f5e6cd-84b7-41e4-b0cc-502e64bf5bf5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5phc\" (UniqueName: \"kubernetes.io/projected/91a715da-e2ce-46ea-9b92-0a0b5290ea02-kube-api-access-g5phc\") pod \"volume-data-source-validator-549c6d54cf-b9v5d\" (UID: \"91a715da-e2ce-46ea-9b92-0a0b5290ea02\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d"
Jul 24 17:10:43.492754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b164e94-9a0b-490a-b256-77a42b0dc2f8-ca-trust-extracted\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492695    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7799dec-999d-473b-9520-596631542053-config\") pod \"service-ca-operator-5d6c75f84f-gw86m\" (UID: \"e7799dec-999d-473b-9520-596631542053\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96201cf2-414e-4660-b819-d8598262234b-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zct84\" (UID: \"96201cf2-414e-4660-b819-d8598262234b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-config-volume\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-bound-sa-token\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4117eff4-ef14-4caa-836b-1c377499a2c7-snapshots\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22wsm\" (UniqueName: \"kubernetes.io/projected/9d06e44e-82c7-434e-b132-c55253507247-kube-api-access-22wsm\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.492904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96201cf2-414e-4660-b819-d8598262234b-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zct84\" (UID: \"96201cf2-414e-4660-b819-d8598262234b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.493301    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.493359    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls podName:c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d nodeName:}" failed. No retries permitted until 2026-07-24 17:10:43.993342524 +0000 UTC m=+36.621220358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls") pod "dns-default-j8hqc" (UID: "c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d") : secret "dns-default-metrics-tls" not found
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.493362    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-certificates\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.494019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.493430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96201cf2-414e-4660-b819-d8598262234b-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zct84\" (UID: \"96201cf2-414e-4660-b819-d8598262234b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.494745 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.494410    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-trusted-ca\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.494931 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.494903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4117eff4-ef14-4caa-836b-1c377499a2c7-tmp\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.495060 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.495024    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:10:43.495121 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.495063    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685d778d68-xht5f: secret "image-registry-tls" not found
Jul 24 17:10:43.495177 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.495135    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls podName:6b164e94-9a0b-490a-b256-77a42b0dc2f8 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:43.995118422 +0000 UTC m=+36.622996265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls") pod "image-registry-685d778d68-xht5f" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8") : secret "image-registry-tls" not found
Jul 24 17:10:43.495244 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.495187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4117eff4-ef14-4caa-836b-1c377499a2c7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.495393 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.495347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4117eff4-ef14-4caa-836b-1c377499a2c7-service-ca-bundle\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.495477 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.495427    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:10:43.495477 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.495466    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert podName:3f934e78-0a38-43f9-9e4b-145cba4c780b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:43.995454146 +0000 UTC m=+36.623331976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqxkv" (UID: "3f934e78-0a38-43f9-9e4b-145cba4c780b") : secret "networking-console-plugin-cert" not found
Jul 24 17:10:43.495627 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.495613    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:43.995565031 +0000 UTC m=+36.623442880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : configmap references non-existent config key: service-ca.crt
Jul 24 17:10:43.495723 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.495680    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:43.495779 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.495719    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls podName:bd972454-db03-460f-930e-70f7d8982857 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:43.995706575 +0000 UTC m=+36.623584441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wjlkv" (UID: "bd972454-db03-460f-930e-70f7d8982857") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:43.495964 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.495907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3f934e78-0a38-43f9-9e4b-145cba4c780b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:43.496261 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.496238    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:43.996216013 +0000 UTC m=+36.624093850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : secret "router-metrics-certs-default" not found
Jul 24 17:10:43.496485 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.496463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7799dec-999d-473b-9520-596631542053-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gw86m\" (UID: \"e7799dec-999d-473b-9520-596631542053\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.496571 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.496533    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:10:43.496632 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.496582    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls podName:3634ccae-7981-4cfb-9e57-0d3fb344fbbd nodeName:}" failed. No retries permitted until 2026-07-24 17:10:43.996567822 +0000 UTC m=+36.624445661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls") pod "cluster-samples-operator-6748489656-fzxpt" (UID: "3634ccae-7981-4cfb-9e57-0d3fb344fbbd") : secret "samples-operator-tls" not found
Jul 24 17:10:43.496632 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.496474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd972454-db03-460f-930e-70f7d8982857-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.496832 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.496818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4117eff4-ef14-4caa-836b-1c377499a2c7-snapshots\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.497065 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.497044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-config-volume\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.497942 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.497833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aefcb407-941b-458d-a730-9dcd9cfa4546-serving-cert\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.498483 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.498461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-image-registry-private-configuration\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.498585 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.498569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96201cf2-414e-4660-b819-d8598262234b-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zct84\" (UID: \"96201cf2-414e-4660-b819-d8598262234b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.498974 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.498953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b04a360e-6ddc-4772-b74c-23b4e0e4f6ef-cert\") pod \"ingress-canary-g6grh\" (UID: \"b04a360e-6ddc-4772-b74c-23b4e0e4f6ef\") " pod="openshift-ingress-canary/ingress-canary-g6grh"
Jul 24 17:10:43.499492 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.499471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-default-certificate\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.499748 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.499732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-stats-auth\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.501686 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.501664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-installation-pull-secrets\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.501946 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.501928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4117eff4-ef14-4caa-836b-1c377499a2c7-serving-cert\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.504292 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.504268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nws94\" (UniqueName: \"kubernetes.io/projected/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-kube-api-access-nws94\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:43.505290 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.505266    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxtzh\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-kube-api-access-kxtzh\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.505935 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.505914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhm8f\" (UniqueName: \"kubernetes.io/projected/b04a360e-6ddc-4772-b74c-23b4e0e4f6ef-kube-api-access-lhm8f\") pod \"ingress-canary-g6grh\" (UID: \"b04a360e-6ddc-4772-b74c-23b4e0e4f6ef\") " pod="openshift-ingress-canary/ingress-canary-g6grh"
Jul 24 17:10:43.507911 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.507594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h28qq\" (UniqueName: \"kubernetes.io/projected/bd972454-db03-460f-930e-70f7d8982857-kube-api-access-h28qq\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.508232 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.508140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ktkk\" (UniqueName: \"kubernetes.io/projected/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-kube-api-access-8ktkk\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.509029 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.509004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7x48\" (UniqueName: \"kubernetes.io/projected/4117eff4-ef14-4caa-836b-1c377499a2c7-kube-api-access-d7x48\") pod \"insights-operator-5885fdb759-h424t\" (UID: \"4117eff4-ef14-4caa-836b-1c377499a2c7\") " pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.510266 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.510068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-687xh\" (UniqueName: \"kubernetes.io/projected/e7799dec-999d-473b-9520-596631542053-kube-api-access-687xh\") pod \"service-ca-operator-5d6c75f84f-gw86m\" (UID: \"e7799dec-999d-473b-9520-596631542053\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.510727 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.510706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5phc\" (UniqueName: \"kubernetes.io/projected/91a715da-e2ce-46ea-9b92-0a0b5290ea02-kube-api-access-g5phc\") pod \"volume-data-source-validator-549c6d54cf-b9v5d\" (UID: \"91a715da-e2ce-46ea-9b92-0a0b5290ea02\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d"
Jul 24 17:10:43.511013 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.510991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll45t\" (UniqueName: \"kubernetes.io/projected/aefcb407-941b-458d-a730-9dcd9cfa4546-kube-api-access-ll45t\") pod \"console-operator-584dcb6b54-qz8rp\" (UID: \"aefcb407-941b-458d-a730-9dcd9cfa4546\") " pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.512313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.512103    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-bound-sa-token\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.512313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.512272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p72vx\" (UniqueName: \"kubernetes.io/projected/96201cf2-414e-4660-b819-d8598262234b-kube-api-access-p72vx\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zct84\" (UID: \"96201cf2-414e-4660-b819-d8598262234b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.512514 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.512409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22wsm\" (UniqueName: \"kubernetes.io/projected/9d06e44e-82c7-434e-b132-c55253507247-kube-api-access-22wsm\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.513688 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.513670    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbq2v\" (UniqueName: \"kubernetes.io/projected/46f5e6cd-84b7-41e4-b0cc-502e64bf5bf5-kube-api-access-xbq2v\") pod \"network-check-source-7d88cb55d8-75wz7\" (UID: \"46f5e6cd-84b7-41e4-b0cc-502e64bf5bf5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7"
Jul 24 17:10:43.557684 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.557646    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:43.580939 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.580907    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"
Jul 24 17:10:43.589194 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.589165    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"
Jul 24 17:10:43.599425 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.599394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-h424t"
Jul 24 17:10:43.636758 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.635269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d"
Jul 24 17:10:43.639497 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.638948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7"
Jul 24 17:10:43.652865 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.652772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6grh"
Jul 24 17:10:43.816851 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.816715    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-qz8rp"]
Jul 24 17:10:43.822931 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.822869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m"]
Jul 24 17:10:43.825720 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.825598    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84"]
Jul 24 17:10:43.852787 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.852755    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-h424t"]
Jul 24 17:10:43.857553 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.857533    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7"]
Jul 24 17:10:43.865136 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.865116    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d"]
Jul 24 17:10:43.996834 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.996778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.996883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.996940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.996959    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.996966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.997013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997028    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls podName:3634ccae-7981-4cfb-9e57-0d3fb344fbbd nodeName:}" failed. No retries permitted until 2026-07-24 17:10:44.997007836 +0000 UTC m=+37.624885683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls") pod "cluster-samples-operator-6748489656-fzxpt" (UID: "3634ccae-7981-4cfb-9e57-0d3fb344fbbd") : secret "samples-operator-tls" not found
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.997063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997062    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997082    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997095    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:44.99707554 +0000 UTC m=+37.624953402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : configmap references non-existent config key: service-ca.crt
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997117    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997124    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:44.99711254 +0000 UTC m=+37.624990373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : secret "router-metrics-certs-default" not found
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997148    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls podName:bd972454-db03-460f-930e-70f7d8982857 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:44.997139237 +0000 UTC m=+37.625017073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wjlkv" (UID: "bd972454-db03-460f-930e-70f7d8982857") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997148    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:10:43.997401 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997164    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685d778d68-xht5f: secret "image-registry-tls" not found
Jul 24 17:10:43.998139 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997178    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert podName:3f934e78-0a38-43f9-9e4b-145cba4c780b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:44.997164256 +0000 UTC m=+37.625042086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqxkv" (UID: "3f934e78-0a38-43f9-9e4b-145cba4c780b") : secret "networking-console-plugin-cert" not found
Jul 24 17:10:43.998139 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997208    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls podName:6b164e94-9a0b-490a-b256-77a42b0dc2f8 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:44.99720004 +0000 UTC m=+37.625077897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls") pod "image-registry-685d778d68-xht5f" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8") : secret "image-registry-tls" not found
Jul 24 17:10:43.998139 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:43.997202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:43.998139 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997255    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:10:43.998139 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:43.997285    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls podName:c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d nodeName:}" failed. No retries permitted until 2026-07-24 17:10:44.997275002 +0000 UTC m=+37.625152864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls") pod "dns-default-j8hqc" (UID: "c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d") : secret "dns-default-metrics-tls" not found
Jul 24 17:10:44.930562 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:44.930528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:10:44.930743 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:44.930651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:10:44.930844 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:44.930661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:10:44.933643 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:44.933617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:10:44.933643 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:44.933636    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gkgpl\""
Jul 24 17:10:44.935077 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:44.935053    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:10:44.935281 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:44.935263    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-56frs\""
Jul 24 17:10:45.006203 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:45.006160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:45.006211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:45.006242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006333    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006386    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006407    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls podName:bd972454-db03-460f-930e-70f7d8982857 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:47.006382328 +0000 UTC m=+39.634260183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wjlkv" (UID: "bd972454-db03-460f-930e-70f7d8982857") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006429    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert podName:3f934e78-0a38-43f9-9e4b-145cba4c780b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:47.006417453 +0000 UTC m=+39.634295282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqxkv" (UID: "3f934e78-0a38-43f9-9e4b-145cba4c780b") : secret "networking-console-plugin-cert" not found
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006339    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006451    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls podName:c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d nodeName:}" failed. No retries permitted until 2026-07-24 17:10:47.006445645 +0000 UTC m=+39.634323476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls") pod "dns-default-j8hqc" (UID: "c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d") : secret "dns-default-metrics-tls" not found
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:45.006473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:45.006523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:45.006567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:45.006624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:45.006586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:45.007009 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006662    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:10:45.007009 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006673    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685d778d68-xht5f: secret "image-registry-tls" not found
Jul 24 17:10:45.007009 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006696    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls podName:6b164e94-9a0b-490a-b256-77a42b0dc2f8 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:47.006688614 +0000 UTC m=+39.634566444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls") pod "image-registry-685d778d68-xht5f" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8") : secret "image-registry-tls" not found
Jul 24 17:10:45.007009 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006729    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:10:45.007009 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006754    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:47.006746052 +0000 UTC m=+39.634623921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : configmap references non-existent config key: service-ca.crt
Jul 24 17:10:45.007009 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006766    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:47.006760664 +0000 UTC m=+39.634638493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : secret "router-metrics-certs-default" not found
Jul 24 17:10:45.007009 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006781    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:10:45.007009 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:45.006833    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls podName:3634ccae-7981-4cfb-9e57-0d3fb344fbbd nodeName:}" failed. No retries permitted until 2026-07-24 17:10:47.00682221 +0000 UTC m=+39.634700061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls") pod "cluster-samples-operator-6748489656-fzxpt" (UID: "3634ccae-7981-4cfb-9e57-0d3fb344fbbd") : secret "samples-operator-tls" not found
Jul 24 17:10:45.338735 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:45.338671    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f5e6cd_84b7_41e4_b0cc_502e64bf5bf5.slice/crio-22b694ab5210fc5d54a72ab38daf55eebbcea488f522c972742f9b2f0eb96592 WatchSource:0}: Error finding container 22b694ab5210fc5d54a72ab38daf55eebbcea488f522c972742f9b2f0eb96592: Status 404 returned error can't find the container with id 22b694ab5210fc5d54a72ab38daf55eebbcea488f522c972742f9b2f0eb96592
Jul 24 17:10:45.348921 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:45.348892    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a715da_e2ce_46ea_9b92_0a0b5290ea02.slice/crio-5ca92772f78180e8cd9c7c796af973935db018595bd67fa0d2a9184b73481d7c WatchSource:0}: Error finding container 5ca92772f78180e8cd9c7c796af973935db018595bd67fa0d2a9184b73481d7c: Status 404 returned error can't find the container with id 5ca92772f78180e8cd9c7c796af973935db018595bd67fa0d2a9184b73481d7c
Jul 24 17:10:45.349643 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:45.349621    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4117eff4_ef14_4caa_836b_1c377499a2c7.slice/crio-7fa42621876415f627b79aaebd564b408c161c5d479ce3e0738a64f00e30db48 WatchSource:0}: Error finding container 7fa42621876415f627b79aaebd564b408c161c5d479ce3e0738a64f00e30db48: Status 404 returned error can't find the container with id 7fa42621876415f627b79aaebd564b408c161c5d479ce3e0738a64f00e30db48
Jul 24 17:10:45.350351 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:45.350327    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7799dec_999d_473b_9520_596631542053.slice/crio-7474a60a47a21e23807cd761f162dfd4d9820a0cfb62490ad4934a51a489306d WatchSource:0}: Error finding container 7474a60a47a21e23807cd761f162dfd4d9820a0cfb62490ad4934a51a489306d: Status 404 returned error can't find the container with id 7474a60a47a21e23807cd761f162dfd4d9820a0cfb62490ad4934a51a489306d
Jul 24 17:10:45.351776 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:45.351745    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96201cf2_414e_4660_b819_d8598262234b.slice/crio-4c85fca221ab14beecf3576277bfd67753dd2dc9ba28e321b5da5da2db06bd78 WatchSource:0}: Error finding container 4c85fca221ab14beecf3576277bfd67753dd2dc9ba28e321b5da5da2db06bd78: Status 404 returned error can't find the container with id 4c85fca221ab14beecf3576277bfd67753dd2dc9ba28e321b5da5da2db06bd78
Jul 24 17:10:45.355404 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:45.353441    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaefcb407_941b_458d_a730_9dcd9cfa4546.slice/crio-30278da5b68a76c69a47a49cb65e26b5782c88c469efac5bb35097fd73391283 WatchSource:0}: Error finding container 30278da5b68a76c69a47a49cb65e26b5782c88c469efac5bb35097fd73391283: Status 404 returned error can't find the container with id 30278da5b68a76c69a47a49cb65e26b5782c88c469efac5bb35097fd73391283
Jul 24 17:10:45.471881 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:45.471853    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6grh"]
Jul 24 17:10:45.474930 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:10:45.474905    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04a360e_6ddc_4772_b74c_23b4e0e4f6ef.slice/crio-7524306eed693564081506f2e8710a7a166f2fd129c17f9a463909ef6be53b77 WatchSource:0}: Error finding container 7524306eed693564081506f2e8710a7a166f2fd129c17f9a463909ef6be53b77: Status 404 returned error can't find the container with id 7524306eed693564081506f2e8710a7a166f2fd129c17f9a463909ef6be53b77
Jul 24 17:10:46.215559 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:46.215230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6grh" event={"ID":"b04a360e-6ddc-4772-b74c-23b4e0e4f6ef","Type":"ContainerStarted","Data":"7524306eed693564081506f2e8710a7a166f2fd129c17f9a463909ef6be53b77"}
Jul 24 17:10:46.224757 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:46.224665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7" event={"ID":"46f5e6cd-84b7-41e4-b0cc-502e64bf5bf5","Type":"ContainerStarted","Data":"22b694ab5210fc5d54a72ab38daf55eebbcea488f522c972742f9b2f0eb96592"}
Jul 24 17:10:46.228901 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:46.228813    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h424t" event={"ID":"4117eff4-ef14-4caa-836b-1c377499a2c7","Type":"ContainerStarted","Data":"7fa42621876415f627b79aaebd564b408c161c5d479ce3e0738a64f00e30db48"}
Jul 24 17:10:46.234242 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:46.234178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84" event={"ID":"96201cf2-414e-4660-b819-d8598262234b","Type":"ContainerStarted","Data":"4c85fca221ab14beecf3576277bfd67753dd2dc9ba28e321b5da5da2db06bd78"}
Jul 24 17:10:46.238991 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:46.238965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m" event={"ID":"e7799dec-999d-473b-9520-596631542053","Type":"ContainerStarted","Data":"7474a60a47a21e23807cd761f162dfd4d9820a0cfb62490ad4934a51a489306d"}
Jul 24 17:10:46.245522 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:46.245462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" event={"ID":"aefcb407-941b-458d-a730-9dcd9cfa4546","Type":"ContainerStarted","Data":"30278da5b68a76c69a47a49cb65e26b5782c88c469efac5bb35097fd73391283"}
Jul 24 17:10:46.249293 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:46.249212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d" event={"ID":"91a715da-e2ce-46ea-9b92-0a0b5290ea02","Type":"ContainerStarted","Data":"5ca92772f78180e8cd9c7c796af973935db018595bd67fa0d2a9184b73481d7c"}
Jul 24 17:10:46.257471 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:46.256452    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b05cebf-84b5-4f82-b8a2-883175c86b8f" containerID="56e1a550555bc8d80a42358865d8a85c32ad835eef0ae3f2b69f40dd91fce565" exitCode=0
Jul 24 17:10:46.257471 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:46.256492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d4ts" event={"ID":"5b05cebf-84b5-4f82-b8a2-883175c86b8f","Type":"ContainerDied","Data":"56e1a550555bc8d80a42358865d8a85c32ad835eef0ae3f2b69f40dd91fce565"}
Jul 24 17:10:47.024868 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:47.024694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:47.024868 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:47.024778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:47.025641 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:47.025244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:47.025641 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:47.025282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:47.025641 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:47.025334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:47.025641 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:47.025365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:47.025641 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:47.025396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026126    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026197    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls podName:c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d nodeName:}" failed. No retries permitted until 2026-07-24 17:10:51.02617633 +0000 UTC m=+43.654054183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls") pod "dns-default-j8hqc" (UID: "c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d") : secret "dns-default-metrics-tls" not found
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026279    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026315    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:51.026303627 +0000 UTC m=+43.654181459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : secret "router-metrics-certs-default" not found
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:51.026374257 +0000 UTC m=+43.654252087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : configmap references non-existent config key: service-ca.crt
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026451    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026463    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685d778d68-xht5f: secret "image-registry-tls" not found
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026492    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls podName:6b164e94-9a0b-490a-b256-77a42b0dc2f8 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:51.026482291 +0000 UTC m=+43.654360134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls") pod "image-registry-685d778d68-xht5f" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8") : secret "image-registry-tls" not found
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026551    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026597    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls podName:bd972454-db03-460f-930e-70f7d8982857 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:51.026583735 +0000 UTC m=+43.654461569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wjlkv" (UID: "bd972454-db03-460f-930e-70f7d8982857") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:47.026636 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026612    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:10:47.027302 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026649    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert podName:3f934e78-0a38-43f9-9e4b-145cba4c780b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:51.026639282 +0000 UTC m=+43.654517127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqxkv" (UID: "3f934e78-0a38-43f9-9e4b-145cba4c780b") : secret "networking-console-plugin-cert" not found
Jul 24 17:10:47.027302 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.026994    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:10:47.027302 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:47.027049    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls podName:3634ccae-7981-4cfb-9e57-0d3fb344fbbd nodeName:}" failed. No retries permitted until 2026-07-24 17:10:51.027034294 +0000 UTC m=+43.654912138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls") pod "cluster-samples-operator-6748489656-fzxpt" (UID: "3634ccae-7981-4cfb-9e57-0d3fb344fbbd") : secret "samples-operator-tls" not found
Jul 24 17:10:47.270963 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:47.270174    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b05cebf-84b5-4f82-b8a2-883175c86b8f" containerID="174cb657e017d9fd4de0a1435318f7b076c8895dc245e571187d4deefdd87f44" exitCode=0
Jul 24 17:10:47.270963 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:47.270252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d4ts" event={"ID":"5b05cebf-84b5-4f82-b8a2-883175c86b8f","Type":"ContainerDied","Data":"174cb657e017d9fd4de0a1435318f7b076c8895dc245e571187d4deefdd87f44"}
Jul 24 17:10:48.277365 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:48.277270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d" event={"ID":"91a715da-e2ce-46ea-9b92-0a0b5290ea02","Type":"ContainerStarted","Data":"7fa04cd7f220163722821a3401ff342b1f4b10582720cf88ad86f5983382a595"}
Jul 24 17:10:48.282733 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:48.282706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d4ts" event={"ID":"5b05cebf-84b5-4f82-b8a2-883175c86b8f","Type":"ContainerStarted","Data":"4dee13ba9c298a61db3cb99ac4128a258e8da60bfae4cb9bbfb9e81ba1b0d635"}
Jul 24 17:10:48.294711 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:48.294628    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b9v5d" podStartSLOduration=27.539761058 podStartE2EDuration="29.294606311s" totalImagesPullingTime="1.754845253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:48.293772341 +0000 UTC m=+40.921650194" watchObservedRunningTime="2026-07-24 17:10:48.294606311 +0000 UTC m=+40.922484188"
Jul 24 17:10:48.316401 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:48.316348    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5d4ts" podStartSLOduration=8.12578098 podStartE2EDuration="40.316328034s" totalImagesPullingTime="32.190547054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:48.315219464 +0000 UTC m=+40.943097316" watchObservedRunningTime="2026-07-24 17:10:48.316328034 +0000 UTC m=+40.944205886"
Jul 24 17:10:51.066049 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:51.066006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:51.066090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:51.066118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:51.066164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066170    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:51.066196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:51.066227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066274    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:59.066256484 +0000 UTC m=+51.694134330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : secret "router-metrics-certs-default" not found
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:51.066314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066338    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066389    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls podName:c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d nodeName:}" failed. No retries permitted until 2026-07-24 17:10:59.066372585 +0000 UTC m=+51.694250432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls") pod "dns-default-j8hqc" (UID: "c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d") : secret "dns-default-metrics-tls" not found
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066408    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066443    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls podName:3634ccae-7981-4cfb-9e57-0d3fb344fbbd nodeName:}" failed. No retries permitted until 2026-07-24 17:10:59.066432547 +0000 UTC m=+51.694310377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls") pod "cluster-samples-operator-6748489656-fzxpt" (UID: "3634ccae-7981-4cfb-9e57-0d3fb344fbbd") : secret "samples-operator-tls" not found
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066458    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:59.066449937 +0000 UTC m=+51.694327766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : configmap references non-existent config key: service-ca.crt
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066498    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:10:51.066518 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066510    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685d778d68-xht5f: secret "image-registry-tls" not found
Jul 24 17:10:51.067214 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066544    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls podName:6b164e94-9a0b-490a-b256-77a42b0dc2f8 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:59.066533107 +0000 UTC m=+51.694410952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls") pod "image-registry-685d778d68-xht5f" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8") : secret "image-registry-tls" not found
Jul 24 17:10:51.067214 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066600    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:51.067214 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066631    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls podName:bd972454-db03-460f-930e-70f7d8982857 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:59.066620602 +0000 UTC m=+51.694498467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wjlkv" (UID: "bd972454-db03-460f-930e-70f7d8982857") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:51.067214 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066687    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:10:51.067214 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:51.066717    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert podName:3f934e78-0a38-43f9-9e4b-145cba4c780b nodeName:}" failed. No retries permitted until 2026-07-24 17:10:59.066707438 +0000 UTC m=+51.694585304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqxkv" (UID: "3f934e78-0a38-43f9-9e4b-145cba4c780b") : secret "networking-console-plugin-cert" not found
Jul 24 17:10:53.299178 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.299141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h424t" event={"ID":"4117eff4-ef14-4caa-836b-1c377499a2c7","Type":"ContainerStarted","Data":"070f6105219f262a261bd90463e44d5bd27c35bf114673cc935bdbc6b14cd5f2"}
Jul 24 17:10:53.300951 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.300888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84" event={"ID":"96201cf2-414e-4660-b819-d8598262234b","Type":"ContainerStarted","Data":"c4113bef6e0eebf9db8e57a32409ff4571b7e36f860b74905d073b1671b21ef7"}
Jul 24 17:10:53.303059 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.302847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m" event={"ID":"e7799dec-999d-473b-9520-596631542053","Type":"ContainerStarted","Data":"d7907e25cafc47c5e20ccc3a08b8c6736ca684898102dcb9a42457881cb25fa7"}
Jul 24 17:10:53.312329 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.307953    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/0.log"
Jul 24 17:10:53.312329 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.307992    2563 generic.go:356] "Generic (PLEG): container finished" podID="aefcb407-941b-458d-a730-9dcd9cfa4546" containerID="9921a833905ccdeaa0ab9fcf8df7412f13ee5f12541bbdb98f135e2cf54ac62e" exitCode=255
Jul 24 17:10:53.312329 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.308130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" event={"ID":"aefcb407-941b-458d-a730-9dcd9cfa4546","Type":"ContainerDied","Data":"9921a833905ccdeaa0ab9fcf8df7412f13ee5f12541bbdb98f135e2cf54ac62e"}
Jul 24 17:10:53.312329 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.308377    2563 scope.go:117] "RemoveContainer" containerID="9921a833905ccdeaa0ab9fcf8df7412f13ee5f12541bbdb98f135e2cf54ac62e"
Jul 24 17:10:53.314858 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.314316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6grh" event={"ID":"b04a360e-6ddc-4772-b74c-23b4e0e4f6ef","Type":"ContainerStarted","Data":"6e03bdfa9d76fe5539e3a92cc86e5a9e8776922ffa3b5a43a566cf00017cfa41"}
Jul 24 17:10:53.315827 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.315725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7" event={"ID":"46f5e6cd-84b7-41e4-b0cc-502e64bf5bf5","Type":"ContainerStarted","Data":"2d12904170c3defd6a2d001e02e818afa8581acbe8e7cbc2bcbd2c2c19ddf4b1"}
Jul 24 17:10:53.321683 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.321642    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-h424t" podStartSLOduration=25.692017982 podStartE2EDuration="33.321625976s" totalImagesPullingTime="7.629607994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:53.318823719 +0000 UTC m=+45.946701571" watchObservedRunningTime="2026-07-24 17:10:53.321625976 +0000 UTC m=+45.949503810"
Jul 24 17:10:53.335862 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.335817    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-75wz7" podStartSLOduration=26.684584777 podStartE2EDuration="34.335776625s" totalImagesPullingTime="7.651191848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:53.334384128 +0000 UTC m=+45.962261980" watchObservedRunningTime="2026-07-24 17:10:53.335776625 +0000 UTC m=+45.963654477"
Jul 24 17:10:53.350708 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.350565    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g6grh" podStartSLOduration=2.84508706 podStartE2EDuration="10.35055293s" totalImagesPullingTime="7.50546587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:53.350242142 +0000 UTC m=+45.978119995" watchObservedRunningTime="2026-07-24 17:10:53.35055293 +0000 UTC m=+45.978430782"
Jul 24 17:10:53.395614 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.394850    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84" podStartSLOduration=26.767281132 podStartE2EDuration="34.394830058s" totalImagesPullingTime="7.627548926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:53.36952019 +0000 UTC m=+45.997398045" watchObservedRunningTime="2026-07-24 17:10:53.394830058 +0000 UTC m=+46.022707909"
Jul 24 17:10:53.418990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.418939    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m" podStartSLOduration=26.789424405 podStartE2EDuration="34.418919408s" totalImagesPullingTime="7.629495003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:53.417432784 +0000 UTC m=+46.045310638" watchObservedRunningTime="2026-07-24 17:10:53.418919408 +0000 UTC m=+46.046797261"
Jul 24 17:10:53.558730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.558655    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:53.558730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:53.558721    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:10:54.166224 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.166189    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h45c9"]
Jul 24 17:10:54.198865 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.198830    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h45c9"]
Jul 24 17:10:54.199040 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.198949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.202143 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.202120    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 17:10:54.202288 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.202119    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 17:10:54.202504 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.202489    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bwrlh\""
Jul 24 17:10:54.296423 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.296344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.296423 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.296399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.296607 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.296479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2add8b07-4e2d-4187-9711-3a47099a6036-data-volume\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.296663 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.296644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr6vn\" (UniqueName: \"kubernetes.io/projected/2add8b07-4e2d-4187-9711-3a47099a6036-kube-api-access-tr6vn\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.296713 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.296695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2add8b07-4e2d-4187-9711-3a47099a6036-crio-socket\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.322102 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.322076    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/1.log"
Jul 24 17:10:54.322569 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.322553    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/0.log"
Jul 24 17:10:54.322673 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.322593    2563 generic.go:356] "Generic (PLEG): container finished" podID="aefcb407-941b-458d-a730-9dcd9cfa4546" containerID="0d5f147c5ec22e92bf944a3f7eb40bd4bad222b784748bba7808dbd646975152" exitCode=255
Jul 24 17:10:54.322729 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.322705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" event={"ID":"aefcb407-941b-458d-a730-9dcd9cfa4546","Type":"ContainerDied","Data":"0d5f147c5ec22e92bf944a3f7eb40bd4bad222b784748bba7808dbd646975152"}
Jul 24 17:10:54.322780 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.322768    2563 scope.go:117] "RemoveContainer" containerID="9921a833905ccdeaa0ab9fcf8df7412f13ee5f12541bbdb98f135e2cf54ac62e"
Jul 24 17:10:54.323113 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.323091    2563 scope.go:117] "RemoveContainer" containerID="0d5f147c5ec22e92bf944a3f7eb40bd4bad222b784748bba7808dbd646975152"
Jul 24 17:10:54.323303 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:54.323279    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-qz8rp_openshift-console-operator(aefcb407-941b-458d-a730-9dcd9cfa4546)\"" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" podUID="aefcb407-941b-458d-a730-9dcd9cfa4546"
Jul 24 17:10:54.397324 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.397288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2add8b07-4e2d-4187-9711-3a47099a6036-crio-socket\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.397537 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.397509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2add8b07-4e2d-4187-9711-3a47099a6036-crio-socket\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.397704 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.397683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.397782 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.397744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.397888 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.397816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2add8b07-4e2d-4187-9711-3a47099a6036-data-volume\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.397985 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:54.397966    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:10:54.398044 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:54.398031    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm podName:2add8b07-4e2d-4187-9711-3a47099a6036 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:54.898011971 +0000 UTC m=+47.525889816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h45c9" (UID: "2add8b07-4e2d-4187-9711-3a47099a6036") : configmap "kube-rbac-proxy" not found
Jul 24 17:10:54.398109 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.398094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr6vn\" (UniqueName: \"kubernetes.io/projected/2add8b07-4e2d-4187-9711-3a47099a6036-kube-api-access-tr6vn\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.398208 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:54.398194    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:10:54.398268 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:54.398243    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls podName:2add8b07-4e2d-4187-9711-3a47099a6036 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:54.898227994 +0000 UTC m=+47.526105831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h45c9" (UID: "2add8b07-4e2d-4187-9711-3a47099a6036") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:10:54.398646 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.398625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2add8b07-4e2d-4187-9711-3a47099a6036-data-volume\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.409408 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.409384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr6vn\" (UniqueName: \"kubernetes.io/projected/2add8b07-4e2d-4187-9711-3a47099a6036-kube-api-access-tr6vn\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.902206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.902168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.902206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:54.902212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:54.902477 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:54.902309    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:10:54.902477 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:54.902315    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:10:54.902477 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:54.902384    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm podName:2add8b07-4e2d-4187-9711-3a47099a6036 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:55.902363563 +0000 UTC m=+48.530241415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h45c9" (UID: "2add8b07-4e2d-4187-9711-3a47099a6036") : configmap "kube-rbac-proxy" not found
Jul 24 17:10:54.902477 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:54.902415    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls podName:2add8b07-4e2d-4187-9711-3a47099a6036 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:55.902397096 +0000 UTC m=+48.530274926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h45c9" (UID: "2add8b07-4e2d-4187-9711-3a47099a6036") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:10:55.330643 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:55.330606    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/1.log"
Jul 24 17:10:55.331135 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:55.331080    2563 scope.go:117] "RemoveContainer" containerID="0d5f147c5ec22e92bf944a3f7eb40bd4bad222b784748bba7808dbd646975152"
Jul 24 17:10:55.331259 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:55.331238    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-qz8rp_openshift-console-operator(aefcb407-941b-458d-a730-9dcd9cfa4546)\"" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" podUID="aefcb407-941b-458d-a730-9dcd9cfa4546"
Jul 24 17:10:55.911226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:55.911188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:55.911226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:55.911234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:55.911489 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:55.911331    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:10:55.911489 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:55.911337    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:10:55.911489 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:55.911405    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm podName:2add8b07-4e2d-4187-9711-3a47099a6036 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:57.911384776 +0000 UTC m=+50.539262635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h45c9" (UID: "2add8b07-4e2d-4187-9711-3a47099a6036") : configmap "kube-rbac-proxy" not found
Jul 24 17:10:55.911489 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:55.911452    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls podName:2add8b07-4e2d-4187-9711-3a47099a6036 nodeName:}" failed. No retries permitted until 2026-07-24 17:10:57.911442212 +0000 UTC m=+50.539320069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h45c9" (UID: "2add8b07-4e2d-4187-9711-3a47099a6036") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:10:55.957552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:55.957520    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-prz4f_a3a5d168-84a4-42e0-926f-939504b0eae7/dns-node-resolver/0.log"
Jul 24 17:10:56.958205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:56.958176    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vl76g_1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3/node-ca/0.log"
Jul 24 17:10:57.358219 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:57.358122    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g6grh_b04a360e-6ddc-4772-b74c-23b4e0e4f6ef/serve-healthcheck-canary/0.log"
Jul 24 17:10:57.928534 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:57.928492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:57.928534 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:57.928540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:10:57.928748 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:57.928618    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:10:57.928748 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:57.928694    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm podName:2add8b07-4e2d-4187-9711-3a47099a6036 nodeName:}" failed. No retries permitted until 2026-07-24 17:11:01.928678852 +0000 UTC m=+54.556556682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h45c9" (UID: "2add8b07-4e2d-4187-9711-3a47099a6036") : configmap "kube-rbac-proxy" not found
Jul 24 17:10:57.928748 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:57.928711    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:10:57.928876 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:57.928768    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls podName:2add8b07-4e2d-4187-9711-3a47099a6036 nodeName:}" failed. No retries permitted until 2026-07-24 17:11:01.928753242 +0000 UTC m=+54.556631090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h45c9" (UID: "2add8b07-4e2d-4187-9711-3a47099a6036") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:10:59.139758 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:59.139720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:59.139758 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:59.139766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:59.139826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:59.139855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:59.139883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.139911    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:11:15.139893071 +0000 UTC m=+67.767770905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : configmap references non-existent config key: service-ca.crt
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.139917    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.139940    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-685d778d68-xht5f: secret "image-registry-tls" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.139944    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.139913    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.139985    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls podName:c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d nodeName:}" failed. No retries permitted until 2026-07-24 17:11:15.13997124 +0000 UTC m=+67.767849089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls") pod "dns-default-j8hqc" (UID: "c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d") : secret "dns-default-metrics-tls" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.139989    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.140001    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls podName:6b164e94-9a0b-490a-b256-77a42b0dc2f8 nodeName:}" failed. No retries permitted until 2026-07-24 17:11:15.139994014 +0000 UTC m=+67.767871844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls") pod "image-registry-685d778d68-xht5f" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8") : secret "image-registry-tls" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:59.140016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.140023    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert podName:3f934e78-0a38-43f9-9e4b-145cba4c780b nodeName:}" failed. No retries permitted until 2026-07-24 17:11:15.140013911 +0000 UTC m=+67.767891741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqxkv" (UID: "3f934e78-0a38-43f9-9e4b-145cba4c780b") : secret "networking-console-plugin-cert" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.140039    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls podName:bd972454-db03-460f-930e-70f7d8982857 nodeName:}" failed. No retries permitted until 2026-07-24 17:11:15.140033179 +0000 UTC m=+67.767911008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wjlkv" (UID: "bd972454-db03-460f-930e-70f7d8982857") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.140110    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:10:59.140255 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.140145    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 17:10:59.140747 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.140151    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls podName:3634ccae-7981-4cfb-9e57-0d3fb344fbbd nodeName:}" failed. No retries permitted until 2026-07-24 17:11:15.140136908 +0000 UTC m=+67.768014738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls") pod "cluster-samples-operator-6748489656-fzxpt" (UID: "3634ccae-7981-4cfb-9e57-0d3fb344fbbd") : secret "samples-operator-tls" not found
Jul 24 17:10:59.140747 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:10:59.140109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:10:59.140747 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:10:59.140170    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs podName:9d06e44e-82c7-434e-b132-c55253507247 nodeName:}" failed. No retries permitted until 2026-07-24 17:11:15.140162889 +0000 UTC m=+67.768040718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs") pod "router-default-7fdb95cfb7-czwhl" (UID: "9d06e44e-82c7-434e-b132-c55253507247") : secret "router-metrics-certs-default" not found
Jul 24 17:11:01.965344 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:01.965310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:11:01.965828 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:01.965354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:11:01.965828 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:11:01.965466    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:11:01.965828 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:11:01.965523    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls podName:2add8b07-4e2d-4187-9711-3a47099a6036 nodeName:}" failed. No retries permitted until 2026-07-24 17:11:09.965505971 +0000 UTC m=+62.593383807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h45c9" (UID: "2add8b07-4e2d-4187-9711-3a47099a6036") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:11:01.965965 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:01.965929    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2add8b07-4e2d-4187-9711-3a47099a6036-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:11:03.557983 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:03.557934    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:11:03.557983 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:03.558000    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:11:03.558550 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:03.558437    2563 scope.go:117] "RemoveContainer" containerID="0d5f147c5ec22e92bf944a3f7eb40bd4bad222b784748bba7808dbd646975152"
Jul 24 17:11:04.359413 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:04.359379    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:11:04.359840 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:04.359826    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/1.log"
Jul 24 17:11:04.359904 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:04.359858    2563 generic.go:356] "Generic (PLEG): container finished" podID="aefcb407-941b-458d-a730-9dcd9cfa4546" containerID="8a47faecf9565db0b85234d59c047150c6670b092eb43733fce5691b0f7da03c" exitCode=255
Jul 24 17:11:04.359904 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:04.359899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" event={"ID":"aefcb407-941b-458d-a730-9dcd9cfa4546","Type":"ContainerDied","Data":"8a47faecf9565db0b85234d59c047150c6670b092eb43733fce5691b0f7da03c"}
Jul 24 17:11:04.359972 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:04.359944    2563 scope.go:117] "RemoveContainer" containerID="0d5f147c5ec22e92bf944a3f7eb40bd4bad222b784748bba7808dbd646975152"
Jul 24 17:11:04.360270 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:04.360247    2563 scope.go:117] "RemoveContainer" containerID="8a47faecf9565db0b85234d59c047150c6670b092eb43733fce5691b0f7da03c"
Jul 24 17:11:04.360443 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:11:04.360423    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-qz8rp_openshift-console-operator(aefcb407-941b-458d-a730-9dcd9cfa4546)\"" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" podUID="aefcb407-941b-458d-a730-9dcd9cfa4546"
Jul 24 17:11:05.366752 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:05.366726    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:11:08.203225 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:08.203199    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dx9mm"
Jul 24 17:11:10.033194 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:10.033157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:11:10.035509 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:10.035486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2add8b07-4e2d-4187-9711-3a47099a6036-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h45c9\" (UID: \"2add8b07-4e2d-4187-9711-3a47099a6036\") " pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:11:10.112586 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:10.112556    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bwrlh\""
Jul 24 17:11:10.120081 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:10.120062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h45c9"
Jul 24 17:11:10.243606 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:10.243458    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h45c9"]
Jul 24 17:11:10.246043 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:10.246010    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2add8b07_4e2d_4187_9711_3a47099a6036.slice/crio-71693b1bf35b14db028cae37c8ad3accad6601b4a11e3e46a23dceb8b77da168 WatchSource:0}: Error finding container 71693b1bf35b14db028cae37c8ad3accad6601b4a11e3e46a23dceb8b77da168: Status 404 returned error can't find the container with id 71693b1bf35b14db028cae37c8ad3accad6601b4a11e3e46a23dceb8b77da168
Jul 24 17:11:10.383601 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:10.383512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h45c9" event={"ID":"2add8b07-4e2d-4187-9711-3a47099a6036","Type":"ContainerStarted","Data":"71693b1bf35b14db028cae37c8ad3accad6601b4a11e3e46a23dceb8b77da168"}
Jul 24 17:11:13.558535 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.558493    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:11:13.559028 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.558587    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:11:13.559028 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.559020    2563 scope.go:117] "RemoveContainer" containerID="8a47faecf9565db0b85234d59c047150c6670b092eb43733fce5691b0f7da03c"
Jul 24 17:11:13.559246 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:11:13.559221    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-qz8rp_openshift-console-operator(aefcb407-941b-458d-a730-9dcd9cfa4546)\"" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" podUID="aefcb407-941b-458d-a730-9dcd9cfa4546"
Jul 24 17:11:13.670093 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.670046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:11:13.673135 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.673109    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:11:13.683726 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.683705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a539260-c108-464f-a64c-4d43ab4b71f6-original-pull-secret\") pod \"global-pull-secret-syncer-rcw58\" (UID: \"9a539260-c108-464f-a64c-4d43ab4b71f6\") " pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:11:13.744114 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.744073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rcw58"
Jul 24 17:11:13.770811 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.770760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:11:13.773993 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.773973    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:11:13.783788 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.783766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58ffc242-7629-4e3b-885d-fad30fe0923b-metrics-certs\") pod \"network-metrics-daemon-bwpql\" (UID: \"58ffc242-7629-4e3b-885d-fad30fe0923b\") " pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:11:13.872322 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.872230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:11:13.875232 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:13.875201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sfj6\" (UniqueName: \"kubernetes.io/projected/952af373-0793-4ff5-a4be-22907b42836a-kube-api-access-5sfj6\") pod \"network-check-target-pmglx\" (UID: \"952af373-0793-4ff5-a4be-22907b42836a\") " pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:11:14.053308 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:14.053276    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-56frs\""
Jul 24 17:11:14.059463 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:14.059436    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gkgpl\""
Jul 24 17:11:14.061501 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:14.061471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwpql"
Jul 24 17:11:14.067730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:14.067705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:11:15.184573 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.184543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:11:15.185118 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.184579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:11:15.185118 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.184621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:11:15.185118 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.184647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:11:15.185118 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.184917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:11:15.185118 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.184980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:11:15.185118 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.185043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:11:15.185421 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.185382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d06e44e-82c7-434e-b132-c55253507247-service-ca-bundle\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:11:15.188848 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.188012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d-metrics-tls\") pod \"dns-default-j8hqc\" (UID: \"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d\") " pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:11:15.188848 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.188046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d06e44e-82c7-434e-b132-c55253507247-metrics-certs\") pod \"router-default-7fdb95cfb7-czwhl\" (UID: \"9d06e44e-82c7-434e-b132-c55253507247\") " pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:11:15.188848 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.188069    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"image-registry-685d778d68-xht5f\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") " pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:11:15.188848 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.188238    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f934e78-0a38-43f9-9e4b-145cba4c780b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqxkv\" (UID: \"3f934e78-0a38-43f9-9e4b-145cba4c780b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:11:15.190724 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.190705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ccae-7981-4cfb-9e57-0d3fb344fbbd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fzxpt\" (UID: \"3634ccae-7981-4cfb-9e57-0d3fb344fbbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:11:15.191624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.191606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd972454-db03-460f-930e-70f7d8982857-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wjlkv\" (UID: \"bd972454-db03-460f-930e-70f7d8982857\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:11:15.216592 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.216560    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bwpql"]
Jul 24 17:11:15.219991 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:15.219960    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ffc242_7629_4e3b_885d_fad30fe0923b.slice/crio-f58670d99ef1d0a138e87a3739f657e09a1b2dc5c8103f9dcc50bd15ac0685f7 WatchSource:0}: Error finding container f58670d99ef1d0a138e87a3739f657e09a1b2dc5c8103f9dcc50bd15ac0685f7: Status 404 returned error can't find the container with id f58670d99ef1d0a138e87a3739f657e09a1b2dc5c8103f9dcc50bd15ac0685f7
Jul 24 17:11:15.271101 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.271071    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-685d778d68-xht5f"]
Jul 24 17:11:15.273969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.273950    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g65mg\""
Jul 24 17:11:15.282126 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.282093    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:11:15.317710 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.317623    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"]
Jul 24 17:11:15.348658 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.348616    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"]
Jul 24 17:11:15.348879 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.348718    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.366480 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.366285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-g6bkr\""
Jul 24 17:11:15.377207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.377166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"
Jul 24 17:11:15.404751 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.404718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bwpql" event={"ID":"58ffc242-7629-4e3b-885d-fad30fe0923b","Type":"ContainerStarted","Data":"f58670d99ef1d0a138e87a3739f657e09a1b2dc5c8103f9dcc50bd15ac0685f7"}
Jul 24 17:11:15.406250 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.406227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h45c9" event={"ID":"2add8b07-4e2d-4187-9711-3a47099a6036","Type":"ContainerStarted","Data":"5f309befbbd5a8f654682ef23addf6df33032ec37daa305f298ba1e744b581d0"}
Jul 24 17:11:15.411376 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.411356    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cjp5p\""
Jul 24 17:11:15.414697 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.414679    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rcw58"]
Jul 24 17:11:15.415917 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.415896    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jc776\""
Jul 24 17:11:15.417376 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.417344    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pmglx"]
Jul 24 17:11:15.417664 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:15.417645    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a539260_c108_464f_a64c_4d43ab4b71f6.slice/crio-a47daea47c569d3b92ed93e28b97967a1c6317cfe43fb46965e2bad21a2991cc WatchSource:0}: Error finding container a47daea47c569d3b92ed93e28b97967a1c6317cfe43fb46965e2bad21a2991cc: Status 404 returned error can't find the container with id a47daea47c569d3b92ed93e28b97967a1c6317cfe43fb46965e2bad21a2991cc
Jul 24 17:11:15.418638 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.418472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"
Jul 24 17:11:15.419434 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:15.419415    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952af373_0793_4ff5_a4be_22907b42836a.slice/crio-712f50227b999b73882cafac59c76b9e3581f6343241c08a855404cca7d7dfd8 WatchSource:0}: Error finding container 712f50227b999b73882cafac59c76b9e3581f6343241c08a855404cca7d7dfd8: Status 404 returned error can't find the container with id 712f50227b999b73882cafac59c76b9e3581f6343241c08a855404cca7d7dfd8
Jul 24 17:11:15.420933 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.420914    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-98l9k\""
Jul 24 17:11:15.424154 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.424135    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:11:15.428757 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.428737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"
Jul 24 17:11:15.435054 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.435035    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-685d778d68-xht5f"]
Jul 24 17:11:15.440063 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:15.440038    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b164e94_9a0b_490a_b256_77a42b0dc2f8.slice/crio-f4e03d7af982032339d0a9a38607a0a197a0fdfcca5a28e3798e6d46b8b0578f WatchSource:0}: Error finding container f4e03d7af982032339d0a9a38607a0a197a0fdfcca5a28e3798e6d46b8b0578f: Status 404 returned error can't find the container with id f4e03d7af982032339d0a9a38607a0a197a0fdfcca5a28e3798e6d46b8b0578f
Jul 24 17:11:15.447629 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.447610    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cpjrs\""
Jul 24 17:11:15.456179 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.456074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:11:15.487714 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.487221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51c72219-7a58-4b32-b3d1-53027ee5211d-installation-pull-secrets\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.487714 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.487273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smllx\" (UniqueName: \"kubernetes.io/projected/51c72219-7a58-4b32-b3d1-53027ee5211d-kube-api-access-smllx\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.487714 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.487304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51c72219-7a58-4b32-b3d1-53027ee5211d-registry-tls\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.487714 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.487358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51c72219-7a58-4b32-b3d1-53027ee5211d-trusted-ca\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.487714 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.487384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51c72219-7a58-4b32-b3d1-53027ee5211d-bound-sa-token\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.487714 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.487413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51c72219-7a58-4b32-b3d1-53027ee5211d-registry-certificates\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.487714 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.487440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51c72219-7a58-4b32-b3d1-53027ee5211d-ca-trust-extracted\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.487714 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.487483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51c72219-7a58-4b32-b3d1-53027ee5211d-image-registry-private-configuration\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.572099 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.571674    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt"]
Jul 24 17:11:15.588597 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.588567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51c72219-7a58-4b32-b3d1-53027ee5211d-installation-pull-secrets\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.588597 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.588600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smllx\" (UniqueName: \"kubernetes.io/projected/51c72219-7a58-4b32-b3d1-53027ee5211d-kube-api-access-smllx\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.588825 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.588621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51c72219-7a58-4b32-b3d1-53027ee5211d-registry-tls\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.588825 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.588653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51c72219-7a58-4b32-b3d1-53027ee5211d-trusted-ca\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.588825 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.588673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51c72219-7a58-4b32-b3d1-53027ee5211d-bound-sa-token\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.588825 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.588697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51c72219-7a58-4b32-b3d1-53027ee5211d-registry-certificates\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.588825 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.588723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51c72219-7a58-4b32-b3d1-53027ee5211d-ca-trust-extracted\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.588825 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.588759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51c72219-7a58-4b32-b3d1-53027ee5211d-image-registry-private-configuration\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.590467 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.590265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51c72219-7a58-4b32-b3d1-53027ee5211d-trusted-ca\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.590467 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.590304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51c72219-7a58-4b32-b3d1-53027ee5211d-registry-certificates\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.590663 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.590573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51c72219-7a58-4b32-b3d1-53027ee5211d-ca-trust-extracted\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.593880 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.593644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51c72219-7a58-4b32-b3d1-53027ee5211d-registry-tls\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.595095 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.595047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51c72219-7a58-4b32-b3d1-53027ee5211d-installation-pull-secrets\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.596560 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.596510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51c72219-7a58-4b32-b3d1-53027ee5211d-image-registry-private-configuration\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.612993 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.612937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51c72219-7a58-4b32-b3d1-53027ee5211d-bound-sa-token\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.615546 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.615523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smllx\" (UniqueName: \"kubernetes.io/projected/51c72219-7a58-4b32-b3d1-53027ee5211d-kube-api-access-smllx\") pod \"image-registry-66cd7ff8c9-hpmkh\" (UID: \"51c72219-7a58-4b32-b3d1-53027ee5211d\") " pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.648947 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:15.647037    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d06e44e_82c7_434e_b132_c55253507247.slice/crio-b9c5a2c17375b86c9c45527140dd19807e5aabb03fff9023bcb1c2b51ebdd206 WatchSource:0}: Error finding container b9c5a2c17375b86c9c45527140dd19807e5aabb03fff9023bcb1c2b51ebdd206: Status 404 returned error can't find the container with id b9c5a2c17375b86c9c45527140dd19807e5aabb03fff9023bcb1c2b51ebdd206
Jul 24 17:11:15.653132 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.652960    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fdb95cfb7-czwhl"]
Jul 24 17:11:15.663523 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.663494    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:15.677255 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.677230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv"]
Jul 24 17:11:15.681001 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:15.680972    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f934e78_0a38_43f9_9e4b_145cba4c780b.slice/crio-f690be8413015ab23e6530b56b89cf109264546fe6ebee5a6dcd4c1a251454f0 WatchSource:0}: Error finding container f690be8413015ab23e6530b56b89cf109264546fe6ebee5a6dcd4c1a251454f0: Status 404 returned error can't find the container with id f690be8413015ab23e6530b56b89cf109264546fe6ebee5a6dcd4c1a251454f0
Jul 24 17:11:15.705555 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.705526    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv"]
Jul 24 17:11:15.710033 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:15.710000    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd972454_db03_460f_930e_70f7d8982857.slice/crio-9be56ab7a75afbbb01f55c98431a10c92dd1d6d2c45ab4d26111ab4de9320168 WatchSource:0}: Error finding container 9be56ab7a75afbbb01f55c98431a10c92dd1d6d2c45ab4d26111ab4de9320168: Status 404 returned error can't find the container with id 9be56ab7a75afbbb01f55c98431a10c92dd1d6d2c45ab4d26111ab4de9320168
Jul 24 17:11:15.729710 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.729686    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8hqc"]
Jul 24 17:11:15.837966 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:15.837889    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"]
Jul 24 17:11:15.842309 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:15.842266    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c72219_7a58_4b32_b3d1_53027ee5211d.slice/crio-90ed7abac9baa9b95e6019138548f9b2e5099373bea6cda6e1abc5462a32ee5e WatchSource:0}: Error finding container 90ed7abac9baa9b95e6019138548f9b2e5099373bea6cda6e1abc5462a32ee5e: Status 404 returned error can't find the container with id 90ed7abac9baa9b95e6019138548f9b2e5099373bea6cda6e1abc5462a32ee5e
Jul 24 17:11:16.417102 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.417015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rcw58" event={"ID":"9a539260-c108-464f-a64c-4d43ab4b71f6","Type":"ContainerStarted","Data":"a47daea47c569d3b92ed93e28b97967a1c6317cfe43fb46965e2bad21a2991cc"}
Jul 24 17:11:16.423923 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.423452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh" event={"ID":"51c72219-7a58-4b32-b3d1-53027ee5211d","Type":"ContainerStarted","Data":"a8658366465465167e869efa5f59af6787a93256213fc8fb187d1aad0582e283"}
Jul 24 17:11:16.423923 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.423515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh" event={"ID":"51c72219-7a58-4b32-b3d1-53027ee5211d","Type":"ContainerStarted","Data":"90ed7abac9baa9b95e6019138548f9b2e5099373bea6cda6e1abc5462a32ee5e"}
Jul 24 17:11:16.423923 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.423860    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:16.430184 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.430098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8hqc" event={"ID":"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d","Type":"ContainerStarted","Data":"ff6238e2833845f91408e385973cb2605cd4e1f33fc1a9ed5aba823bbfa8f9f5"}
Jul 24 17:11:16.435262 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.435188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv" event={"ID":"3f934e78-0a38-43f9-9e4b-145cba4c780b","Type":"ContainerStarted","Data":"f690be8413015ab23e6530b56b89cf109264546fe6ebee5a6dcd4c1a251454f0"}
Jul 24 17:11:16.438815 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.438543    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pmglx" event={"ID":"952af373-0793-4ff5-a4be-22907b42836a","Type":"ContainerStarted","Data":"b70c90e9282dda7ba8869401987ae3de7e1e9157f6340feea36586c139b8d717"}
Jul 24 17:11:16.438815 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.438589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pmglx" event={"ID":"952af373-0793-4ff5-a4be-22907b42836a","Type":"ContainerStarted","Data":"712f50227b999b73882cafac59c76b9e3581f6343241c08a855404cca7d7dfd8"}
Jul 24 17:11:16.438815 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.438617    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:11:16.442079 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.442051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt" event={"ID":"3634ccae-7981-4cfb-9e57-0d3fb344fbbd","Type":"ContainerStarted","Data":"af24f984cbe5d2d1c12b059bc3926356042bc21361a15264c451fa9049156972"}
Jul 24 17:11:16.447736 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.445447    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh" podStartSLOduration=1.445431581 podStartE2EDuration="1.445431581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:16.444216898 +0000 UTC m=+69.072094753" watchObservedRunningTime="2026-07-24 17:11:16.445431581 +0000 UTC m=+69.073309433"
Jul 24 17:11:16.447736 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.447199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685d778d68-xht5f" event={"ID":"6b164e94-9a0b-490a-b256-77a42b0dc2f8","Type":"ContainerStarted","Data":"8dd7bdfad6d5709aad9a170d7f6f8d0d0a8f5e76edea07dd3e92ce0dcfabfc49"}
Jul 24 17:11:16.447736 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.447237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685d778d68-xht5f" event={"ID":"6b164e94-9a0b-490a-b256-77a42b0dc2f8","Type":"ContainerStarted","Data":"f4e03d7af982032339d0a9a38607a0a197a0fdfcca5a28e3798e6d46b8b0578f"}
Jul 24 17:11:16.447736 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.447517    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:11:16.456579 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.456557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv" event={"ID":"bd972454-db03-460f-930e-70f7d8982857","Type":"ContainerStarted","Data":"9be56ab7a75afbbb01f55c98431a10c92dd1d6d2c45ab4d26111ab4de9320168"}
Jul 24 17:11:16.465521 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.465464    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pmglx" podStartSLOduration=68.465446509 podStartE2EDuration="1m8.465446509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:16.463856451 +0000 UTC m=+69.091734304" watchObservedRunningTime="2026-07-24 17:11:16.465446509 +0000 UTC m=+69.093324363"
Jul 24 17:11:16.478080 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.477294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fdb95cfb7-czwhl" event={"ID":"9d06e44e-82c7-434e-b132-c55253507247","Type":"ContainerStarted","Data":"7a9ff02fb7f9095a48f0509ca01f626eb8f8ca75c770cbcfe28ef2cde548befd"}
Jul 24 17:11:16.478080 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.477348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fdb95cfb7-czwhl" event={"ID":"9d06e44e-82c7-434e-b132-c55253507247","Type":"ContainerStarted","Data":"b9c5a2c17375b86c9c45527140dd19807e5aabb03fff9023bcb1c2b51ebdd206"}
Jul 24 17:11:16.483300 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:16.482174    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-685d778d68-xht5f" podStartSLOduration=57.482157813 podStartE2EDuration="57.482157813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:16.481163036 +0000 UTC m=+69.109040925" watchObservedRunningTime="2026-07-24 17:11:16.482157813 +0000 UTC m=+69.110035645"
Jul 24 17:11:17.425449 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:17.425363    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:11:17.435280 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:17.435251    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:11:17.456860 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:17.455996    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7fdb95cfb7-czwhl" podStartSLOduration=58.45597535 podStartE2EDuration="58.45597535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:16.500741821 +0000 UTC m=+69.128619676" watchObservedRunningTime="2026-07-24 17:11:17.45597535 +0000 UTC m=+70.083853205"
Jul 24 17:11:17.484634 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:17.484473    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:11:17.485746 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:17.485548    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7fdb95cfb7-czwhl"
Jul 24 17:11:23.509929 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.509893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8hqc" event={"ID":"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d","Type":"ContainerStarted","Data":"43879c9b1c306d073016123ebd1d8b9943008b099279fa431c1673b14df9f4ad"}
Jul 24 17:11:23.510428 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.509982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8hqc" event={"ID":"c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d","Type":"ContainerStarted","Data":"82d8eabec35e764207a064a841777ddcd078dd7d0f9e67b1a2ab5e959f4aa5fe"}
Jul 24 17:11:23.510660 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.510640    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:11:23.512616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.512402    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv" event={"ID":"3f934e78-0a38-43f9-9e4b-145cba4c780b","Type":"ContainerStarted","Data":"1ac462657135da9010424f97241978ffa949eac944f89fbd5cce67f169757567"}
Jul 24 17:11:23.514526 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.514491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h45c9" event={"ID":"2add8b07-4e2d-4187-9711-3a47099a6036","Type":"ContainerStarted","Data":"ea6b146e68febf63b5e7b0750854dbed49db5afa619a481e9a83857df43ad3be"}
Jul 24 17:11:23.516670 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.516646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt" event={"ID":"3634ccae-7981-4cfb-9e57-0d3fb344fbbd","Type":"ContainerStarted","Data":"5d034f712d4805ccc9cc8070dc532c8f32ac17761371bdb620b6aefe914cce98"}
Jul 24 17:11:23.516823 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.516700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt" event={"ID":"3634ccae-7981-4cfb-9e57-0d3fb344fbbd","Type":"ContainerStarted","Data":"c1187372229e816ad06fbf5128bc5ab2311ac044759f77f192b3d2d43f052227"}
Jul 24 17:11:23.518965 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.518919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv" event={"ID":"bd972454-db03-460f-930e-70f7d8982857","Type":"ContainerStarted","Data":"a017f81416fc3c0d3ed254571f5060f0309f0d31bc483a74ca4fbf2969c894c4"}
Jul 24 17:11:23.520992 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.520967    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bwpql" event={"ID":"58ffc242-7629-4e3b-885d-fad30fe0923b","Type":"ContainerStarted","Data":"44ff68cb943947d25523f22a9c1649dabf74204daff4df2a89880a49dd2e5ef6"}
Jul 24 17:11:23.521090 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.521014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bwpql" event={"ID":"58ffc242-7629-4e3b-885d-fad30fe0923b","Type":"ContainerStarted","Data":"eae7281983436e1e32297a51ec8c6e913493f85cba5c69f326d2d8e4d6f375a6"}
Jul 24 17:11:23.522714 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.522682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rcw58" event={"ID":"9a539260-c108-464f-a64c-4d43ab4b71f6","Type":"ContainerStarted","Data":"11e79679c2b13a8754a8b21af73721ab686425c354467503f8f417f95d9f9d32"}
Jul 24 17:11:23.532484 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.532442    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j8hqc" podStartSLOduration=33.445323199 podStartE2EDuration="40.532429697s" totalImagesPullingTime="7.087106498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:23.531102867 +0000 UTC m=+76.158980720" watchObservedRunningTime="2026-07-24 17:11:23.532429697 +0000 UTC m=+76.160307548"
Jul 24 17:11:23.546786 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.546745    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqxkv" podStartSLOduration=56.490770592 podStartE2EDuration="1m3.546735342s" totalImagesPullingTime="7.05596475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:23.545662754 +0000 UTC m=+76.173540603" watchObservedRunningTime="2026-07-24 17:11:23.546735342 +0000 UTC m=+76.174613196"
Jul 24 17:11:23.562619 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.561490    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rcw58" podStartSLOduration=68.156060931 podStartE2EDuration="1m15.561475992s" totalImagesPullingTime="7.405415061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:23.561141958 +0000 UTC m=+76.189019826" watchObservedRunningTime="2026-07-24 17:11:23.561475992 +0000 UTC m=+76.189353846"
Jul 24 17:11:23.578599 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.578563    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bwpql" podStartSLOduration=68.698041617 podStartE2EDuration="1m15.578550732s" totalImagesPullingTime="6.880509115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:23.577592084 +0000 UTC m=+76.205469938" watchObservedRunningTime="2026-07-24 17:11:23.578550732 +0000 UTC m=+76.206428583"
Jul 24 17:11:23.595307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.594053    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fzxpt" podStartSLOduration=56.509423956 podStartE2EDuration="1m3.594038484s" totalImagesPullingTime="7.084614528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:23.593937143 +0000 UTC m=+76.221814996" watchObservedRunningTime="2026-07-24 17:11:23.594038484 +0000 UTC m=+76.221916336"
Jul 24 17:11:23.614287 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:23.614241    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wjlkv" podStartSLOduration=57.586073071 podStartE2EDuration="1m4.614228067s" totalImagesPullingTime="7.028154996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:23.61265138 +0000 UTC m=+76.240529245" watchObservedRunningTime="2026-07-24 17:11:23.614228067 +0000 UTC m=+76.242105923"
Jul 24 17:11:27.541527 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:27.541495    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h45c9" event={"ID":"2add8b07-4e2d-4187-9711-3a47099a6036","Type":"ContainerStarted","Data":"2b9c5b91c75f63460d6592b07c25f5142c1151699c6b29f3921968bad2eb68ab"}
Jul 24 17:11:27.560160 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:27.560112    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h45c9" podStartSLOduration=17.063849331 podStartE2EDuration="33.560091579s" totalImagesPullingTime="16.496242248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:10:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:27.559197604 +0000 UTC m=+80.187075458" watchObservedRunningTime="2026-07-24 17:11:27.560091579 +0000 UTC m=+80.187969432"
Jul 24 17:11:27.932304 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:27.932282    2563 scope.go:117] "RemoveContainer" containerID="8a47faecf9565db0b85234d59c047150c6670b092eb43733fce5691b0f7da03c"
Jul 24 17:11:28.547726 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:28.547696    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:11:28.548162 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:28.547839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" event={"ID":"aefcb407-941b-458d-a730-9dcd9cfa4546","Type":"ContainerStarted","Data":"051ab0a65ff860f764c99e976e75ab8bb9c36a6ab11fd887861499f2413cab04"}
Jul 24 17:11:28.568426 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:28.568379    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp" podStartSLOduration=61.940868783 podStartE2EDuration="1m9.568362882s" totalImagesPullingTime="7.627494099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:28.568191202 +0000 UTC m=+81.196069056" watchObservedRunningTime="2026-07-24 17:11:28.568362882 +0000 UTC m=+81.196240765"
Jul 24 17:11:34.536444 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:34.536414    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j8hqc"
Jul 24 17:11:35.668027 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:35.667983    2563 patch_prober.go:28] interesting pod/image-registry-66cd7ff8c9-hpmkh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 17:11:35.668364 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:35.668038    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh" podUID="51c72219-7a58-4b32-b3d1-53027ee5211d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:11:36.452874 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:36.452841    2563 patch_prober.go:28] interesting pod/image-registry-685d778d68-xht5f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 17:11:36.453036 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:36.452889    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-685d778d68-xht5f" podUID="6b164e94-9a0b-490a-b256-77a42b0dc2f8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:11:37.488785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:37.488755    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66cd7ff8c9-hpmkh"
Jul 24 17:11:38.549150 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.549116    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:11:38.552870 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.552851    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-qz8rp"
Jul 24 17:11:38.788243 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.788215    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-grqvf"]
Jul 24 17:11:38.791590 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.791570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:38.794380 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.794351    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 17:11:38.794491 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.794382    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 17:11:38.794719 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.794676    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kgtc8\""
Jul 24 17:11:38.794904 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.794889    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 17:11:38.796058 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.796042    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 17:11:38.981776 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.981723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/160d5532-f69e-46c9-a4d7-42fc10ac5709-metrics-client-ca\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:38.981955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.981785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-accelerators-collector-config\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:38.981955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.981820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7fhw\" (UniqueName: \"kubernetes.io/projected/160d5532-f69e-46c9-a4d7-42fc10ac5709-kube-api-access-z7fhw\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:38.981955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.981846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-wtmp\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:38.981955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.981864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/160d5532-f69e-46c9-a4d7-42fc10ac5709-sys\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:38.981955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.981878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/160d5532-f69e-46c9-a4d7-42fc10ac5709-root\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:38.981955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.981895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-textfile\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:38.981955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.981930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-tls\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:38.981955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:38.981957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083204 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/160d5532-f69e-46c9-a4d7-42fc10ac5709-metrics-client-ca\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083354 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-accelerators-collector-config\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083354 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7fhw\" (UniqueName: \"kubernetes.io/projected/160d5532-f69e-46c9-a4d7-42fc10ac5709-kube-api-access-z7fhw\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083354 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-wtmp\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083354 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/160d5532-f69e-46c9-a4d7-42fc10ac5709-sys\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083354 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/160d5532-f69e-46c9-a4d7-42fc10ac5709-sys\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/160d5532-f69e-46c9-a4d7-42fc10ac5709-root\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-textfile\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/160d5532-f69e-46c9-a4d7-42fc10ac5709-root\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-tls\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-wtmp\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083953 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-textfile\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083953 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/160d5532-f69e-46c9-a4d7-42fc10ac5709-metrics-client-ca\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.083953 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.083839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-accelerators-collector-config\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.085993 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.085974    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-tls\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.086106 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.086085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/160d5532-f69e-46c9-a4d7-42fc10ac5709-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.091894 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.091872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7fhw\" (UniqueName: \"kubernetes.io/projected/160d5532-f69e-46c9-a4d7-42fc10ac5709-kube-api-access-z7fhw\") pod \"node-exporter-grqvf\" (UID: \"160d5532-f69e-46c9-a4d7-42fc10ac5709\") " pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.101698 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.101681    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-grqvf"
Jul 24 17:11:39.111717 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:39.111694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160d5532_f69e_46c9_a4d7_42fc10ac5709.slice/crio-c8a9fe47ca77166cdadef7e16321cb924c1f3870699340d0bf8c074565aeb979 WatchSource:0}: Error finding container c8a9fe47ca77166cdadef7e16321cb924c1f3870699340d0bf8c074565aeb979: Status 404 returned error can't find the container with id c8a9fe47ca77166cdadef7e16321cb924c1f3870699340d0bf8c074565aeb979
Jul 24 17:11:39.590045 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:39.590014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grqvf" event={"ID":"160d5532-f69e-46c9-a4d7-42fc10ac5709","Type":"ContainerStarted","Data":"c8a9fe47ca77166cdadef7e16321cb924c1f3870699340d0bf8c074565aeb979"}
Jul 24 17:11:40.595699 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:40.595615    2563 generic.go:356] "Generic (PLEG): container finished" podID="160d5532-f69e-46c9-a4d7-42fc10ac5709" containerID="73ccbd838e005cd67b91006182c7340083be23887345b30d869cdfcc6863c676" exitCode=0
Jul 24 17:11:40.595699 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:40.595662    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grqvf" event={"ID":"160d5532-f69e-46c9-a4d7-42fc10ac5709","Type":"ContainerDied","Data":"73ccbd838e005cd67b91006182c7340083be23887345b30d869cdfcc6863c676"}
Jul 24 17:11:41.479544 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.479481    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-685d778d68-xht5f" podUID="6b164e94-9a0b-490a-b256-77a42b0dc2f8" containerName="registry" containerID="cri-o://8dd7bdfad6d5709aad9a170d7f6f8d0d0a8f5e76edea07dd3e92ce0dcfabfc49" gracePeriod=30
Jul 24 17:11:41.601879 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.601845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grqvf" event={"ID":"160d5532-f69e-46c9-a4d7-42fc10ac5709","Type":"ContainerStarted","Data":"7d59269e1b4d5b9da1f27ddf3e305809d8b4ccaa0ecd9e9a0d361ee05da3a714"}
Jul 24 17:11:41.602268 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.601940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-grqvf" event={"ID":"160d5532-f69e-46c9-a4d7-42fc10ac5709","Type":"ContainerStarted","Data":"a9794a5c67e87ed8003571d64b642243959a0574d7e457ddc7dc25a4cf515f81"}
Jul 24 17:11:41.603441 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.603401    2563 generic.go:356] "Generic (PLEG): container finished" podID="6b164e94-9a0b-490a-b256-77a42b0dc2f8" containerID="8dd7bdfad6d5709aad9a170d7f6f8d0d0a8f5e76edea07dd3e92ce0dcfabfc49" exitCode=0
Jul 24 17:11:41.603555 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.603465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685d778d68-xht5f" event={"ID":"6b164e94-9a0b-490a-b256-77a42b0dc2f8","Type":"ContainerDied","Data":"8dd7bdfad6d5709aad9a170d7f6f8d0d0a8f5e76edea07dd3e92ce0dcfabfc49"}
Jul 24 17:11:41.621650 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.621399    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-grqvf" podStartSLOduration=2.388973482 podStartE2EDuration="3.621385517s" totalImagesPullingTime="1.159463317s" totalInitContainerRuntime="72.948718ms" isStatefulPod=true podCreationTimestamp="2026-07-24 17:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:41.621251525 +0000 UTC m=+94.249129412" watchObservedRunningTime="2026-07-24 17:11:41.621385517 +0000 UTC m=+94.249263368"
Jul 24 17:11:41.730633 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.730580    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:11:41.802187 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.802158    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-bound-sa-token\") pod \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") "
Jul 24 17:11:41.802364 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.802197    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") pod \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") "
Jul 24 17:11:41.802364 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.802215    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxtzh\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-kube-api-access-kxtzh\") pod \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") "
Jul 24 17:11:41.802364 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.802344    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-installation-pull-secrets\") pod \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") "
Jul 24 17:11:41.802543 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.802381    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b164e94-9a0b-490a-b256-77a42b0dc2f8-ca-trust-extracted\") pod \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") "
Jul 24 17:11:41.802543 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.802422    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-certificates\") pod \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") "
Jul 24 17:11:41.802543 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.802446    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-trusted-ca\") pod \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") "
Jul 24 17:11:41.802543 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.802473    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-image-registry-private-configuration\") pod \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\" (UID: \"6b164e94-9a0b-490a-b256-77a42b0dc2f8\") "
Jul 24 17:11:41.802864 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.802831    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6b164e94-9a0b-490a-b256-77a42b0dc2f8" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:11:41.803224 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.803169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6b164e94-9a0b-490a-b256-77a42b0dc2f8" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:11:41.804959 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.804931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6b164e94-9a0b-490a-b256-77a42b0dc2f8" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:11:41.805264 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.805237    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6b164e94-9a0b-490a-b256-77a42b0dc2f8" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:11:41.805394 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.805376    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6b164e94-9a0b-490a-b256-77a42b0dc2f8" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:11:41.805480 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.805460    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6b164e94-9a0b-490a-b256-77a42b0dc2f8" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:11:41.805520 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.805492    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-kube-api-access-kxtzh" (OuterVolumeSpecName: "kube-api-access-kxtzh") pod "6b164e94-9a0b-490a-b256-77a42b0dc2f8" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8"). InnerVolumeSpecName "kube-api-access-kxtzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:11:41.811292 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.811270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b164e94-9a0b-490a-b256-77a42b0dc2f8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6b164e94-9a0b-490a-b256-77a42b0dc2f8" (UID: "6b164e94-9a0b-490a-b256-77a42b0dc2f8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:11:41.902976 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.902945    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-bound-sa-token\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:11:41.902976 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.902970    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-tls\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:11:41.902976 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.902978    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxtzh\" (UniqueName: \"kubernetes.io/projected/6b164e94-9a0b-490a-b256-77a42b0dc2f8-kube-api-access-kxtzh\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:11:41.903161 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.902990    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-installation-pull-secrets\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:11:41.903161 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.902998    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b164e94-9a0b-490a-b256-77a42b0dc2f8-ca-trust-extracted\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:11:41.903161 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.903006    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-registry-certificates\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:11:41.903161 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.903014    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b164e94-9a0b-490a-b256-77a42b0dc2f8-trusted-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:11:41.903161 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:41.903024    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b164e94-9a0b-490a-b256-77a42b0dc2f8-image-registry-private-configuration\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:11:42.608424 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:42.608398    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685d778d68-xht5f"
Jul 24 17:11:42.608860 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:42.608441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685d778d68-xht5f" event={"ID":"6b164e94-9a0b-490a-b256-77a42b0dc2f8","Type":"ContainerDied","Data":"f4e03d7af982032339d0a9a38607a0a197a0fdfcca5a28e3798e6d46b8b0578f"}
Jul 24 17:11:42.608860 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:42.608498    2563 scope.go:117] "RemoveContainer" containerID="8dd7bdfad6d5709aad9a170d7f6f8d0d0a8f5e76edea07dd3e92ce0dcfabfc49"
Jul 24 17:11:42.626237 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:42.626217    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-685d778d68-xht5f"]
Jul 24 17:11:42.631586 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:42.631567    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-685d778d68-xht5f"]
Jul 24 17:11:43.935269 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:43.935239    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b164e94-9a0b-490a-b256-77a42b0dc2f8" path="/var/lib/kubelet/pods/6b164e94-9a0b-490a-b256-77a42b0dc2f8/volumes"
Jul 24 17:11:47.486724 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:47.486696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pmglx"
Jul 24 17:11:48.845089 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.845054    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-859996ff9c-5hmps"]
Jul 24 17:11:48.845462 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.845319    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b164e94-9a0b-490a-b256-77a42b0dc2f8" containerName="registry"
Jul 24 17:11:48.845462 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.845330    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b164e94-9a0b-490a-b256-77a42b0dc2f8" containerName="registry"
Jul 24 17:11:48.845462 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.845381    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b164e94-9a0b-490a-b256-77a42b0dc2f8" containerName="registry"
Jul 24 17:11:48.863212 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.863178    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859996ff9c-5hmps"]
Jul 24 17:11:48.863362 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.863277    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:48.866464 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.866442    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 17:11:48.866464 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.866456    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 17:11:48.866634 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.866507    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 17:11:48.867764 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.867741    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 17:11:48.867764 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.867757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j5hxv\""
Jul 24 17:11:48.867962 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.867757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 17:11:48.867962 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.867746    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 17:11:48.868158 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.868141    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 17:11:48.872373 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.872356    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 17:11:48.951973 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.951940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-trusted-ca-bundle\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:48.951973 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.951978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-serving-cert\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:48.952163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.951997    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-oauth-serving-cert\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:48.952163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.952077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwlms\" (UniqueName: \"kubernetes.io/projected/adabf7b9-22ed-48a1-83b7-d313598161f7-kube-api-access-zwlms\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:48.952163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.952134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-service-ca\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:48.952163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.952161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-console-config\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:48.952288 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:48.952181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-oauth-config\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.053393 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.053353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-trusted-ca-bundle\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.053393 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.053393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-serving-cert\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.053612 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.053414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-oauth-serving-cert\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.053612 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.053459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlms\" (UniqueName: \"kubernetes.io/projected/adabf7b9-22ed-48a1-83b7-d313598161f7-kube-api-access-zwlms\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.053612 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.053484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-service-ca\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.053612 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.053512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-console-config\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.053612 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.053537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-oauth-config\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.054282 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.054257    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-console-config\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.054414 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.054389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-oauth-serving-cert\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.054458 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.054389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-service-ca\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.054753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.054726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-trusted-ca-bundle\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.056022 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.056000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-oauth-config\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.056170 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.056152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-serving-cert\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.062850 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.062825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwlms\" (UniqueName: \"kubernetes.io/projected/adabf7b9-22ed-48a1-83b7-d313598161f7-kube-api-access-zwlms\") pod \"console-859996ff9c-5hmps\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") " pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.173551 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.173520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:49.330763 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.330728    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859996ff9c-5hmps"]
Jul 24 17:11:49.334622 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:11:49.334600    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadabf7b9_22ed_48a1_83b7_d313598161f7.slice/crio-8d5a38a698a72b3fc903a416464bb99059166a018ed60c9863d5601d34b83ced WatchSource:0}: Error finding container 8d5a38a698a72b3fc903a416464bb99059166a018ed60c9863d5601d34b83ced: Status 404 returned error can't find the container with id 8d5a38a698a72b3fc903a416464bb99059166a018ed60c9863d5601d34b83ced
Jul 24 17:11:49.636004 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:49.635921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859996ff9c-5hmps" event={"ID":"adabf7b9-22ed-48a1-83b7-d313598161f7","Type":"ContainerStarted","Data":"8d5a38a698a72b3fc903a416464bb99059166a018ed60c9863d5601d34b83ced"}
Jul 24 17:11:52.651139 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:52.651103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859996ff9c-5hmps" event={"ID":"adabf7b9-22ed-48a1-83b7-d313598161f7","Type":"ContainerStarted","Data":"3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a"}
Jul 24 17:11:52.670856 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:52.670809    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-859996ff9c-5hmps" podStartSLOduration=1.869453283 podStartE2EDuration="4.670777496s" totalImagesPullingTime="2.801324213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:52.668604452 +0000 UTC m=+105.296482341" watchObservedRunningTime="2026-07-24 17:11:52.670777496 +0000 UTC m=+105.298655348"
Jul 24 17:11:59.174396 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:59.174357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:59.174836 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:59.174453    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:59.179103 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:59.179080    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:11:59.681308 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:11:59.681285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:12:04.697003 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:04.696962    2563 generic.go:356] "Generic (PLEG): container finished" podID="96201cf2-414e-4660-b819-d8598262234b" containerID="c4113bef6e0eebf9db8e57a32409ff4571b7e36f860b74905d073b1671b21ef7" exitCode=0
Jul 24 17:12:04.697472 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:04.697035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84" event={"ID":"96201cf2-414e-4660-b819-d8598262234b","Type":"ContainerDied","Data":"c4113bef6e0eebf9db8e57a32409ff4571b7e36f860b74905d073b1671b21ef7"}
Jul 24 17:12:04.697472 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:04.697426    2563 scope.go:117] "RemoveContainer" containerID="c4113bef6e0eebf9db8e57a32409ff4571b7e36f860b74905d073b1671b21ef7"
Jul 24 17:12:04.698595 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:04.698575    2563 generic.go:356] "Generic (PLEG): container finished" podID="e7799dec-999d-473b-9520-596631542053" containerID="d7907e25cafc47c5e20ccc3a08b8c6736ca684898102dcb9a42457881cb25fa7" exitCode=0
Jul 24 17:12:04.698688 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:04.698604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m" event={"ID":"e7799dec-999d-473b-9520-596631542053","Type":"ContainerDied","Data":"d7907e25cafc47c5e20ccc3a08b8c6736ca684898102dcb9a42457881cb25fa7"}
Jul 24 17:12:04.698902 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:04.698890    2563 scope.go:117] "RemoveContainer" containerID="d7907e25cafc47c5e20ccc3a08b8c6736ca684898102dcb9a42457881cb25fa7"
Jul 24 17:12:05.704360 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:05.704322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zct84" event={"ID":"96201cf2-414e-4660-b819-d8598262234b","Type":"ContainerStarted","Data":"0d902585eeac2667ca99888e1cd55523a370f700e7303fde36f115308826eb99"}
Jul 24 17:12:05.705983 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:05.705953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gw86m" event={"ID":"e7799dec-999d-473b-9520-596631542053","Type":"ContainerStarted","Data":"540bcc8f985f7521a9fe797a62a60724978d3a2843fb06d86e6e8bd2a73b5bf5"}
Jul 24 17:12:13.736445 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:13.736416    2563 generic.go:356] "Generic (PLEG): container finished" podID="4117eff4-ef14-4caa-836b-1c377499a2c7" containerID="070f6105219f262a261bd90463e44d5bd27c35bf114673cc935bdbc6b14cd5f2" exitCode=0
Jul 24 17:12:13.736771 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:13.736490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h424t" event={"ID":"4117eff4-ef14-4caa-836b-1c377499a2c7","Type":"ContainerDied","Data":"070f6105219f262a261bd90463e44d5bd27c35bf114673cc935bdbc6b14cd5f2"}
Jul 24 17:12:13.736855 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:13.736835    2563 scope.go:117] "RemoveContainer" containerID="070f6105219f262a261bd90463e44d5bd27c35bf114673cc935bdbc6b14cd5f2"
Jul 24 17:12:14.746447 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:14.746410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h424t" event={"ID":"4117eff4-ef14-4caa-836b-1c377499a2c7","Type":"ContainerStarted","Data":"a423cd4fcb2cc17d3be2cec504ba3af46a773195e81ed32e3cee8bc731efa651"}
Jul 24 17:12:17.216521 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:17.216491    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859996ff9c-5hmps"]
Jul 24 17:12:42.237019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.236951    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-859996ff9c-5hmps" podUID="adabf7b9-22ed-48a1-83b7-d313598161f7" containerName="console" containerID="cri-o://3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a" gracePeriod=15
Jul 24 17:12:42.479866 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.479840    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:12:42.582894 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.582819    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-serving-cert\") pod \"adabf7b9-22ed-48a1-83b7-d313598161f7\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") "
Jul 24 17:12:42.582894 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.582873    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-service-ca\") pod \"adabf7b9-22ed-48a1-83b7-d313598161f7\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") "
Jul 24 17:12:42.582894 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.582895    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-oauth-config\") pod \"adabf7b9-22ed-48a1-83b7-d313598161f7\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") "
Jul 24 17:12:42.583158 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.582924    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-console-config\") pod \"adabf7b9-22ed-48a1-83b7-d313598161f7\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") "
Jul 24 17:12:42.583158 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.582949    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwlms\" (UniqueName: \"kubernetes.io/projected/adabf7b9-22ed-48a1-83b7-d313598161f7-kube-api-access-zwlms\") pod \"adabf7b9-22ed-48a1-83b7-d313598161f7\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") "
Jul 24 17:12:42.583158 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.582968    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-oauth-serving-cert\") pod \"adabf7b9-22ed-48a1-83b7-d313598161f7\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") "
Jul 24 17:12:42.583158 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.583059    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-trusted-ca-bundle\") pod \"adabf7b9-22ed-48a1-83b7-d313598161f7\" (UID: \"adabf7b9-22ed-48a1-83b7-d313598161f7\") "
Jul 24 17:12:42.583410 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.583384    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-service-ca" (OuterVolumeSpecName: "service-ca") pod "adabf7b9-22ed-48a1-83b7-d313598161f7" (UID: "adabf7b9-22ed-48a1-83b7-d313598161f7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:12:42.583410 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.583395    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-console-config" (OuterVolumeSpecName: "console-config") pod "adabf7b9-22ed-48a1-83b7-d313598161f7" (UID: "adabf7b9-22ed-48a1-83b7-d313598161f7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:12:42.583520 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.583487    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "adabf7b9-22ed-48a1-83b7-d313598161f7" (UID: "adabf7b9-22ed-48a1-83b7-d313598161f7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:12:42.583586 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.583568    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "adabf7b9-22ed-48a1-83b7-d313598161f7" (UID: "adabf7b9-22ed-48a1-83b7-d313598161f7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:12:42.585430 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.585408    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "adabf7b9-22ed-48a1-83b7-d313598161f7" (UID: "adabf7b9-22ed-48a1-83b7-d313598161f7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:12:42.585542 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.585461    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adabf7b9-22ed-48a1-83b7-d313598161f7-kube-api-access-zwlms" (OuterVolumeSpecName: "kube-api-access-zwlms") pod "adabf7b9-22ed-48a1-83b7-d313598161f7" (UID: "adabf7b9-22ed-48a1-83b7-d313598161f7"). InnerVolumeSpecName "kube-api-access-zwlms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:12:42.585542 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.585520    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "adabf7b9-22ed-48a1-83b7-d313598161f7" (UID: "adabf7b9-22ed-48a1-83b7-d313598161f7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:12:42.684430 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.684400    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-trusted-ca-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:12:42.684430 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.684423    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-serving-cert\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:12:42.684430 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.684433    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:12:42.684627 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.684441    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adabf7b9-22ed-48a1-83b7-d313598161f7-console-oauth-config\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:12:42.684627 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.684449    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-console-config\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:12:42.684627 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.684458    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwlms\" (UniqueName: \"kubernetes.io/projected/adabf7b9-22ed-48a1-83b7-d313598161f7-kube-api-access-zwlms\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:12:42.684627 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.684467    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adabf7b9-22ed-48a1-83b7-d313598161f7-oauth-serving-cert\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:12:42.854293 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.854208    2563 generic.go:356] "Generic (PLEG): container finished" podID="adabf7b9-22ed-48a1-83b7-d313598161f7" containerID="3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a" exitCode=0
Jul 24 17:12:42.854293 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.854257    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859996ff9c-5hmps"
Jul 24 17:12:42.854465 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.854298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859996ff9c-5hmps" event={"ID":"adabf7b9-22ed-48a1-83b7-d313598161f7","Type":"ContainerDied","Data":"3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a"}
Jul 24 17:12:42.854465 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.854350    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859996ff9c-5hmps" event={"ID":"adabf7b9-22ed-48a1-83b7-d313598161f7","Type":"ContainerDied","Data":"8d5a38a698a72b3fc903a416464bb99059166a018ed60c9863d5601d34b83ced"}
Jul 24 17:12:42.854465 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.854371    2563 scope.go:117] "RemoveContainer" containerID="3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a"
Jul 24 17:12:42.862854 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.862836    2563 scope.go:117] "RemoveContainer" containerID="3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a"
Jul 24 17:12:42.863119 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:12:42.863100    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a\": container with ID starting with 3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a not found: ID does not exist" containerID="3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a"
Jul 24 17:12:42.863174 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.863128    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a"} err="failed to get container status \"3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a\": rpc error: code = NotFound desc = could not find container \"3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a\": container with ID starting with 3b747097c4ea3eabb3318d93643403ea9d36bd4388ae71eb9132032caa11a30a not found: ID does not exist"
Jul 24 17:12:42.874899 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.874880    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859996ff9c-5hmps"]
Jul 24 17:12:42.880006 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:42.879987    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-859996ff9c-5hmps"]
Jul 24 17:12:43.935264 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:12:43.935229    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adabf7b9-22ed-48a1-83b7-d313598161f7" path="/var/lib/kubelet/pods/adabf7b9-22ed-48a1-83b7-d313598161f7/volumes"
Jul 24 17:13:02.247913 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.247826    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bc985bbb9-hj7w7"]
Jul 24 17:13:02.248298 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.248207    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adabf7b9-22ed-48a1-83b7-d313598161f7" containerName="console"
Jul 24 17:13:02.248298 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.248226    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="adabf7b9-22ed-48a1-83b7-d313598161f7" containerName="console"
Jul 24 17:13:02.248380 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.248318    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="adabf7b9-22ed-48a1-83b7-d313598161f7" containerName="console"
Jul 24 17:13:02.251434 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.251414    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.254503 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.254476    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 17:13:02.254636 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.254599    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 17:13:02.254921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.254902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j5hxv\""
Jul 24 17:13:02.255072 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.254966    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 17:13:02.255072 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.254990    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 17:13:02.255072 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.254990    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 17:13:02.255266 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.255251    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 17:13:02.255315 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.255265    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 17:13:02.261236 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.261216    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 17:13:02.262543 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.262521    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc985bbb9-hj7w7"]
Jul 24 17:13:02.333035 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.333005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-serving-cert\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.333206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.333042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-oauth-serving-cert\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.333206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.333069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-config\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.333206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.333156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-oauth-config\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.333206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.333186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-trusted-ca-bundle\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.333348 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.333222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-service-ca\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.333348 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.333238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbw4j\" (UniqueName: \"kubernetes.io/projected/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-kube-api-access-zbw4j\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.434132 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.434104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-oauth-config\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.434306 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.434139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-trusted-ca-bundle\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.434306 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.434166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-service-ca\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.434306 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.434184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbw4j\" (UniqueName: \"kubernetes.io/projected/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-kube-api-access-zbw4j\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.434306 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.434216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-serving-cert\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.434306 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.434243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-oauth-serving-cert\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.434306 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.434274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-config\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.435013 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.434990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-service-ca\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.435115 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.434990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-config\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.435115 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.435039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-oauth-serving-cert\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.435288 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.435271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-trusted-ca-bundle\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.437268 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.437242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-oauth-config\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.437371 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.437283    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-serving-cert\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.442984 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.442962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbw4j\" (UniqueName: \"kubernetes.io/projected/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-kube-api-access-zbw4j\") pod \"console-6bc985bbb9-hj7w7\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") " pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.563150 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.563053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:02.692443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.692420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc985bbb9-hj7w7"]
Jul 24 17:13:02.694604 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:13:02.694572    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda85700f1_6b8e_4fd8_9de1_f94d54c041bf.slice/crio-ab33cff43f68ccafe4aeae6950a8a44c32c1f01ba14e9865dd67ed1940dae1fa WatchSource:0}: Error finding container ab33cff43f68ccafe4aeae6950a8a44c32c1f01ba14e9865dd67ed1940dae1fa: Status 404 returned error can't find the container with id ab33cff43f68ccafe4aeae6950a8a44c32c1f01ba14e9865dd67ed1940dae1fa
Jul 24 17:13:02.930433 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.930390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc985bbb9-hj7w7" event={"ID":"a85700f1-6b8e-4fd8-9de1-f94d54c041bf","Type":"ContainerStarted","Data":"20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546"}
Jul 24 17:13:02.930433 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.930434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc985bbb9-hj7w7" event={"ID":"a85700f1-6b8e-4fd8-9de1-f94d54c041bf","Type":"ContainerStarted","Data":"ab33cff43f68ccafe4aeae6950a8a44c32c1f01ba14e9865dd67ed1940dae1fa"}
Jul 24 17:13:02.949570 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:02.949521    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bc985bbb9-hj7w7" podStartSLOduration=0.949507012 podStartE2EDuration="949.507012ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:02.947936608 +0000 UTC m=+175.575814462" watchObservedRunningTime="2026-07-24 17:13:02.949507012 +0000 UTC m=+175.577384864"
Jul 24 17:13:12.563735 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:12.563701    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:12.564252 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:12.563763    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:12.568302 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:12.568282    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:13:12.976668 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:13:12.976637    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:14:19.333273 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.333240    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"]
Jul 24 17:14:19.336679 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.336663    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.339931 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.339908    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:14:19.341250 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.341231    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:14:19.341307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.341238    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-29nn2\""
Jul 24 17:14:19.345219 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.345185    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"]
Jul 24 17:14:19.428086 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.428059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.428264 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.428098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.428264 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.428131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfcbq\" (UniqueName: \"kubernetes.io/projected/d7f89dfd-c9ea-4e98-9204-136d1392084d-kube-api-access-pfcbq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.529394 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.529343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfcbq\" (UniqueName: \"kubernetes.io/projected/d7f89dfd-c9ea-4e98-9204-136d1392084d-kube-api-access-pfcbq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.529567 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.529427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.529567 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.529456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.529843 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.529825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.529902 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.529854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.538506 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.538487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfcbq\" (UniqueName: \"kubernetes.io/projected/d7f89dfd-c9ea-4e98-9204-136d1392084d-kube-api-access-pfcbq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.646688 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.646606    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:19.772550 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:19.772525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"]
Jul 24 17:14:19.773958 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:14:19.773928    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f89dfd_c9ea_4e98_9204_136d1392084d.slice/crio-6538dd00e5303ca4cc7aa88c7889277c5757dfd24211c70d88bcca2d96ed6b49 WatchSource:0}: Error finding container 6538dd00e5303ca4cc7aa88c7889277c5757dfd24211c70d88bcca2d96ed6b49: Status 404 returned error can't find the container with id 6538dd00e5303ca4cc7aa88c7889277c5757dfd24211c70d88bcca2d96ed6b49
Jul 24 17:14:20.212229 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:20.212189    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t" event={"ID":"d7f89dfd-c9ea-4e98-9204-136d1392084d","Type":"ContainerStarted","Data":"6538dd00e5303ca4cc7aa88c7889277c5757dfd24211c70d88bcca2d96ed6b49"}
Jul 24 17:14:26.238441 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:26.238353    2563 generic.go:356] "Generic (PLEG): container finished" podID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerID="00ee355cbab096ba8de2f8b5e788d7aed076182bf109109c01dd15ab1bd53be1" exitCode=0
Jul 24 17:14:26.238807 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:26.238437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t" event={"ID":"d7f89dfd-c9ea-4e98-9204-136d1392084d","Type":"ContainerDied","Data":"00ee355cbab096ba8de2f8b5e788d7aed076182bf109109c01dd15ab1bd53be1"}
Jul 24 17:14:29.253762 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:29.253727    2563 generic.go:356] "Generic (PLEG): container finished" podID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerID="fc0a84a2b83135a87075431b944f867d578e4be56a2073b70f43c0528b356483" exitCode=0
Jul 24 17:14:29.254150 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:29.253817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t" event={"ID":"d7f89dfd-c9ea-4e98-9204-136d1392084d","Type":"ContainerDied","Data":"fc0a84a2b83135a87075431b944f867d578e4be56a2073b70f43c0528b356483"}
Jul 24 17:14:37.289718 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:37.289673    2563 generic.go:356] "Generic (PLEG): container finished" podID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerID="b21876ba708194b6298c75e77808d40c4513a8e47182a9a1fd0f6687fc2bb4f3" exitCode=0
Jul 24 17:14:37.290072 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:37.289758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t" event={"ID":"d7f89dfd-c9ea-4e98-9204-136d1392084d","Type":"ContainerDied","Data":"b21876ba708194b6298c75e77808d40c4513a8e47182a9a1fd0f6687fc2bb4f3"}
Jul 24 17:14:38.420489 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.420467    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:38.488646 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.488615    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-bundle\") pod \"d7f89dfd-c9ea-4e98-9204-136d1392084d\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") "
Jul 24 17:14:38.488781 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.488712    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfcbq\" (UniqueName: \"kubernetes.io/projected/d7f89dfd-c9ea-4e98-9204-136d1392084d-kube-api-access-pfcbq\") pod \"d7f89dfd-c9ea-4e98-9204-136d1392084d\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") "
Jul 24 17:14:38.488781 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.488737    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-util\") pod \"d7f89dfd-c9ea-4e98-9204-136d1392084d\" (UID: \"d7f89dfd-c9ea-4e98-9204-136d1392084d\") "
Jul 24 17:14:38.489340 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.489309    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-bundle" (OuterVolumeSpecName: "bundle") pod "d7f89dfd-c9ea-4e98-9204-136d1392084d" (UID: "d7f89dfd-c9ea-4e98-9204-136d1392084d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:38.491004 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.490973    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7f89dfd-c9ea-4e98-9204-136d1392084d-kube-api-access-pfcbq" (OuterVolumeSpecName: "kube-api-access-pfcbq") pod "d7f89dfd-c9ea-4e98-9204-136d1392084d" (UID: "d7f89dfd-c9ea-4e98-9204-136d1392084d"). InnerVolumeSpecName "kube-api-access-pfcbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:38.492825 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.492787    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-util" (OuterVolumeSpecName: "util") pod "d7f89dfd-c9ea-4e98-9204-136d1392084d" (UID: "d7f89dfd-c9ea-4e98-9204-136d1392084d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:38.590081 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.590021    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:14:38.590081 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.590043    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfcbq\" (UniqueName: \"kubernetes.io/projected/d7f89dfd-c9ea-4e98-9204-136d1392084d-kube-api-access-pfcbq\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:14:38.590081 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:38.590054    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f89dfd-c9ea-4e98-9204-136d1392084d-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:14:39.299469 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:39.299443    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t"
Jul 24 17:14:39.299638 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:39.299432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409jk7t" event={"ID":"d7f89dfd-c9ea-4e98-9204-136d1392084d","Type":"ContainerDied","Data":"6538dd00e5303ca4cc7aa88c7889277c5757dfd24211c70d88bcca2d96ed6b49"}
Jul 24 17:14:39.299638 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:39.299563    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6538dd00e5303ca4cc7aa88c7889277c5757dfd24211c70d88bcca2d96ed6b49"
Jul 24 17:14:42.047769 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.047729    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"]
Jul 24 17:14:42.048245 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.048116    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerName="util"
Jul 24 17:14:42.048245 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.048133    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerName="util"
Jul 24 17:14:42.048245 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.048145    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerName="extract"
Jul 24 17:14:42.048245 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.048152    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerName="extract"
Jul 24 17:14:42.048245 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.048175    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerName="pull"
Jul 24 17:14:42.048245 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.048183    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerName="pull"
Jul 24 17:14:42.048534 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.048260    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7f89dfd-c9ea-4e98-9204-136d1392084d" containerName="extract"
Jul 24 17:14:42.091248 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.091214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"]
Jul 24 17:14:42.091405 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.091319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"
Jul 24 17:14:42.095004 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.094979    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qz4hz\""
Jul 24 17:14:42.095153 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.095006    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:14:42.095153 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.094982    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 17:14:42.222483 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.222442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkprb\" (UniqueName: \"kubernetes.io/projected/d1901d39-e7ad-43c1-ac43-c79f6f87cbd1-kube-api-access-vkprb\") pod \"cert-manager-operator-controller-manager-55c444bf86-hn6hf\" (UID: \"d1901d39-e7ad-43c1-ac43-c79f6f87cbd1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"
Jul 24 17:14:42.222623 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.222489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1901d39-e7ad-43c1-ac43-c79f6f87cbd1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hn6hf\" (UID: \"d1901d39-e7ad-43c1-ac43-c79f6f87cbd1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"
Jul 24 17:14:42.323373 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.323299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1901d39-e7ad-43c1-ac43-c79f6f87cbd1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hn6hf\" (UID: \"d1901d39-e7ad-43c1-ac43-c79f6f87cbd1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"
Jul 24 17:14:42.323373 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.323358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkprb\" (UniqueName: \"kubernetes.io/projected/d1901d39-e7ad-43c1-ac43-c79f6f87cbd1-kube-api-access-vkprb\") pod \"cert-manager-operator-controller-manager-55c444bf86-hn6hf\" (UID: \"d1901d39-e7ad-43c1-ac43-c79f6f87cbd1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"
Jul 24 17:14:42.323656 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.323637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1901d39-e7ad-43c1-ac43-c79f6f87cbd1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hn6hf\" (UID: \"d1901d39-e7ad-43c1-ac43-c79f6f87cbd1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"
Jul 24 17:14:42.333001 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.332976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkprb\" (UniqueName: \"kubernetes.io/projected/d1901d39-e7ad-43c1-ac43-c79f6f87cbd1-kube-api-access-vkprb\") pod \"cert-manager-operator-controller-manager-55c444bf86-hn6hf\" (UID: \"d1901d39-e7ad-43c1-ac43-c79f6f87cbd1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"
Jul 24 17:14:42.399776 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.399750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"
Jul 24 17:14:42.565374 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:42.565346    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf"]
Jul 24 17:14:42.567532 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:14:42.567506    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1901d39_e7ad_43c1_ac43_c79f6f87cbd1.slice/crio-df663b877ea1981e9a2fa70c573d6017d5dfdcdeb7188890cd49048c0a8b79d5 WatchSource:0}: Error finding container df663b877ea1981e9a2fa70c573d6017d5dfdcdeb7188890cd49048c0a8b79d5: Status 404 returned error can't find the container with id df663b877ea1981e9a2fa70c573d6017d5dfdcdeb7188890cd49048c0a8b79d5
Jul 24 17:14:43.317056 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:43.317015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf" event={"ID":"d1901d39-e7ad-43c1-ac43-c79f6f87cbd1","Type":"ContainerStarted","Data":"df663b877ea1981e9a2fa70c573d6017d5dfdcdeb7188890cd49048c0a8b79d5"}
Jul 24 17:14:45.327081 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:45.327048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf" event={"ID":"d1901d39-e7ad-43c1-ac43-c79f6f87cbd1","Type":"ContainerStarted","Data":"bbb8a9ff34ecc2dbea6ef3389da6d8176a93fc6d6a3d5b58fa1d9bbf617548c8"}
Jul 24 17:14:45.351562 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:45.351510    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hn6hf" podStartSLOduration=1.473295212 podStartE2EDuration="3.351493484s" totalImagesPullingTime="1.878198272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:45.350017572 +0000 UTC m=+277.977895474" watchObservedRunningTime="2026-07-24 17:14:45.351493484 +0000 UTC m=+277.979371335"
Jul 24 17:14:46.538585 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.538551    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"]
Jul 24 17:14:46.540848 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.540832    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.543997 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.543974    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:14:46.545489 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.545465    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:14:46.545588 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.545471    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-29nn2\""
Jul 24 17:14:46.550779 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.550756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"]
Jul 24 17:14:46.658615 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.658583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8mrr\" (UniqueName: \"kubernetes.io/projected/4b804be0-c98b-496f-bf7c-ad57353369ac-kube-api-access-t8mrr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.658719 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.658633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.658719 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.658656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.759693 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.759657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.759867 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.759728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8mrr\" (UniqueName: \"kubernetes.io/projected/4b804be0-c98b-496f-bf7c-ad57353369ac-kube-api-access-t8mrr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.759867 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.759765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.760125 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.760105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.760179 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.760151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.768328 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.768294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8mrr\" (UniqueName: \"kubernetes.io/projected/4b804be0-c98b-496f-bf7c-ad57353369ac-kube-api-access-t8mrr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.851528 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.851427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:46.988048 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:46.987966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"]
Jul 24 17:14:46.990199 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:14:46.990171    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b804be0_c98b_496f_bf7c_ad57353369ac.slice/crio-24fed5c2a12d5c61649aa301b5f4d24bbe3ba6421ecb71785715b9bd3a954176 WatchSource:0}: Error finding container 24fed5c2a12d5c61649aa301b5f4d24bbe3ba6421ecb71785715b9bd3a954176: Status 404 returned error can't find the container with id 24fed5c2a12d5c61649aa301b5f4d24bbe3ba6421ecb71785715b9bd3a954176
Jul 24 17:14:47.336613 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:47.336582    2563 generic.go:356] "Generic (PLEG): container finished" podID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerID="048d0d34d153083d9a2ceec21e8b4e5d139aee857d1e129bc3bf5b4633c21e52" exitCode=0
Jul 24 17:14:47.336808 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:47.336672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc" event={"ID":"4b804be0-c98b-496f-bf7c-ad57353369ac","Type":"ContainerDied","Data":"048d0d34d153083d9a2ceec21e8b4e5d139aee857d1e129bc3bf5b4633c21e52"}
Jul 24 17:14:47.336808 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:47.336721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc" event={"ID":"4b804be0-c98b-496f-bf7c-ad57353369ac","Type":"ContainerStarted","Data":"24fed5c2a12d5c61649aa301b5f4d24bbe3ba6421ecb71785715b9bd3a954176"}
Jul 24 17:14:49.347542 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:49.347515    2563 generic.go:356] "Generic (PLEG): container finished" podID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerID="f84fb5438661b30a9184de64e75b12fa28994309d163d0fe41eea7ce2991c06e" exitCode=0
Jul 24 17:14:49.347853 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:49.347596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc" event={"ID":"4b804be0-c98b-496f-bf7c-ad57353369ac","Type":"ContainerDied","Data":"f84fb5438661b30a9184de64e75b12fa28994309d163d0fe41eea7ce2991c06e"}
Jul 24 17:14:50.353674 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:50.353638    2563 generic.go:356] "Generic (PLEG): container finished" podID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerID="e2b1cecbf4236df639bbec44b5e2f67cb1d8aa6a38f86ab4bd5576847f26298d" exitCode=0
Jul 24 17:14:50.354116 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:50.353718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc" event={"ID":"4b804be0-c98b-496f-bf7c-ad57353369ac","Type":"ContainerDied","Data":"e2b1cecbf4236df639bbec44b5e2f67cb1d8aa6a38f86ab4bd5576847f26298d"}
Jul 24 17:14:51.485703 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.485673    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:51.600123 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.600093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-bundle\") pod \"4b804be0-c98b-496f-bf7c-ad57353369ac\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") "
Jul 24 17:14:51.600280 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.600138    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-util\") pod \"4b804be0-c98b-496f-bf7c-ad57353369ac\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") "
Jul 24 17:14:51.600280 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.600176    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8mrr\" (UniqueName: \"kubernetes.io/projected/4b804be0-c98b-496f-bf7c-ad57353369ac-kube-api-access-t8mrr\") pod \"4b804be0-c98b-496f-bf7c-ad57353369ac\" (UID: \"4b804be0-c98b-496f-bf7c-ad57353369ac\") "
Jul 24 17:14:51.600491 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.600468    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-bundle" (OuterVolumeSpecName: "bundle") pod "4b804be0-c98b-496f-bf7c-ad57353369ac" (UID: "4b804be0-c98b-496f-bf7c-ad57353369ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:51.602292 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.602271    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b804be0-c98b-496f-bf7c-ad57353369ac-kube-api-access-t8mrr" (OuterVolumeSpecName: "kube-api-access-t8mrr") pod "4b804be0-c98b-496f-bf7c-ad57353369ac" (UID: "4b804be0-c98b-496f-bf7c-ad57353369ac"). InnerVolumeSpecName "kube-api-access-t8mrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:14:51.605787 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.605767    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-util" (OuterVolumeSpecName: "util") pod "4b804be0-c98b-496f-bf7c-ad57353369ac" (UID: "4b804be0-c98b-496f-bf7c-ad57353369ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:14:51.700847 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.700821    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:14:51.700847 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.700845    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8mrr\" (UniqueName: \"kubernetes.io/projected/4b804be0-c98b-496f-bf7c-ad57353369ac-kube-api-access-t8mrr\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:14:51.701013 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:51.700854    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b804be0-c98b-496f-bf7c-ad57353369ac-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:14:52.369552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:52.369521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc" event={"ID":"4b804be0-c98b-496f-bf7c-ad57353369ac","Type":"ContainerDied","Data":"24fed5c2a12d5c61649aa301b5f4d24bbe3ba6421ecb71785715b9bd3a954176"}
Jul 24 17:14:52.369765 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:52.369572    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr7jpc"
Jul 24 17:14:52.369765 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:52.369588    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24fed5c2a12d5c61649aa301b5f4d24bbe3ba6421ecb71785715b9bd3a954176"
Jul 24 17:14:56.146415 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.146380    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7kh48"]
Jul 24 17:14:56.146785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.146652    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerName="pull"
Jul 24 17:14:56.146785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.146662    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerName="pull"
Jul 24 17:14:56.146785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.146677    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerName="util"
Jul 24 17:14:56.146785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.146684    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerName="util"
Jul 24 17:14:56.146785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.146691    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerName="extract"
Jul 24 17:14:56.146785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.146696    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerName="extract"
Jul 24 17:14:56.146785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.146751    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b804be0-c98b-496f-bf7c-ad57353369ac" containerName="extract"
Jul 24 17:14:56.148895 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.148880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7kh48"
Jul 24 17:14:56.151595 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.151566    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 17:14:56.151726 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.151639    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 17:14:56.151786 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.151720    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-g7z5f\""
Jul 24 17:14:56.159052 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.159030    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7kh48"]
Jul 24 17:14:56.239936 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.239911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/286252c6-3b41-41e2-aa16-c15e518cb207-bound-sa-token\") pod \"cert-manager-55b4d954d5-7kh48\" (UID: \"286252c6-3b41-41e2-aa16-c15e518cb207\") " pod="cert-manager/cert-manager-55b4d954d5-7kh48"
Jul 24 17:14:56.240076 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.239964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9frq\" (UniqueName: \"kubernetes.io/projected/286252c6-3b41-41e2-aa16-c15e518cb207-kube-api-access-v9frq\") pod \"cert-manager-55b4d954d5-7kh48\" (UID: \"286252c6-3b41-41e2-aa16-c15e518cb207\") " pod="cert-manager/cert-manager-55b4d954d5-7kh48"
Jul 24 17:14:56.341345 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.341316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/286252c6-3b41-41e2-aa16-c15e518cb207-bound-sa-token\") pod \"cert-manager-55b4d954d5-7kh48\" (UID: \"286252c6-3b41-41e2-aa16-c15e518cb207\") " pod="cert-manager/cert-manager-55b4d954d5-7kh48"
Jul 24 17:14:56.341462 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.341376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9frq\" (UniqueName: \"kubernetes.io/projected/286252c6-3b41-41e2-aa16-c15e518cb207-kube-api-access-v9frq\") pod \"cert-manager-55b4d954d5-7kh48\" (UID: \"286252c6-3b41-41e2-aa16-c15e518cb207\") " pod="cert-manager/cert-manager-55b4d954d5-7kh48"
Jul 24 17:14:56.349505 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.349473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/286252c6-3b41-41e2-aa16-c15e518cb207-bound-sa-token\") pod \"cert-manager-55b4d954d5-7kh48\" (UID: \"286252c6-3b41-41e2-aa16-c15e518cb207\") " pod="cert-manager/cert-manager-55b4d954d5-7kh48"
Jul 24 17:14:56.349628 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.349611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9frq\" (UniqueName: \"kubernetes.io/projected/286252c6-3b41-41e2-aa16-c15e518cb207-kube-api-access-v9frq\") pod \"cert-manager-55b4d954d5-7kh48\" (UID: \"286252c6-3b41-41e2-aa16-c15e518cb207\") " pod="cert-manager/cert-manager-55b4d954d5-7kh48"
Jul 24 17:14:56.471230 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.471203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7kh48"
Jul 24 17:14:56.599667 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:56.599641    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7kh48"]
Jul 24 17:14:56.603224 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:14:56.603192    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod286252c6_3b41_41e2_aa16_c15e518cb207.slice/crio-439677b13ad8c3a578e3a878fd4890f174ed054c1f815b532bf9729d700f5493 WatchSource:0}: Error finding container 439677b13ad8c3a578e3a878fd4890f174ed054c1f815b532bf9729d700f5493: Status 404 returned error can't find the container with id 439677b13ad8c3a578e3a878fd4890f174ed054c1f815b532bf9729d700f5493
Jul 24 17:14:57.392424 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:57.392384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7kh48" event={"ID":"286252c6-3b41-41e2-aa16-c15e518cb207","Type":"ContainerStarted","Data":"439677b13ad8c3a578e3a878fd4890f174ed054c1f815b532bf9729d700f5493"}
Jul 24 17:14:59.137693 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.137659    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"]
Jul 24 17:14:59.140542 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.140527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"
Jul 24 17:14:59.143219 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.143193    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 17:14:59.143364 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.143262    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:14:59.143364 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.143282    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-s2jcx\""
Jul 24 17:14:59.150923 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.150904    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"]
Jul 24 17:14:59.267686 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.267607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d57kk\" (UniqueName: \"kubernetes.io/projected/0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3-kube-api-access-d57kk\") pod \"openshift-lws-operator-fd8ccff4c-d6skq\" (UID: \"0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"
Jul 24 17:14:59.267686 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.267661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d6skq\" (UID: \"0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"
Jul 24 17:14:59.368185 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.368150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d6skq\" (UID: \"0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"
Jul 24 17:14:59.368322 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.368245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d57kk\" (UniqueName: \"kubernetes.io/projected/0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3-kube-api-access-d57kk\") pod \"openshift-lws-operator-fd8ccff4c-d6skq\" (UID: \"0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"
Jul 24 17:14:59.368615 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.368596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d6skq\" (UID: \"0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"
Jul 24 17:14:59.380257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.380234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d57kk\" (UniqueName: \"kubernetes.io/projected/0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3-kube-api-access-d57kk\") pod \"openshift-lws-operator-fd8ccff4c-d6skq\" (UID: \"0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"
Jul 24 17:14:59.403016 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.402992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7kh48" event={"ID":"286252c6-3b41-41e2-aa16-c15e518cb207","Type":"ContainerStarted","Data":"0e21ed95c17a29bfa6aa4c7dc7bff7f80dd49e548093b0cb407c3f06db9e6cab"}
Jul 24 17:14:59.418319 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.418267    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7kh48" podStartSLOduration=1.040758583 podStartE2EDuration="3.418250439s" totalImagesPullingTime="2.377491856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:59.418020288 +0000 UTC m=+292.045898140" watchObservedRunningTime="2026-07-24 17:14:59.418250439 +0000 UTC m=+292.046128292"
Jul 24 17:14:59.448908 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.448883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"
Jul 24 17:14:59.577980 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:14:59.577957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq"]
Jul 24 17:14:59.580142 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:14:59.580114    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c8d4f72_3b2d_43ef_9eb2_f0cda72b30c3.slice/crio-ca09d6499404ca9a558469412333c45b7d6423c4a8dc1a71057fcc20ffc2554b WatchSource:0}: Error finding container ca09d6499404ca9a558469412333c45b7d6423c4a8dc1a71057fcc20ffc2554b: Status 404 returned error can't find the container with id ca09d6499404ca9a558469412333c45b7d6423c4a8dc1a71057fcc20ffc2554b
Jul 24 17:15:00.409732 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:00.409686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq" event={"ID":"0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3","Type":"ContainerStarted","Data":"ca09d6499404ca9a558469412333c45b7d6423c4a8dc1a71057fcc20ffc2554b"}
Jul 24 17:15:01.416352 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:01.416307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq" event={"ID":"0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3","Type":"ContainerStarted","Data":"0f1b01bf42e5bf5d13fa213f3bc5ea74473ae52bdd9e2c7b7fe2d74d10126486"}
Jul 24 17:15:01.435913 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:01.435860    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d6skq" podStartSLOduration=0.721638795 podStartE2EDuration="2.435840112s" totalImagesPullingTime="1.714201317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:01.434259388 +0000 UTC m=+294.062137231" watchObservedRunningTime="2026-07-24 17:15:01.435840112 +0000 UTC m=+294.063717965"
Jul 24 17:15:04.198378 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.198339    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"]
Jul 24 17:15:04.201902 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.201880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.204832 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.204811    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-29nn2\""
Jul 24 17:15:04.204832 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.204818    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:15:04.204832 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.204829    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:15:04.210629 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.210603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.210732 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.210657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrmg6\" (UniqueName: \"kubernetes.io/projected/e66c28bb-8011-4897-9948-65ef2ddfb6b6-kube-api-access-vrmg6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.210829 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.210745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.211017 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.211000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"]
Jul 24 17:15:04.311688 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.311650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrmg6\" (UniqueName: \"kubernetes.io/projected/e66c28bb-8011-4897-9948-65ef2ddfb6b6-kube-api-access-vrmg6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.311878 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.311707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.311878 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.311814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.312126 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.312105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.312171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.312143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.319813 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.319775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrmg6\" (UniqueName: \"kubernetes.io/projected/e66c28bb-8011-4897-9948-65ef2ddfb6b6-kube-api-access-vrmg6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.511486 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.511394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:04.643963 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:04.643937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"]
Jul 24 17:15:04.646347 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:15:04.646320    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66c28bb_8011_4897_9948_65ef2ddfb6b6.slice/crio-63e3fc0de641c5a3d73a3fbd60a903085d990ca18dd0ac1692d465a7533e1fd4 WatchSource:0}: Error finding container 63e3fc0de641c5a3d73a3fbd60a903085d990ca18dd0ac1692d465a7533e1fd4: Status 404 returned error can't find the container with id 63e3fc0de641c5a3d73a3fbd60a903085d990ca18dd0ac1692d465a7533e1fd4
Jul 24 17:15:05.433621 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:05.433590    2563 generic.go:356] "Generic (PLEG): container finished" podID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerID="5731d66807ffd2189ef095697324a61291fcc9d06c3e73751915c858786d06c2" exitCode=0
Jul 24 17:15:05.434019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:05.433627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk" event={"ID":"e66c28bb-8011-4897-9948-65ef2ddfb6b6","Type":"ContainerDied","Data":"5731d66807ffd2189ef095697324a61291fcc9d06c3e73751915c858786d06c2"}
Jul 24 17:15:05.434019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:05.433663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk" event={"ID":"e66c28bb-8011-4897-9948-65ef2ddfb6b6","Type":"ContainerStarted","Data":"63e3fc0de641c5a3d73a3fbd60a903085d990ca18dd0ac1692d465a7533e1fd4"}
Jul 24 17:15:07.443921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:07.443883    2563 generic.go:356] "Generic (PLEG): container finished" podID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerID="ca40645a0f2bc88d7aa660eff281fd617883644ad5980608ac11944cab308e24" exitCode=0
Jul 24 17:15:07.444272 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:07.443923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk" event={"ID":"e66c28bb-8011-4897-9948-65ef2ddfb6b6","Type":"ContainerDied","Data":"ca40645a0f2bc88d7aa660eff281fd617883644ad5980608ac11944cab308e24"}
Jul 24 17:15:07.819031 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:07.818952    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:15:07.823072 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:07.823044    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:15:07.833106 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:07.833085    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 17:15:08.450205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:08.450172    2563 generic.go:356] "Generic (PLEG): container finished" podID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerID="6795f0f8eedfc650431f302f21c380238fee50bb55cf46ba74a8a92a365717be" exitCode=0
Jul 24 17:15:08.451624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:08.450258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk" event={"ID":"e66c28bb-8011-4897-9948-65ef2ddfb6b6","Type":"ContainerDied","Data":"6795f0f8eedfc650431f302f21c380238fee50bb55cf46ba74a8a92a365717be"}
Jul 24 17:15:09.577291 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.577268    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:09.649002 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.648972    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-bundle\") pod \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") "
Jul 24 17:15:09.649002 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.649001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-util\") pod \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") "
Jul 24 17:15:09.649181 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.649061    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrmg6\" (UniqueName: \"kubernetes.io/projected/e66c28bb-8011-4897-9948-65ef2ddfb6b6-kube-api-access-vrmg6\") pod \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\" (UID: \"e66c28bb-8011-4897-9948-65ef2ddfb6b6\") "
Jul 24 17:15:09.649637 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.649616    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-bundle" (OuterVolumeSpecName: "bundle") pod "e66c28bb-8011-4897-9948-65ef2ddfb6b6" (UID: "e66c28bb-8011-4897-9948-65ef2ddfb6b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:15:09.651262 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.651234    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e66c28bb-8011-4897-9948-65ef2ddfb6b6-kube-api-access-vrmg6" (OuterVolumeSpecName: "kube-api-access-vrmg6") pod "e66c28bb-8011-4897-9948-65ef2ddfb6b6" (UID: "e66c28bb-8011-4897-9948-65ef2ddfb6b6"). InnerVolumeSpecName "kube-api-access-vrmg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:15:09.654479 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.654454    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-util" (OuterVolumeSpecName: "util") pod "e66c28bb-8011-4897-9948-65ef2ddfb6b6" (UID: "e66c28bb-8011-4897-9948-65ef2ddfb6b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:15:09.749959 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.749890    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:09.749959 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.749912    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e66c28bb-8011-4897-9948-65ef2ddfb6b6-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:09.749959 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:09.749921    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrmg6\" (UniqueName: \"kubernetes.io/projected/e66c28bb-8011-4897-9948-65ef2ddfb6b6-kube-api-access-vrmg6\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:10.461005 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:10.460980    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk"
Jul 24 17:15:10.461188 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:10.460974    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhcggk" event={"ID":"e66c28bb-8011-4897-9948-65ef2ddfb6b6","Type":"ContainerDied","Data":"63e3fc0de641c5a3d73a3fbd60a903085d990ca18dd0ac1692d465a7533e1fd4"}
Jul 24 17:15:10.461188 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:10.461110    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63e3fc0de641c5a3d73a3fbd60a903085d990ca18dd0ac1692d465a7533e1fd4"
Jul 24 17:15:19.381489 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.381455    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"]
Jul 24 17:15:19.381971 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.381772    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerName="util"
Jul 24 17:15:19.381971 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.381783    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerName="util"
Jul 24 17:15:19.381971 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.381808    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerName="pull"
Jul 24 17:15:19.381971 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.381813    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerName="pull"
Jul 24 17:15:19.381971 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.381822    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerName="extract"
Jul 24 17:15:19.381971 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.381828    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerName="extract"
Jul 24 17:15:19.381971 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.381891    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e66c28bb-8011-4897-9948-65ef2ddfb6b6" containerName="extract"
Jul 24 17:15:19.386016 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.385999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.390115 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.390093    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 17:15:19.390370 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.390175    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 17:15:19.390433 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.390413    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 17:15:19.390433 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.390415    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4tjsr\""
Jul 24 17:15:19.390594 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.390581    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 17:15:19.412375 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.412352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"]
Jul 24 17:15:19.421931 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.421907    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb2de119-8ecf-4de0-b642-7e8f241231c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.422047 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.421961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dklf\" (UniqueName: \"kubernetes.io/projected/eb2de119-8ecf-4de0-b642-7e8f241231c9-kube-api-access-2dklf\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.422092 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.422038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb2de119-8ecf-4de0-b642-7e8f241231c9-tmp\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.422131 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.422102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb2de119-8ecf-4de0-b642-7e8f241231c9-manifests\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.422212 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.422130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb2de119-8ecf-4de0-b642-7e8f241231c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.523329 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.523296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb2de119-8ecf-4de0-b642-7e8f241231c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.523545 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.523346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dklf\" (UniqueName: \"kubernetes.io/projected/eb2de119-8ecf-4de0-b642-7e8f241231c9-kube-api-access-2dklf\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.523545 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.523369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb2de119-8ecf-4de0-b642-7e8f241231c9-tmp\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.523545 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.523395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb2de119-8ecf-4de0-b642-7e8f241231c9-manifests\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.523545 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.523413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb2de119-8ecf-4de0-b642-7e8f241231c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.523969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.523943    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb2de119-8ecf-4de0-b642-7e8f241231c9-manifests\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.526026 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.526005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb2de119-8ecf-4de0-b642-7e8f241231c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.526292 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.526273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb2de119-8ecf-4de0-b642-7e8f241231c9-tmp\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.526415 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.526399    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb2de119-8ecf-4de0-b642-7e8f241231c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.532261 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.532231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dklf\" (UniqueName: \"kubernetes.io/projected/eb2de119-8ecf-4de0-b642-7e8f241231c9-kube-api-access-2dklf\") pod \"opendatahub-operator-controller-manager-5bcd74455c-7gqm9\" (UID: \"eb2de119-8ecf-4de0-b642-7e8f241231c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.695848 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.695777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:19.840594 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.840568    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"]
Jul 24 17:15:19.842578 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:15:19.842553    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2de119_8ecf_4de0_b642_7e8f241231c9.slice/crio-b00eb74b998b84adc60efdb644d857fd6d7ae859346b258f838f918dfe17ff96 WatchSource:0}: Error finding container b00eb74b998b84adc60efdb644d857fd6d7ae859346b258f838f918dfe17ff96: Status 404 returned error can't find the container with id b00eb74b998b84adc60efdb644d857fd6d7ae859346b258f838f918dfe17ff96
Jul 24 17:15:19.844359 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:19.844338    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:15:20.507364 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:20.507323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9" event={"ID":"eb2de119-8ecf-4de0-b642-7e8f241231c9","Type":"ContainerStarted","Data":"b00eb74b998b84adc60efdb644d857fd6d7ae859346b258f838f918dfe17ff96"}
Jul 24 17:15:23.524467 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:23.524434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9" event={"ID":"eb2de119-8ecf-4de0-b642-7e8f241231c9","Type":"ContainerStarted","Data":"2be5748efb2cc22ad04f31b1cd8ce077fdb188f3f094b90779a2919bbf5541ba"}
Jul 24 17:15:24.530877 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:24.530838    2563 generic.go:356] "Generic (PLEG): container finished" podID="eb2de119-8ecf-4de0-b642-7e8f241231c9" containerID="2be5748efb2cc22ad04f31b1cd8ce077fdb188f3f094b90779a2919bbf5541ba" exitCode=0
Jul 24 17:15:24.531256 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:24.530934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9" event={"ID":"eb2de119-8ecf-4de0-b642-7e8f241231c9","Type":"ContainerDied","Data":"2be5748efb2cc22ad04f31b1cd8ce077fdb188f3f094b90779a2919bbf5541ba"}
Jul 24 17:15:25.537034 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:25.536997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9" event={"ID":"eb2de119-8ecf-4de0-b642-7e8f241231c9","Type":"ContainerStarted","Data":"5e6c1bedaa951cee3ca199d16d69f2b3c0cce0a713c373a4d0f7ea88b6fae703"}
Jul 24 17:15:25.537442 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:25.537147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:25.561011 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:25.560962    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9" podStartSLOduration=2.276572996 podStartE2EDuration="6.560948338s" totalImagesPullingTime="3.223938894s" totalInitContainerRuntime="1.060436448s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:25.55816349 +0000 UTC m=+318.186041342" watchObservedRunningTime="2026-07-24 17:15:25.560948338 +0000 UTC m=+318.188826189"
Jul 24 17:15:36.543617 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:36.543588    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bcd74455c-7gqm9"
Jul 24 17:15:39.380912 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.380873    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"]
Jul 24 17:15:39.386493 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.386470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.389606 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.389576    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-22trv\""
Jul 24 17:15:39.389718 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.389576    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 17:15:39.389923 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.389910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 17:15:39.402839 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.402815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"]
Jul 24 17:15:39.495933 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.495890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8e30207-dd22-42c4-b3af-ad8980d33d8d-tmp\") pod \"kube-auth-proxy-84b496c558-jrfl7\" (UID: \"f8e30207-dd22-42c4-b3af-ad8980d33d8d\") " pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.496101 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.495946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e30207-dd22-42c4-b3af-ad8980d33d8d-tls-certs\") pod \"kube-auth-proxy-84b496c558-jrfl7\" (UID: \"f8e30207-dd22-42c4-b3af-ad8980d33d8d\") " pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.496101 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.495979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trt6t\" (UniqueName: \"kubernetes.io/projected/f8e30207-dd22-42c4-b3af-ad8980d33d8d-kube-api-access-trt6t\") pod \"kube-auth-proxy-84b496c558-jrfl7\" (UID: \"f8e30207-dd22-42c4-b3af-ad8980d33d8d\") " pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.591495 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.591457    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p2wjf"]
Jul 24 17:15:39.595268 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.595244    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:39.596442 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.596417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e30207-dd22-42c4-b3af-ad8980d33d8d-tls-certs\") pod \"kube-auth-proxy-84b496c558-jrfl7\" (UID: \"f8e30207-dd22-42c4-b3af-ad8980d33d8d\") " pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.596551 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.596462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trt6t\" (UniqueName: \"kubernetes.io/projected/f8e30207-dd22-42c4-b3af-ad8980d33d8d-kube-api-access-trt6t\") pod \"kube-auth-proxy-84b496c558-jrfl7\" (UID: \"f8e30207-dd22-42c4-b3af-ad8980d33d8d\") " pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.596617 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.596560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8e30207-dd22-42c4-b3af-ad8980d33d8d-tmp\") pod \"kube-auth-proxy-84b496c558-jrfl7\" (UID: \"f8e30207-dd22-42c4-b3af-ad8980d33d8d\") " pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.598448 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.598425    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-m4jzz\""
Jul 24 17:15:39.598560 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.598539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 24 17:15:39.599179 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.599149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8e30207-dd22-42c4-b3af-ad8980d33d8d-tmp\") pod \"kube-auth-proxy-84b496c558-jrfl7\" (UID: \"f8e30207-dd22-42c4-b3af-ad8980d33d8d\") " pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.599313 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.599293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e30207-dd22-42c4-b3af-ad8980d33d8d-tls-certs\") pod \"kube-auth-proxy-84b496c558-jrfl7\" (UID: \"f8e30207-dd22-42c4-b3af-ad8980d33d8d\") " pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.614376 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.614338    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p2wjf"]
Jul 24 17:15:39.617711 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.617686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trt6t\" (UniqueName: \"kubernetes.io/projected/f8e30207-dd22-42c4-b3af-ad8980d33d8d-kube-api-access-trt6t\") pod \"kube-auth-proxy-84b496c558-jrfl7\" (UID: \"f8e30207-dd22-42c4-b3af-ad8980d33d8d\") " pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.696459 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.696422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"
Jul 24 17:15:39.696972 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.696951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057-cert\") pod \"odh-model-controller-7998c67dc4-p2wjf\" (UID: \"f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057\") " pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:39.697049 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.696982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flg7j\" (UniqueName: \"kubernetes.io/projected/f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057-kube-api-access-flg7j\") pod \"odh-model-controller-7998c67dc4-p2wjf\" (UID: \"f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057\") " pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:39.798446 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.798412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057-cert\") pod \"odh-model-controller-7998c67dc4-p2wjf\" (UID: \"f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057\") " pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:39.798613 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.798461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flg7j\" (UniqueName: \"kubernetes.io/projected/f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057-kube-api-access-flg7j\") pod \"odh-model-controller-7998c67dc4-p2wjf\" (UID: \"f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057\") " pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:39.798613 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:15:39.798568    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 24 17:15:39.798728 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:15:39.798644    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057-cert podName:f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057 nodeName:}" failed. No retries permitted until 2026-07-24 17:15:40.298620123 +0000 UTC m=+332.926497961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057-cert") pod "odh-model-controller-7998c67dc4-p2wjf" (UID: "f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057") : secret "odh-model-controller-webhook-cert" not found
Jul 24 17:15:39.808210 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.808179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flg7j\" (UniqueName: \"kubernetes.io/projected/f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057-kube-api-access-flg7j\") pod \"odh-model-controller-7998c67dc4-p2wjf\" (UID: \"f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057\") " pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:39.838507 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:39.838477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84b496c558-jrfl7"]
Jul 24 17:15:39.840568 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:15:39.840542    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e30207_dd22_42c4_b3af_ad8980d33d8d.slice/crio-8c7955b8e922e6cac4b73c91f10f60e258e402515c8d6face0e8a27ca378670d WatchSource:0}: Error finding container 8c7955b8e922e6cac4b73c91f10f60e258e402515c8d6face0e8a27ca378670d: Status 404 returned error can't find the container with id 8c7955b8e922e6cac4b73c91f10f60e258e402515c8d6face0e8a27ca378670d
Jul 24 17:15:40.303128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.303093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057-cert\") pod \"odh-model-controller-7998c67dc4-p2wjf\" (UID: \"f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057\") " pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:40.305628 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.305600    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057-cert\") pod \"odh-model-controller-7998c67dc4-p2wjf\" (UID: \"f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057\") " pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:40.471375 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.471340    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c2hgq"]
Jul 24 17:15:40.474996 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.474975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:40.479535 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.479510    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 24 17:15:40.490508 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.490482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c2hgq"]
Jul 24 17:15:40.530949 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.530907    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:40.606138 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.605249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwq4q\" (UniqueName: \"kubernetes.io/projected/91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c-kube-api-access-lwq4q\") pod \"model-serving-api-54d89bd5fc-c2hgq\" (UID: \"91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c\") " pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:40.606138 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.605314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c-tls-certs\") pod \"model-serving-api-54d89bd5fc-c2hgq\" (UID: \"91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c\") " pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:40.609232 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.609196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7" event={"ID":"f8e30207-dd22-42c4-b3af-ad8980d33d8d","Type":"ContainerStarted","Data":"8c7955b8e922e6cac4b73c91f10f60e258e402515c8d6face0e8a27ca378670d"}
Jul 24 17:15:40.672688 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.672655    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"]
Jul 24 17:15:40.677696 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.677643    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.680636 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.680470    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 17:15:40.680636 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.680590    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:15:40.680974 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.680631    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 17:15:40.680974 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.680853    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 17:15:40.681094 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.681079    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nh49w\""
Jul 24 17:15:40.690477 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.690452    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"]
Jul 24 17:15:40.702508 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.702481    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p2wjf"]
Jul 24 17:15:40.704986 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:15:40.704959    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6be5ae1_e4c0_4ad4_a7fc_2f130bab8057.slice/crio-ae402edbc02a2f028f1ab28187afb21f8f9b9cbca36f0e3724861f780b6b7160 WatchSource:0}: Error finding container ae402edbc02a2f028f1ab28187afb21f8f9b9cbca36f0e3724861f780b6b7160: Status 404 returned error can't find the container with id ae402edbc02a2f028f1ab28187afb21f8f9b9cbca36f0e3724861f780b6b7160
Jul 24 17:15:40.706625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.706143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwq4q\" (UniqueName: \"kubernetes.io/projected/91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c-kube-api-access-lwq4q\") pod \"model-serving-api-54d89bd5fc-c2hgq\" (UID: \"91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c\") " pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:40.706625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.706213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c-tls-certs\") pod \"model-serving-api-54d89bd5fc-c2hgq\" (UID: \"91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c\") " pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:40.706625 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:15:40.706353    2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 24 17:15:40.706625 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:15:40.706408    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c-tls-certs podName:91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c nodeName:}" failed. No retries permitted until 2026-07-24 17:15:41.206388498 +0000 UTC m=+333.834266335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c-tls-certs") pod "model-serving-api-54d89bd5fc-c2hgq" (UID: "91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c") : secret "model-serving-api-tls" not found
Jul 24 17:15:40.723742 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.723691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwq4q\" (UniqueName: \"kubernetes.io/projected/91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c-kube-api-access-lwq4q\") pod \"model-serving-api-54d89bd5fc-c2hgq\" (UID: \"91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c\") " pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:40.806736 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.806691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twxl\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-kube-api-access-4twxl\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.806951 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.806777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.806951 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.806846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.806951 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.806889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.806951 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.806940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.807155 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.806974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.807155 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.807008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.908129 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.908081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twxl\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-kube-api-access-4twxl\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.908340 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.908177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.908340 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.908221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.908340 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.908265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.908340 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.908297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.908340 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.908336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.908519 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.908378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.909625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.909595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.911711 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.911684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.911870 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.911831    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.911947 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.911887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.912187 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.912165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.917570 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.917547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.918039 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.918014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twxl\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-kube-api-access-4twxl\") pod \"istiod-openshift-gateway-7b7995d5cd-bljzw\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:40.990363 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:40.990330    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:41.158246 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:41.158185    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"]
Jul 24 17:15:41.159881 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:15:41.159852    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6996e2_b6ae_42c6_9a31_cbcf280c9237.slice/crio-5334dde4ac579ccfd7e3ed603ed2ae410df73e031c9edf44e6c200017dbdc52a WatchSource:0}: Error finding container 5334dde4ac579ccfd7e3ed603ed2ae410df73e031c9edf44e6c200017dbdc52a: Status 404 returned error can't find the container with id 5334dde4ac579ccfd7e3ed603ed2ae410df73e031c9edf44e6c200017dbdc52a
Jul 24 17:15:41.212403 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:41.212360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c-tls-certs\") pod \"model-serving-api-54d89bd5fc-c2hgq\" (UID: \"91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c\") " pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:41.215478 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:41.215450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c-tls-certs\") pod \"model-serving-api-54d89bd5fc-c2hgq\" (UID: \"91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c\") " pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:41.387294 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:41.387255    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:41.577319 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:41.577233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c2hgq"]
Jul 24 17:15:41.581463 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:15:41.581425    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b343fe_a0f0_4bc9_b6e1_d3a11d60bf1c.slice/crio-5ca0bfdec50feb58385c10c917895e2e90a767d94ee501b3b2cddf3f107c9575 WatchSource:0}: Error finding container 5ca0bfdec50feb58385c10c917895e2e90a767d94ee501b3b2cddf3f107c9575: Status 404 returned error can't find the container with id 5ca0bfdec50feb58385c10c917895e2e90a767d94ee501b3b2cddf3f107c9575
Jul 24 17:15:41.619518 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:41.619477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf" event={"ID":"f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057","Type":"ContainerStarted","Data":"ae402edbc02a2f028f1ab28187afb21f8f9b9cbca36f0e3724861f780b6b7160"}
Jul 24 17:15:41.621807 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:41.621760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq" event={"ID":"91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c","Type":"ContainerStarted","Data":"5ca0bfdec50feb58385c10c917895e2e90a767d94ee501b3b2cddf3f107c9575"}
Jul 24 17:15:41.624600 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:41.624570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw" event={"ID":"4b6996e2-b6ae-42c6-9a31-cbcf280c9237","Type":"ContainerStarted","Data":"5334dde4ac579ccfd7e3ed603ed2ae410df73e031c9edf44e6c200017dbdc52a"}
Jul 24 17:15:45.676602 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:45.676570    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:15:45.676928 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:45.676632    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 24 17:15:46.656883 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.656841    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf" event={"ID":"f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057","Type":"ContainerStarted","Data":"3044fce5e4c853f1ab7c098ccfd7764f08719db60eeb063c4697683f57bdb8ec"}
Jul 24 17:15:46.657139 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.657113    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:46.658524 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.658497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7" event={"ID":"f8e30207-dd22-42c4-b3af-ad8980d33d8d","Type":"ContainerStarted","Data":"270f21e902103337af42cbd2d9e285a564500ee26c4fbc4ab1f3c626679376e3"}
Jul 24 17:15:46.660356 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.660325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq" event={"ID":"91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c","Type":"ContainerStarted","Data":"5e5ceca3736df9fb8d04d9b2701cee5620dfc63548ad24948b5cabdc1ba34ee3"}
Jul 24 17:15:46.660512 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.660407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:15:46.662450 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.662419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw" event={"ID":"4b6996e2-b6ae-42c6-9a31-cbcf280c9237","Type":"ContainerStarted","Data":"783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e"}
Jul 24 17:15:46.662676 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.662658    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:46.664563 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.664541    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-bljzw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:15:46.664670 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.664604    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw" podUID="4b6996e2-b6ae-42c6-9a31-cbcf280c9237" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:15:46.674193 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.674142    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf" podStartSLOduration=2.710935954 podStartE2EDuration="7.674126432s" totalImagesPullingTime="4.963190478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:46.673833136 +0000 UTC m=+339.301710989" watchObservedRunningTime="2026-07-24 17:15:46.674126432 +0000 UTC m=+339.302004285"
Jul 24 17:15:46.698733 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.698677    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw" podStartSLOduration=2.184711542 podStartE2EDuration="6.69866203s" totalImagesPullingTime="4.513950488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:46.697774241 +0000 UTC m=+339.325652093" watchObservedRunningTime="2026-07-24 17:15:46.69866203 +0000 UTC m=+339.326539882"
Jul 24 17:15:46.715498 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.715437    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84b496c558-jrfl7" podStartSLOduration=1.895885076 podStartE2EDuration="7.715421235s" totalImagesPullingTime="5.819536159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:46.713600156 +0000 UTC m=+339.341478032" watchObservedRunningTime="2026-07-24 17:15:46.715421235 +0000 UTC m=+339.343299131"
Jul 24 17:15:46.733156 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:46.733089    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq" podStartSLOduration=2.648089009 podStartE2EDuration="6.733074183s" totalImagesPullingTime="4.084985174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:46.733012108 +0000 UTC m=+339.360889974" watchObservedRunningTime="2026-07-24 17:15:46.733074183 +0000 UTC m=+339.360952032"
Jul 24 17:15:47.673409 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:47.673381    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:50.997802 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:50.997756    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"]
Jul 24 17:15:51.001742 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.001711    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:51.002341 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.002317    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"]
Jul 24 17:15:51.005026 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.005007    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 17:15:51.005109 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.005027    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-676mm\""
Jul 24 17:15:51.005443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.005425    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:15:51.008163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.008125    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5gnxh\""
Jul 24 17:15:51.009577 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.008587    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 24 17:15:51.016251 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.016149    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"]
Jul 24 17:15:51.018139 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.018116    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"]
Jul 24 17:15:51.113063 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.113030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdqgz\" (UniqueName: \"kubernetes.io/projected/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-kube-api-access-hdqgz\") pod \"kserve-controller-manager-d6f4b65b8-mfz7b\" (UID: \"06de65a4-a5cc-4367-a21a-859b4ccfcbf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:51.113063 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.113078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-cert\") pod \"kserve-controller-manager-d6f4b65b8-mfz7b\" (UID: \"06de65a4-a5cc-4367-a21a-859b4ccfcbf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:51.113278 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.113119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ec83345-2f15-463b-8e78-0184a8b849f1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pkwn9\" (UID: \"4ec83345-2f15-463b-8e78-0184a8b849f1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:15:51.113278 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.113150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjjh\" (UniqueName: \"kubernetes.io/projected/4ec83345-2f15-463b-8e78-0184a8b849f1-kube-api-access-5hjjh\") pod \"llmisvc-controller-manager-777c6bd7d5-pkwn9\" (UID: \"4ec83345-2f15-463b-8e78-0184a8b849f1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:15:51.214021 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.213974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdqgz\" (UniqueName: \"kubernetes.io/projected/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-kube-api-access-hdqgz\") pod \"kserve-controller-manager-d6f4b65b8-mfz7b\" (UID: \"06de65a4-a5cc-4367-a21a-859b4ccfcbf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:51.214211 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.214049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-cert\") pod \"kserve-controller-manager-d6f4b65b8-mfz7b\" (UID: \"06de65a4-a5cc-4367-a21a-859b4ccfcbf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:51.214211 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.214085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ec83345-2f15-463b-8e78-0184a8b849f1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pkwn9\" (UID: \"4ec83345-2f15-463b-8e78-0184a8b849f1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:15:51.214211 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.214134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjjh\" (UniqueName: \"kubernetes.io/projected/4ec83345-2f15-463b-8e78-0184a8b849f1-kube-api-access-5hjjh\") pod \"llmisvc-controller-manager-777c6bd7d5-pkwn9\" (UID: \"4ec83345-2f15-463b-8e78-0184a8b849f1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:15:51.214211 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:15:51.214194    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 24 17:15:51.214419 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:15:51.214275    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-cert podName:06de65a4-a5cc-4367-a21a-859b4ccfcbf8 nodeName:}" failed. No retries permitted until 2026-07-24 17:15:51.714257604 +0000 UTC m=+344.342135434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-cert") pod "kserve-controller-manager-d6f4b65b8-mfz7b" (UID: "06de65a4-a5cc-4367-a21a-859b4ccfcbf8") : secret "kserve-webhook-server-cert" not found
Jul 24 17:15:51.216724 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.216697    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ec83345-2f15-463b-8e78-0184a8b849f1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pkwn9\" (UID: \"4ec83345-2f15-463b-8e78-0184a8b849f1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:15:51.231894 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.231870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdqgz\" (UniqueName: \"kubernetes.io/projected/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-kube-api-access-hdqgz\") pod \"kserve-controller-manager-d6f4b65b8-mfz7b\" (UID: \"06de65a4-a5cc-4367-a21a-859b4ccfcbf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:51.233399 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.233379    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjjh\" (UniqueName: \"kubernetes.io/projected/4ec83345-2f15-463b-8e78-0184a8b849f1-kube-api-access-5hjjh\") pod \"llmisvc-controller-manager-777c6bd7d5-pkwn9\" (UID: \"4ec83345-2f15-463b-8e78-0184a8b849f1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:15:51.325742 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.325646    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:15:51.466676 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.466618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"]
Jul 24 17:15:51.468948 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:15:51.468926    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4ec83345_2f15_463b_8e78_0184a8b849f1.slice/crio-7234696d7b663120d5ec3b4004330fd0f631a168f4a7029659e4534779d85c81 WatchSource:0}: Error finding container 7234696d7b663120d5ec3b4004330fd0f631a168f4a7029659e4534779d85c81: Status 404 returned error can't find the container with id 7234696d7b663120d5ec3b4004330fd0f631a168f4a7029659e4534779d85c81
Jul 24 17:15:51.693254 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.693222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9" event={"ID":"4ec83345-2f15-463b-8e78-0184a8b849f1","Type":"ContainerStarted","Data":"7234696d7b663120d5ec3b4004330fd0f631a168f4a7029659e4534779d85c81"}
Jul 24 17:15:51.718724 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:51.718693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-cert\") pod \"kserve-controller-manager-d6f4b65b8-mfz7b\" (UID: \"06de65a4-a5cc-4367-a21a-859b4ccfcbf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:51.718891 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:15:51.718870    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 24 17:15:51.718952 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:15:51.718941    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-cert podName:06de65a4-a5cc-4367-a21a-859b4ccfcbf8 nodeName:}" failed. No retries permitted until 2026-07-24 17:15:52.718924319 +0000 UTC m=+345.346802155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-cert") pod "kserve-controller-manager-d6f4b65b8-mfz7b" (UID: "06de65a4-a5cc-4367-a21a-859b4ccfcbf8") : secret "kserve-webhook-server-cert" not found
Jul 24 17:15:52.727228 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:52.727197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-cert\") pod \"kserve-controller-manager-d6f4b65b8-mfz7b\" (UID: \"06de65a4-a5cc-4367-a21a-859b4ccfcbf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:52.729593 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:52.729566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06de65a4-a5cc-4367-a21a-859b4ccfcbf8-cert\") pod \"kserve-controller-manager-d6f4b65b8-mfz7b\" (UID: \"06de65a4-a5cc-4367-a21a-859b4ccfcbf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:52.813613 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:52.813572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:52.965066 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:52.965034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"]
Jul 24 17:15:52.967216 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:15:52.967186    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06de65a4_a5cc_4367_a21a_859b4ccfcbf8.slice/crio-bfc37517d00a0919ed4d1b6b3eca0c6819e5c427ba793623f2ee383f9b4daf68 WatchSource:0}: Error finding container bfc37517d00a0919ed4d1b6b3eca0c6819e5c427ba793623f2ee383f9b4daf68: Status 404 returned error can't find the container with id bfc37517d00a0919ed4d1b6b3eca0c6819e5c427ba793623f2ee383f9b4daf68
Jul 24 17:15:53.707620 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:53.707588    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b" event={"ID":"06de65a4-a5cc-4367-a21a-859b4ccfcbf8","Type":"ContainerStarted","Data":"bfc37517d00a0919ed4d1b6b3eca0c6819e5c427ba793623f2ee383f9b4daf68"}
Jul 24 17:15:53.989833 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:53.989065    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"]
Jul 24 17:15:53.989833 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:53.989266    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw" podUID="4b6996e2-b6ae-42c6-9a31-cbcf280c9237" containerName="discovery" containerID="cri-o://783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e" gracePeriod=30
Jul 24 17:15:54.586000 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.585977    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:54.655094 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.655064    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-cacerts\") pod \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") "
Jul 24 17:15:54.655094 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.655096    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-kubeconfig\") pod \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") "
Jul 24 17:15:54.655307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.655113    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-token\") pod \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") "
Jul 24 17:15:54.655307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.655157    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-ca-configmap\") pod \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") "
Jul 24 17:15:54.655307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.655192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-local-certs\") pod \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") "
Jul 24 17:15:54.655307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.655234    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-dns-cert\") pod \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") "
Jul 24 17:15:54.655307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.655267    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4twxl\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-kube-api-access-4twxl\") pod \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\" (UID: \"4b6996e2-b6ae-42c6-9a31-cbcf280c9237\") "
Jul 24 17:15:54.655692 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.655660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4b6996e2-b6ae-42c6-9a31-cbcf280c9237" (UID: "4b6996e2-b6ae-42c6-9a31-cbcf280c9237"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:15:54.658739 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.658702    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b6996e2-b6ae-42c6-9a31-cbcf280c9237" (UID: "4b6996e2-b6ae-42c6-9a31-cbcf280c9237"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:15:54.658890 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.658759    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4b6996e2-b6ae-42c6-9a31-cbcf280c9237" (UID: "4b6996e2-b6ae-42c6-9a31-cbcf280c9237"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:15:54.658890 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.658760    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-local-certs" (OuterVolumeSpecName: "local-certs") pod "4b6996e2-b6ae-42c6-9a31-cbcf280c9237" (UID: "4b6996e2-b6ae-42c6-9a31-cbcf280c9237"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:15:54.659147 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.659120    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4b6996e2-b6ae-42c6-9a31-cbcf280c9237" (UID: "4b6996e2-b6ae-42c6-9a31-cbcf280c9237"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:15:54.659214 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.659181    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-cacerts" (OuterVolumeSpecName: "cacerts") pod "4b6996e2-b6ae-42c6-9a31-cbcf280c9237" (UID: "4b6996e2-b6ae-42c6-9a31-cbcf280c9237"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:15:54.659214 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.659190    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-kube-api-access-4twxl" (OuterVolumeSpecName: "kube-api-access-4twxl") pod "4b6996e2-b6ae-42c6-9a31-cbcf280c9237" (UID: "4b6996e2-b6ae-42c6-9a31-cbcf280c9237"). InnerVolumeSpecName "kube-api-access-4twxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:15:54.714819 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.714705    2563 generic.go:356] "Generic (PLEG): container finished" podID="4b6996e2-b6ae-42c6-9a31-cbcf280c9237" containerID="783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e" exitCode=0
Jul 24 17:15:54.714819 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.714757    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"
Jul 24 17:15:54.715035 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.714867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw" event={"ID":"4b6996e2-b6ae-42c6-9a31-cbcf280c9237","Type":"ContainerDied","Data":"783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e"}
Jul 24 17:15:54.715035 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.714907    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw" event={"ID":"4b6996e2-b6ae-42c6-9a31-cbcf280c9237","Type":"ContainerDied","Data":"5334dde4ac579ccfd7e3ed603ed2ae410df73e031c9edf44e6c200017dbdc52a"}
Jul 24 17:15:54.715035 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.714926    2563 scope.go:117] "RemoveContainer" containerID="783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e"
Jul 24 17:15:54.717095 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.717066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9" event={"ID":"4ec83345-2f15-463b-8e78-0184a8b849f1","Type":"ContainerStarted","Data":"3a3a7b11e92b1d681631c590c01367af3f1229c6102341bd1cd4e11d4d828b9c"}
Jul 24 17:15:54.717205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.717136    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:15:54.755127 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.755079    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9" podStartSLOduration=1.7591595290000002 podStartE2EDuration="4.755063121s" totalImagesPullingTime="2.995903592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:54.753864815 +0000 UTC m=+347.381742671" watchObservedRunningTime="2026-07-24 17:15:54.755063121 +0000 UTC m=+347.382940973"
Jul 24 17:15:54.756638 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.756615    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-cacerts\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:54.756772 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.756643    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-kubeconfig\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:54.756772 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.756656    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-token\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:54.756772 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.756671    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-ca-configmap\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:54.756772 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.756683    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-local-certs\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:54.756772 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.756696    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-istio-csr-dns-cert\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:54.756772 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.756708    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4twxl\" (UniqueName: \"kubernetes.io/projected/4b6996e2-b6ae-42c6-9a31-cbcf280c9237-kube-api-access-4twxl\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:15:54.767776 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.767745    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"]
Jul 24 17:15:54.772872 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:54.772851    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw"]
Jul 24 17:15:55.139863 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:55.139581    2563 scope.go:117] "RemoveContainer" containerID="783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e"
Jul 24 17:15:55.140146 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:15:55.140032    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e\": container with ID starting with 783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e not found: ID does not exist" containerID="783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e"
Jul 24 17:15:55.140146 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:55.140107    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e"} err="failed to get container status \"783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e\": rpc error: code = NotFound desc = could not find container \"783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e\": container with ID starting with 783d422187adbcc9e4002e1bcd7aec8f8cb11f8c6cf506dc6f7bfcf646db214e not found: ID does not exist"
Jul 24 17:15:55.723454 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:55.723420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b" event={"ID":"06de65a4-a5cc-4367-a21a-859b4ccfcbf8","Type":"ContainerStarted","Data":"f13f615566f9db022c69ffada3808ecf0d039d6e9c3f4fd79aff2ea8683f58ae"}
Jul 24 17:15:55.723681 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:55.723507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:15:55.741090 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:55.741040    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b" podStartSLOduration=3.522333303 podStartE2EDuration="5.741025441s" totalImagesPullingTime="2.218692138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:55.74009403 +0000 UTC m=+348.367971882" watchObservedRunningTime="2026-07-24 17:15:55.741025441 +0000 UTC m=+348.368903293"
Jul 24 17:15:55.942325 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:55.942288    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6996e2-b6ae-42c6-9a31-cbcf280c9237" path="/var/lib/kubelet/pods/4b6996e2-b6ae-42c6-9a31-cbcf280c9237/volumes"
Jul 24 17:15:57.674171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:57.674142    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-p2wjf"
Jul 24 17:15:57.676079 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:15:57.676058    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-c2hgq"
Jul 24 17:16:25.726582 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:25.726547    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pkwn9"
Jul 24 17:16:26.736047 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:26.736013    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mfz7b"
Jul 24 17:16:40.409545 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.409509    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pswpm"]
Jul 24 17:16:40.410005 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.409884    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6996e2-b6ae-42c6-9a31-cbcf280c9237" containerName="discovery"
Jul 24 17:16:40.410005 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.409898    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6996e2-b6ae-42c6-9a31-cbcf280c9237" containerName="discovery"
Jul 24 17:16:40.410081 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.410013    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6996e2-b6ae-42c6-9a31-cbcf280c9237" containerName="discovery"
Jul 24 17:16:40.412150 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.412128    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pswpm"
Jul 24 17:16:40.415060 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.415038    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:16:40.416201 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.416164    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:16:40.416201 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.416180    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6d57b\""
Jul 24 17:16:40.423430 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.423408    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pswpm"]
Jul 24 17:16:40.527432 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.527398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmzqc\" (UniqueName: \"kubernetes.io/projected/a5646b9b-32b3-4fa6-b2a5-aad49ac310b2-kube-api-access-dmzqc\") pod \"kuadrant-operator-catalog-pswpm\" (UID: \"a5646b9b-32b3-4fa6-b2a5-aad49ac310b2\") " pod="kuadrant-system/kuadrant-operator-catalog-pswpm"
Jul 24 17:16:40.628661 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.628620    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmzqc\" (UniqueName: \"kubernetes.io/projected/a5646b9b-32b3-4fa6-b2a5-aad49ac310b2-kube-api-access-dmzqc\") pod \"kuadrant-operator-catalog-pswpm\" (UID: \"a5646b9b-32b3-4fa6-b2a5-aad49ac310b2\") " pod="kuadrant-system/kuadrant-operator-catalog-pswpm"
Jul 24 17:16:40.636961 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.636934    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmzqc\" (UniqueName: \"kubernetes.io/projected/a5646b9b-32b3-4fa6-b2a5-aad49ac310b2-kube-api-access-dmzqc\") pod \"kuadrant-operator-catalog-pswpm\" (UID: \"a5646b9b-32b3-4fa6-b2a5-aad49ac310b2\") " pod="kuadrant-system/kuadrant-operator-catalog-pswpm"
Jul 24 17:16:40.723254 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.723174    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pswpm"
Jul 24 17:16:40.856849 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.856824    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pswpm"]
Jul 24 17:16:40.858984 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:16:40.858953    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5646b9b_32b3_4fa6_b2a5_aad49ac310b2.slice/crio-6f188fcffacd2aacc0a3eca2b30330edd37118e3a0161fe35602aeb4c9997673 WatchSource:0}: Error finding container 6f188fcffacd2aacc0a3eca2b30330edd37118e3a0161fe35602aeb4c9997673: Status 404 returned error can't find the container with id 6f188fcffacd2aacc0a3eca2b30330edd37118e3a0161fe35602aeb4c9997673
Jul 24 17:16:40.933772 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:40.933741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pswpm" event={"ID":"a5646b9b-32b3-4fa6-b2a5-aad49ac310b2","Type":"ContainerStarted","Data":"6f188fcffacd2aacc0a3eca2b30330edd37118e3a0161fe35602aeb4c9997673"}
Jul 24 17:16:41.029224 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.029140    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pswpm"]
Jul 24 17:16:41.047657 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.047630    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9tsks"]
Jul 24 17:16:41.050339 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.050323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9tsks"
Jul 24 17:16:41.058973 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.058951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9tsks"]
Jul 24 17:16:41.132091 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.132052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2679d\" (UniqueName: \"kubernetes.io/projected/78058d46-35e9-4ea3-9fb7-2e1324f6ed83-kube-api-access-2679d\") pod \"kuadrant-operator-catalog-9tsks\" (UID: \"78058d46-35e9-4ea3-9fb7-2e1324f6ed83\") " pod="kuadrant-system/kuadrant-operator-catalog-9tsks"
Jul 24 17:16:41.232658 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.232622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2679d\" (UniqueName: \"kubernetes.io/projected/78058d46-35e9-4ea3-9fb7-2e1324f6ed83-kube-api-access-2679d\") pod \"kuadrant-operator-catalog-9tsks\" (UID: \"78058d46-35e9-4ea3-9fb7-2e1324f6ed83\") " pod="kuadrant-system/kuadrant-operator-catalog-9tsks"
Jul 24 17:16:41.240863 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.240831    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2679d\" (UniqueName: \"kubernetes.io/projected/78058d46-35e9-4ea3-9fb7-2e1324f6ed83-kube-api-access-2679d\") pod \"kuadrant-operator-catalog-9tsks\" (UID: \"78058d46-35e9-4ea3-9fb7-2e1324f6ed83\") " pod="kuadrant-system/kuadrant-operator-catalog-9tsks"
Jul 24 17:16:41.360083 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.360002    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9tsks"
Jul 24 17:16:41.501030 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.501006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9tsks"]
Jul 24 17:16:41.524746 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:16:41.524711    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78058d46_35e9_4ea3_9fb7_2e1324f6ed83.slice/crio-c0a22f6270d2e04367fdc23968c6754afad22b83498162363c96887a48ae620a WatchSource:0}: Error finding container c0a22f6270d2e04367fdc23968c6754afad22b83498162363c96887a48ae620a: Status 404 returned error can't find the container with id c0a22f6270d2e04367fdc23968c6754afad22b83498162363c96887a48ae620a
Jul 24 17:16:41.941324 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:41.941286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9tsks" event={"ID":"78058d46-35e9-4ea3-9fb7-2e1324f6ed83","Type":"ContainerStarted","Data":"c0a22f6270d2e04367fdc23968c6754afad22b83498162363c96887a48ae620a"}
Jul 24 17:16:42.948632 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:42.948599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9tsks" event={"ID":"78058d46-35e9-4ea3-9fb7-2e1324f6ed83","Type":"ContainerStarted","Data":"fbc3417bcb5ca2c1bcc42f5729f9f8f5adaeb3b7abd40ed4caa8fe120d21ee8b"}
Jul 24 17:16:42.950439 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:42.950412    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pswpm" event={"ID":"a5646b9b-32b3-4fa6-b2a5-aad49ac310b2","Type":"ContainerStarted","Data":"93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f"}
Jul 24 17:16:42.950543 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:42.950502    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pswpm" podUID="a5646b9b-32b3-4fa6-b2a5-aad49ac310b2" containerName="registry-server" containerID="cri-o://93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f" gracePeriod=2
Jul 24 17:16:42.964527 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:42.964484    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9tsks" podStartSLOduration=0.622472507 podStartE2EDuration="1.964469368s" totalImagesPullingTime="1.341996861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:16:42.963100564 +0000 UTC m=+395.590978416" watchObservedRunningTime="2026-07-24 17:16:42.964469368 +0000 UTC m=+395.592347220"
Jul 24 17:16:42.979618 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:42.979569    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pswpm" podStartSLOduration=0.972385354 podStartE2EDuration="2.979553644s" totalImagesPullingTime="2.00716829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:16:42.97805749 +0000 UTC m=+395.605935345" watchObservedRunningTime="2026-07-24 17:16:42.979553644 +0000 UTC m=+395.607431537"
Jul 24 17:16:43.192392 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.192370    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pswpm_a5646b9b-32b3-4fa6-b2a5-aad49ac310b2/registry-server/0.log"
Jul 24 17:16:43.194732 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.194716    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pswpm"
Jul 24 17:16:43.352731 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.352695    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmzqc\" (UniqueName: \"kubernetes.io/projected/a5646b9b-32b3-4fa6-b2a5-aad49ac310b2-kube-api-access-dmzqc\") pod \"a5646b9b-32b3-4fa6-b2a5-aad49ac310b2\" (UID: \"a5646b9b-32b3-4fa6-b2a5-aad49ac310b2\") "
Jul 24 17:16:43.355056 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.355024    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5646b9b-32b3-4fa6-b2a5-aad49ac310b2-kube-api-access-dmzqc" (OuterVolumeSpecName: "kube-api-access-dmzqc") pod "a5646b9b-32b3-4fa6-b2a5-aad49ac310b2" (UID: "a5646b9b-32b3-4fa6-b2a5-aad49ac310b2"). InnerVolumeSpecName "kube-api-access-dmzqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:16:43.453357 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.453314    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmzqc\" (UniqueName: \"kubernetes.io/projected/a5646b9b-32b3-4fa6-b2a5-aad49ac310b2-kube-api-access-dmzqc\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:16:43.956201 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.956174    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pswpm_a5646b9b-32b3-4fa6-b2a5-aad49ac310b2/registry-server/0.log"
Jul 24 17:16:43.956601 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.956212    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5646b9b-32b3-4fa6-b2a5-aad49ac310b2" containerID="93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f" exitCode=2
Jul 24 17:16:43.956601 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.956242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pswpm" event={"ID":"a5646b9b-32b3-4fa6-b2a5-aad49ac310b2","Type":"ContainerDied","Data":"93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f"}
Jul 24 17:16:43.956601 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.956270    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pswpm"
Jul 24 17:16:43.956601 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.956294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pswpm" event={"ID":"a5646b9b-32b3-4fa6-b2a5-aad49ac310b2","Type":"ContainerDied","Data":"6f188fcffacd2aacc0a3eca2b30330edd37118e3a0161fe35602aeb4c9997673"}
Jul 24 17:16:43.956601 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.956314    2563 scope.go:117] "RemoveContainer" containerID="93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f"
Jul 24 17:16:43.965045 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.965023    2563 scope.go:117] "RemoveContainer" containerID="93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f"
Jul 24 17:16:43.965314 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:16:43.965295    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f\": container with ID starting with 93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f not found: ID does not exist" containerID="93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f"
Jul 24 17:16:43.965359 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.965323    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f"} err="failed to get container status \"93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f\": rpc error: code = NotFound desc = could not find container \"93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f\": container with ID starting with 93a639d1e6c1ae7a0a1e23d684dd8a8be114e9bcf417024a7bb906756b38516f not found: ID does not exist"
Jul 24 17:16:43.973624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.973600    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pswpm"]
Jul 24 17:16:43.975184 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:43.975167    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pswpm"]
Jul 24 17:16:45.936843 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:45.936785    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5646b9b-32b3-4fa6-b2a5-aad49ac310b2" path="/var/lib/kubelet/pods/a5646b9b-32b3-4fa6-b2a5-aad49ac310b2/volumes"
Jul 24 17:16:51.360327 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:51.360287    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9tsks"
Jul 24 17:16:51.360849 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:51.360359    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9tsks"
Jul 24 17:16:51.381962 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:51.381937    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9tsks"
Jul 24 17:16:52.014451 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:52.014424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9tsks"
Jul 24 17:16:56.019368 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.019334    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"]
Jul 24 17:16:56.019779 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.019660    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5646b9b-32b3-4fa6-b2a5-aad49ac310b2" containerName="registry-server"
Jul 24 17:16:56.019779 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.019672    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5646b9b-32b3-4fa6-b2a5-aad49ac310b2" containerName="registry-server"
Jul 24 17:16:56.019779 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.019726    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5646b9b-32b3-4fa6-b2a5-aad49ac310b2" containerName="registry-server"
Jul 24 17:16:56.024382 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.024362    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.027038 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.027016    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gwqqm\""
Jul 24 17:16:56.031453 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.031105    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"]
Jul 24 17:16:56.163051 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.163012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.163228 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.163067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.163228 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.163170    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmf7b\" (UniqueName: \"kubernetes.io/projected/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-kube-api-access-nmf7b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.264130 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.264083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmf7b\" (UniqueName: \"kubernetes.io/projected/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-kube-api-access-nmf7b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.264307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.264146    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.264307 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.264186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.264536 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.264520    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.264583 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.264565    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.273187 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.273105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmf7b\" (UniqueName: \"kubernetes.io/projected/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-kube-api-access-nmf7b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.334027 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.333993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:16:56.477467 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.477440    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"]
Jul 24 17:16:56.478876 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:16:56.478851    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f2a8fe_7e0b_44d1_91a0_427b309c00ea.slice/crio-59cd8f5689aa08dcfeba57949088c6e1efe49b182a49c7e5f903e7a3b9733085 WatchSource:0}: Error finding container 59cd8f5689aa08dcfeba57949088c6e1efe49b182a49c7e5f903e7a3b9733085: Status 404 returned error can't find the container with id 59cd8f5689aa08dcfeba57949088c6e1efe49b182a49c7e5f903e7a3b9733085
Jul 24 17:16:56.616212 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.616183    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"]
Jul 24 17:16:56.619611 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.619594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.626858 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.626832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"]
Jul 24 17:16:56.768683 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.768642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.768901 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.768692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.768901 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.768719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx8dg\" (UniqueName: \"kubernetes.io/projected/325a1546-70bb-4c0c-b9d7-c57d828efb86-kube-api-access-qx8dg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.869416 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.869315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.869416 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.869387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.869628 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.869425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx8dg\" (UniqueName: \"kubernetes.io/projected/325a1546-70bb-4c0c-b9d7-c57d828efb86-kube-api-access-qx8dg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.869925 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.869906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.869982 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.869927    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.878622 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.878595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx8dg\" (UniqueName: \"kubernetes.io/projected/325a1546-70bb-4c0c-b9d7-c57d828efb86-kube-api-access-qx8dg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:56.961351 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:56.961316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:16:57.021361 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.021327    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerID="6023d6c0710b82c925702d6ff4a8cde34cc9801f245fd3668ee2582d9dfcfee9" exitCode=0
Jul 24 17:16:57.021702 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.021399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px" event={"ID":"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea","Type":"ContainerDied","Data":"6023d6c0710b82c925702d6ff4a8cde34cc9801f245fd3668ee2582d9dfcfee9"}
Jul 24 17:16:57.021702 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.021450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px" event={"ID":"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea","Type":"ContainerStarted","Data":"59cd8f5689aa08dcfeba57949088c6e1efe49b182a49c7e5f903e7a3b9733085"}
Jul 24 17:16:57.096988 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.096965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"]
Jul 24 17:16:57.098688 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:16:57.098664    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325a1546_70bb_4c0c_b9d7_c57d828efb86.slice/crio-27ef2dd6c3da7f81acbcc850345b99f94568d9e83f824fca6741c4713708205a WatchSource:0}: Error finding container 27ef2dd6c3da7f81acbcc850345b99f94568d9e83f824fca6741c4713708205a: Status 404 returned error can't find the container with id 27ef2dd6c3da7f81acbcc850345b99f94568d9e83f824fca6741c4713708205a
Jul 24 17:16:57.224951 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.224917    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"]
Jul 24 17:16:57.228351 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.228331    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.235596 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.235575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"]
Jul 24 17:16:57.373308 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.373274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.373308 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.373309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k99r9\" (UniqueName: \"kubernetes.io/projected/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-kube-api-access-k99r9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.373526 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.373339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.474726 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.474684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.474924 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.474828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.474924 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.474861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k99r9\" (UniqueName: \"kubernetes.io/projected/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-kube-api-access-k99r9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.475201 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.475179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.475252 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.475204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.482931 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.482903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k99r9\" (UniqueName: \"kubernetes.io/projected/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-kube-api-access-k99r9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.568980 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.568951    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:16:57.625299 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.625271    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"]
Jul 24 17:16:57.628905 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.628886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.636398 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.636365    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"]
Jul 24 17:16:57.750456 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.750429    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"]
Jul 24 17:16:57.752145 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:16:57.752117    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d1038b_2c7e_4f03_9a5f_b6a8e309a945.slice/crio-3e8ead9020eefc6cbd8b69c1ce63053b06ed118254ba7bdd37ede6fec90bc33c WatchSource:0}: Error finding container 3e8ead9020eefc6cbd8b69c1ce63053b06ed118254ba7bdd37ede6fec90bc33c: Status 404 returned error can't find the container with id 3e8ead9020eefc6cbd8b69c1ce63053b06ed118254ba7bdd37ede6fec90bc33c
Jul 24 17:16:57.777293 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.777267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.777403 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.777314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.777462 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.777443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb49w\" (UniqueName: \"kubernetes.io/projected/8376950c-5e5a-425d-ba3e-574e65b08242-kube-api-access-lb49w\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.878385 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.878343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb49w\" (UniqueName: \"kubernetes.io/projected/8376950c-5e5a-425d-ba3e-574e65b08242-kube-api-access-lb49w\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.878564 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.878442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.878564 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.878492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.878890 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.878870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.878936 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.878898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.886847 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.886821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb49w\" (UniqueName: \"kubernetes.io/projected/8376950c-5e5a-425d-ba3e-574e65b08242-kube-api-access-lb49w\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:57.942232 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:57.942202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:16:58.030602 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:58.029878    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerID="70d0431338e5d2a2976be95e6e0eaa6b9c3eb8fadd7a79f9a855cc73d9f7d489" exitCode=0
Jul 24 17:16:58.030602 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:58.030063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px" event={"ID":"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea","Type":"ContainerDied","Data":"70d0431338e5d2a2976be95e6e0eaa6b9c3eb8fadd7a79f9a855cc73d9f7d489"}
Jul 24 17:16:58.032516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:58.032494    2563 generic.go:356] "Generic (PLEG): container finished" podID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerID="5dee2c3bfc0849fcee4740caef86e4ed1bd308e07bea42d8b29205e2228e3c0e" exitCode=0
Jul 24 17:16:58.032631 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:58.032574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh" event={"ID":"84d1038b-2c7e-4f03-9a5f-b6a8e309a945","Type":"ContainerDied","Data":"5dee2c3bfc0849fcee4740caef86e4ed1bd308e07bea42d8b29205e2228e3c0e"}
Jul 24 17:16:58.032631 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:58.032616    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh" event={"ID":"84d1038b-2c7e-4f03-9a5f-b6a8e309a945","Type":"ContainerStarted","Data":"3e8ead9020eefc6cbd8b69c1ce63053b06ed118254ba7bdd37ede6fec90bc33c"}
Jul 24 17:16:58.044369 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:58.044339    2563 generic.go:356] "Generic (PLEG): container finished" podID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerID="e1bc342266b17db55586626baea00dcf39605f5d18d23ecf05b26010ccecc688" exitCode=0
Jul 24 17:16:58.044465 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:58.044395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8" event={"ID":"325a1546-70bb-4c0c-b9d7-c57d828efb86","Type":"ContainerDied","Data":"e1bc342266b17db55586626baea00dcf39605f5d18d23ecf05b26010ccecc688"}
Jul 24 17:16:58.044525 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:58.044468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8" event={"ID":"325a1546-70bb-4c0c-b9d7-c57d828efb86","Type":"ContainerStarted","Data":"27ef2dd6c3da7f81acbcc850345b99f94568d9e83f824fca6741c4713708205a"}
Jul 24 17:16:58.087380 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:58.087353    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"]
Jul 24 17:16:58.088916 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:16:58.088895    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8376950c_5e5a_425d_ba3e_574e65b08242.slice/crio-cbc552640242a8440976db09636b72807de8543420af291a87b441de157ed3d0 WatchSource:0}: Error finding container cbc552640242a8440976db09636b72807de8543420af291a87b441de157ed3d0: Status 404 returned error can't find the container with id cbc552640242a8440976db09636b72807de8543420af291a87b441de157ed3d0
Jul 24 17:16:59.051579 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:59.051552    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerID="e9c98ea3bb61bc9a0164b3160b9fc3c682dab6975bc2ac45f97219ab96247afe" exitCode=0
Jul 24 17:16:59.051944 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:59.051634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px" event={"ID":"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea","Type":"ContainerDied","Data":"e9c98ea3bb61bc9a0164b3160b9fc3c682dab6975bc2ac45f97219ab96247afe"}
Jul 24 17:16:59.053023 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:59.053005    2563 generic.go:356] "Generic (PLEG): container finished" podID="8376950c-5e5a-425d-ba3e-574e65b08242" containerID="e0e10ad6d691d74c3e9bd84809a34bdccb6a3cbe72ac304cc88f4d4066e5fd37" exitCode=0
Jul 24 17:16:59.053099 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:59.053078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh" event={"ID":"8376950c-5e5a-425d-ba3e-574e65b08242","Type":"ContainerDied","Data":"e0e10ad6d691d74c3e9bd84809a34bdccb6a3cbe72ac304cc88f4d4066e5fd37"}
Jul 24 17:16:59.053146 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:59.053117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh" event={"ID":"8376950c-5e5a-425d-ba3e-574e65b08242","Type":"ContainerStarted","Data":"cbc552640242a8440976db09636b72807de8543420af291a87b441de157ed3d0"}
Jul 24 17:16:59.054901 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:59.054881    2563 generic.go:356] "Generic (PLEG): container finished" podID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerID="252d388c1bc1f6dff177b9a4a002f0fb21209d2de15c89f72f381f3d9d8f7f66" exitCode=0
Jul 24 17:16:59.055001 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:16:59.054909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8" event={"ID":"325a1546-70bb-4c0c-b9d7-c57d828efb86","Type":"ContainerDied","Data":"252d388c1bc1f6dff177b9a4a002f0fb21209d2de15c89f72f381f3d9d8f7f66"}
Jul 24 17:17:00.062130 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.062039    2563 generic.go:356] "Generic (PLEG): container finished" podID="8376950c-5e5a-425d-ba3e-574e65b08242" containerID="56798707e396acb3bab315323413ce7464ea8abc72a78b84d18cd41d2bfa5db0" exitCode=0
Jul 24 17:17:00.062616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.062144    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh" event={"ID":"8376950c-5e5a-425d-ba3e-574e65b08242","Type":"ContainerDied","Data":"56798707e396acb3bab315323413ce7464ea8abc72a78b84d18cd41d2bfa5db0"}
Jul 24 17:17:00.064178 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.064153    2563 generic.go:356] "Generic (PLEG): container finished" podID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerID="4882d8de77e00b80efa6e1113e937fb25a741ea615eecc46902ca4477eb1bc2c" exitCode=0
Jul 24 17:17:00.064270 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.064233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh" event={"ID":"84d1038b-2c7e-4f03-9a5f-b6a8e309a945","Type":"ContainerDied","Data":"4882d8de77e00b80efa6e1113e937fb25a741ea615eecc46902ca4477eb1bc2c"}
Jul 24 17:17:00.066552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.066531    2563 generic.go:356] "Generic (PLEG): container finished" podID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerID="73ae43ea7c37246798d8efa12961833a08705d7a72d372eaf9353dc64fe7af4e" exitCode=0
Jul 24 17:17:00.066628 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.066606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8" event={"ID":"325a1546-70bb-4c0c-b9d7-c57d828efb86","Type":"ContainerDied","Data":"73ae43ea7c37246798d8efa12961833a08705d7a72d372eaf9353dc64fe7af4e"}
Jul 24 17:17:00.203508 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.203482    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:17:00.296881 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.296852    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-util\") pod \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") "
Jul 24 17:17:00.296881 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.296885    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-bundle\") pod \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") "
Jul 24 17:17:00.297125 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.296923    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmf7b\" (UniqueName: \"kubernetes.io/projected/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-kube-api-access-nmf7b\") pod \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\" (UID: \"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea\") "
Jul 24 17:17:00.297482 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.297459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-bundle" (OuterVolumeSpecName: "bundle") pod "a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" (UID: "a5f2a8fe-7e0b-44d1-91a0-427b309c00ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:00.299227 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.299201    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-kube-api-access-nmf7b" (OuterVolumeSpecName: "kube-api-access-nmf7b") pod "a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" (UID: "a5f2a8fe-7e0b-44d1-91a0-427b309c00ea"). InnerVolumeSpecName "kube-api-access-nmf7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:00.304877 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.304849    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-util" (OuterVolumeSpecName: "util") pod "a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" (UID: "a5f2a8fe-7e0b-44d1-91a0-427b309c00ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:00.397930 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.397839    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:00.397930 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.397871    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:00.397930 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:00.397881    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmf7b\" (UniqueName: \"kubernetes.io/projected/a5f2a8fe-7e0b-44d1-91a0-427b309c00ea-kube-api-access-nmf7b\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:01.074882 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.074839    2563 generic.go:356] "Generic (PLEG): container finished" podID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerID="e5b9a1a0f6d60cb2bed196776fcae20d8a678812ad611fb9e73ccfb11d0b6d38" exitCode=0
Jul 24 17:17:01.075292 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.074930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh" event={"ID":"84d1038b-2c7e-4f03-9a5f-b6a8e309a945","Type":"ContainerDied","Data":"e5b9a1a0f6d60cb2bed196776fcae20d8a678812ad611fb9e73ccfb11d0b6d38"}
Jul 24 17:17:01.076708 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.076682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px" event={"ID":"a5f2a8fe-7e0b-44d1-91a0-427b309c00ea","Type":"ContainerDied","Data":"59cd8f5689aa08dcfeba57949088c6e1efe49b182a49c7e5f903e7a3b9733085"}
Jul 24 17:17:01.076814 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.076743    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59cd8f5689aa08dcfeba57949088c6e1efe49b182a49c7e5f903e7a3b9733085"
Jul 24 17:17:01.076814 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.076692    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px"
Jul 24 17:17:01.078749 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.078728    2563 generic.go:356] "Generic (PLEG): container finished" podID="8376950c-5e5a-425d-ba3e-574e65b08242" containerID="63104539bf4f5c48c50dd18d7639bb924809cc285b52d49de502329a1b50341b" exitCode=0
Jul 24 17:17:01.078870 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.078817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh" event={"ID":"8376950c-5e5a-425d-ba3e-574e65b08242","Type":"ContainerDied","Data":"63104539bf4f5c48c50dd18d7639bb924809cc285b52d49de502329a1b50341b"}
Jul 24 17:17:01.216446 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.216418    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:17:01.311935 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.311886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx8dg\" (UniqueName: \"kubernetes.io/projected/325a1546-70bb-4c0c-b9d7-c57d828efb86-kube-api-access-qx8dg\") pod \"325a1546-70bb-4c0c-b9d7-c57d828efb86\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") "
Jul 24 17:17:01.312153 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.312015    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-util\") pod \"325a1546-70bb-4c0c-b9d7-c57d828efb86\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") "
Jul 24 17:17:01.312153 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.312057    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-bundle\") pod \"325a1546-70bb-4c0c-b9d7-c57d828efb86\" (UID: \"325a1546-70bb-4c0c-b9d7-c57d828efb86\") "
Jul 24 17:17:01.312613 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.312588    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-bundle" (OuterVolumeSpecName: "bundle") pod "325a1546-70bb-4c0c-b9d7-c57d828efb86" (UID: "325a1546-70bb-4c0c-b9d7-c57d828efb86"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:01.314225 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.314194    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/325a1546-70bb-4c0c-b9d7-c57d828efb86-kube-api-access-qx8dg" (OuterVolumeSpecName: "kube-api-access-qx8dg") pod "325a1546-70bb-4c0c-b9d7-c57d828efb86" (UID: "325a1546-70bb-4c0c-b9d7-c57d828efb86"). InnerVolumeSpecName "kube-api-access-qx8dg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:01.317288 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.317263    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-util" (OuterVolumeSpecName: "util") pod "325a1546-70bb-4c0c-b9d7-c57d828efb86" (UID: "325a1546-70bb-4c0c-b9d7-c57d828efb86"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:01.412832 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.412771    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:01.412832 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.412833    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325a1546-70bb-4c0c-b9d7-c57d828efb86-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:01.413040 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:01.412846    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx8dg\" (UniqueName: \"kubernetes.io/projected/325a1546-70bb-4c0c-b9d7-c57d828efb86-kube-api-access-qx8dg\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:02.086907 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.086875    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8"
Jul 24 17:17:02.086907 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.086886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8" event={"ID":"325a1546-70bb-4c0c-b9d7-c57d828efb86","Type":"ContainerDied","Data":"27ef2dd6c3da7f81acbcc850345b99f94568d9e83f824fca6741c4713708205a"}
Jul 24 17:17:02.087414 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.086937    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27ef2dd6c3da7f81acbcc850345b99f94568d9e83f824fca6741c4713708205a"
Jul 24 17:17:02.231986 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.231951    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:17:02.264360 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.264326    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:17:02.320424 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.320391    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-util\") pod \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") "
Jul 24 17:17:02.320636 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.320437    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-bundle\") pod \"8376950c-5e5a-425d-ba3e-574e65b08242\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") "
Jul 24 17:17:02.320636 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.320477    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-bundle\") pod \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") "
Jul 24 17:17:02.320636 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.320498    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k99r9\" (UniqueName: \"kubernetes.io/projected/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-kube-api-access-k99r9\") pod \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\" (UID: \"84d1038b-2c7e-4f03-9a5f-b6a8e309a945\") "
Jul 24 17:17:02.320636 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.320515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb49w\" (UniqueName: \"kubernetes.io/projected/8376950c-5e5a-425d-ba3e-574e65b08242-kube-api-access-lb49w\") pod \"8376950c-5e5a-425d-ba3e-574e65b08242\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") "
Jul 24 17:17:02.320636 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.320627    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-util\") pod \"8376950c-5e5a-425d-ba3e-574e65b08242\" (UID: \"8376950c-5e5a-425d-ba3e-574e65b08242\") "
Jul 24 17:17:02.321116 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.321089    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-bundle" (OuterVolumeSpecName: "bundle") pod "84d1038b-2c7e-4f03-9a5f-b6a8e309a945" (UID: "84d1038b-2c7e-4f03-9a5f-b6a8e309a945"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:02.321237 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.321135    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-bundle" (OuterVolumeSpecName: "bundle") pod "8376950c-5e5a-425d-ba3e-574e65b08242" (UID: "8376950c-5e5a-425d-ba3e-574e65b08242"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:02.323068 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.323042    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8376950c-5e5a-425d-ba3e-574e65b08242-kube-api-access-lb49w" (OuterVolumeSpecName: "kube-api-access-lb49w") pod "8376950c-5e5a-425d-ba3e-574e65b08242" (UID: "8376950c-5e5a-425d-ba3e-574e65b08242"). InnerVolumeSpecName "kube-api-access-lb49w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:02.323358 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.323337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-kube-api-access-k99r9" (OuterVolumeSpecName: "kube-api-access-k99r9") pod "84d1038b-2c7e-4f03-9a5f-b6a8e309a945" (UID: "84d1038b-2c7e-4f03-9a5f-b6a8e309a945"). InnerVolumeSpecName "kube-api-access-k99r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:02.326650 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.326627    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-util" (OuterVolumeSpecName: "util") pod "84d1038b-2c7e-4f03-9a5f-b6a8e309a945" (UID: "84d1038b-2c7e-4f03-9a5f-b6a8e309a945"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:02.327726 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.327705    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-util" (OuterVolumeSpecName: "util") pod "8376950c-5e5a-425d-ba3e-574e65b08242" (UID: "8376950c-5e5a-425d-ba3e-574e65b08242"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:02.422026 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.421974    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:02.422026 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.422022    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:02.422026 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.422032    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8376950c-5e5a-425d-ba3e-574e65b08242-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:02.422026 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.422041    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:02.422302 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.422050    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k99r9\" (UniqueName: \"kubernetes.io/projected/84d1038b-2c7e-4f03-9a5f-b6a8e309a945-kube-api-access-k99r9\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:02.422302 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:02.422063    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb49w\" (UniqueName: \"kubernetes.io/projected/8376950c-5e5a-425d-ba3e-574e65b08242-kube-api-access-lb49w\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:03.094615 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:03.094578    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh"
Jul 24 17:17:03.094615 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:03.094607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh" event={"ID":"8376950c-5e5a-425d-ba3e-574e65b08242","Type":"ContainerDied","Data":"cbc552640242a8440976db09636b72807de8543420af291a87b441de157ed3d0"}
Jul 24 17:17:03.095138 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:03.094655    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbc552640242a8440976db09636b72807de8543420af291a87b441de157ed3d0"
Jul 24 17:17:03.096755 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:03.096722    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh" event={"ID":"84d1038b-2c7e-4f03-9a5f-b6a8e309a945","Type":"ContainerDied","Data":"3e8ead9020eefc6cbd8b69c1ce63053b06ed118254ba7bdd37ede6fec90bc33c"}
Jul 24 17:17:03.096755 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:03.096733    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh"
Jul 24 17:17:03.096934 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:03.096765    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e8ead9020eefc6cbd8b69c1ce63053b06ed118254ba7bdd37ede6fec90bc33c"
Jul 24 17:17:12.013375 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013327    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6f9c667d-gf62b"]
Jul 24 17:17:12.013900 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013850    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerName="pull"
Jul 24 17:17:12.013900 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013873    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerName="pull"
Jul 24 17:17:12.013900 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013891    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8376950c-5e5a-425d-ba3e-574e65b08242" containerName="pull"
Jul 24 17:17:12.013900 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013902    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8376950c-5e5a-425d-ba3e-574e65b08242" containerName="pull"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013916    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerName="util"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013924    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerName="util"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013934    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerName="util"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013941    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerName="util"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013954    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerName="extract"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013962    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerName="extract"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013974    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerName="util"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013982    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerName="util"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.013992    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerName="extract"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014000    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerName="extract"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014016    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerName="pull"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014024    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerName="pull"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014037    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerName="extract"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014045    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerName="extract"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014058    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8376950c-5e5a-425d-ba3e-574e65b08242" containerName="extract"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014066    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8376950c-5e5a-425d-ba3e-574e65b08242" containerName="extract"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014080    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8376950c-5e5a-425d-ba3e-574e65b08242" containerName="util"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014087    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8376950c-5e5a-425d-ba3e-574e65b08242" containerName="util"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014095    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerName="pull"
Jul 24 17:17:12.014164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014103    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerName="pull"
Jul 24 17:17:12.014910 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014190    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5f2a8fe-7e0b-44d1-91a0-427b309c00ea" containerName="extract"
Jul 24 17:17:12.014910 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014203    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="325a1546-70bb-4c0c-b9d7-c57d828efb86" containerName="extract"
Jul 24 17:17:12.014910 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014217    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8376950c-5e5a-425d-ba3e-574e65b08242" containerName="extract"
Jul 24 17:17:12.014910 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.014226    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="84d1038b-2c7e-4f03-9a5f-b6a8e309a945" containerName="extract"
Jul 24 17:17:12.018964 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.018939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.032924 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.032892    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6f9c667d-gf62b"]
Jul 24 17:17:12.108233 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.108192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/567ea201-9137-4347-8b86-196c2e5037b2-console-oauth-config\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.108440 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.108246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5nzr\" (UniqueName: \"kubernetes.io/projected/567ea201-9137-4347-8b86-196c2e5037b2-kube-api-access-q5nzr\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.108440 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.108268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-trusted-ca-bundle\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.108440 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.108290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-service-ca\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.108440 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.108335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/567ea201-9137-4347-8b86-196c2e5037b2-console-serving-cert\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.108440 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.108366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-console-config\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.108632 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.108442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-oauth-serving-cert\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.209857 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.209822    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/567ea201-9137-4347-8b86-196c2e5037b2-console-serving-cert\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.210044 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.209880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-console-config\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.210044 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.209927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-oauth-serving-cert\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.210044 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.209957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/567ea201-9137-4347-8b86-196c2e5037b2-console-oauth-config\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.210211 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.210107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5nzr\" (UniqueName: \"kubernetes.io/projected/567ea201-9137-4347-8b86-196c2e5037b2-kube-api-access-q5nzr\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.210211 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.210159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-trusted-ca-bundle\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.210211 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.210184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-service-ca\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.210854 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.210828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-console-config\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.210959 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.210904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-service-ca\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.210959 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.210932    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-oauth-serving-cert\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.211085 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.211009    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/567ea201-9137-4347-8b86-196c2e5037b2-trusted-ca-bundle\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.212514 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.212493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/567ea201-9137-4347-8b86-196c2e5037b2-console-serving-cert\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.212609 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.212562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/567ea201-9137-4347-8b86-196c2e5037b2-console-oauth-config\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.221903 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.221874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5nzr\" (UniqueName: \"kubernetes.io/projected/567ea201-9137-4347-8b86-196c2e5037b2-kube-api-access-q5nzr\") pod \"console-6b6f9c667d-gf62b\" (UID: \"567ea201-9137-4347-8b86-196c2e5037b2\") " pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.281923 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.281841    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"]
Jul 24 17:17:12.286352 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.286335    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"
Jul 24 17:17:12.289086 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.289064    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 24 17:17:12.289218 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.289135    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mztsj\""
Jul 24 17:17:12.297810 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.297768    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"]
Jul 24 17:17:12.329256 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.329223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:12.411785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.411753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjkv6\" (UniqueName: \"kubernetes.io/projected/d00bea80-48c1-4b45-9e7f-549024f29c20-kube-api-access-qjkv6\") pod \"dns-operator-controller-manager-864dd78c4c-6fn4s\" (UID: \"d00bea80-48c1-4b45-9e7f-549024f29c20\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"
Jul 24 17:17:12.474693 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.474663    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6f9c667d-gf62b"]
Jul 24 17:17:12.476128 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:17:12.476107    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567ea201_9137_4347_8b86_196c2e5037b2.slice/crio-1126285e0fbfeb0b7732e0ca2765f017991beb4e272a093ed74e42b9fd8da2bf WatchSource:0}: Error finding container 1126285e0fbfeb0b7732e0ca2765f017991beb4e272a093ed74e42b9fd8da2bf: Status 404 returned error can't find the container with id 1126285e0fbfeb0b7732e0ca2765f017991beb4e272a093ed74e42b9fd8da2bf
Jul 24 17:17:12.513146 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.513114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjkv6\" (UniqueName: \"kubernetes.io/projected/d00bea80-48c1-4b45-9e7f-549024f29c20-kube-api-access-qjkv6\") pod \"dns-operator-controller-manager-864dd78c4c-6fn4s\" (UID: \"d00bea80-48c1-4b45-9e7f-549024f29c20\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"
Jul 24 17:17:12.525397 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.525375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjkv6\" (UniqueName: \"kubernetes.io/projected/d00bea80-48c1-4b45-9e7f-549024f29c20-kube-api-access-qjkv6\") pod \"dns-operator-controller-manager-864dd78c4c-6fn4s\" (UID: \"d00bea80-48c1-4b45-9e7f-549024f29c20\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"
Jul 24 17:17:12.598131 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.598089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"
Jul 24 17:17:12.743466 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:12.743374    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"]
Jul 24 17:17:12.745526 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:17:12.745500    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00bea80_48c1_4b45_9e7f_549024f29c20.slice/crio-95ed28678f84f04f03b242e0a504e7fd35cf1939cb61f690389a5acff338a940 WatchSource:0}: Error finding container 95ed28678f84f04f03b242e0a504e7fd35cf1939cb61f690389a5acff338a940: Status 404 returned error can't find the container with id 95ed28678f84f04f03b242e0a504e7fd35cf1939cb61f690389a5acff338a940
Jul 24 17:17:13.156165 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:13.156125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s" event={"ID":"d00bea80-48c1-4b45-9e7f-549024f29c20","Type":"ContainerStarted","Data":"95ed28678f84f04f03b242e0a504e7fd35cf1939cb61f690389a5acff338a940"}
Jul 24 17:17:13.157707 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:13.157681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6f9c667d-gf62b" event={"ID":"567ea201-9137-4347-8b86-196c2e5037b2","Type":"ContainerStarted","Data":"579197c922bb70c2bc375c740a90317d96ca790403bd36e31387b769aeb91b74"}
Jul 24 17:17:13.157866 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:13.157729    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6f9c667d-gf62b" event={"ID":"567ea201-9137-4347-8b86-196c2e5037b2","Type":"ContainerStarted","Data":"1126285e0fbfeb0b7732e0ca2765f017991beb4e272a093ed74e42b9fd8da2bf"}
Jul 24 17:17:13.179119 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:13.179063    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b6f9c667d-gf62b" podStartSLOduration=2.179044705 podStartE2EDuration="2.179044705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:13.178011728 +0000 UTC m=+425.805889591" watchObservedRunningTime="2026-07-24 17:17:13.179044705 +0000 UTC m=+425.806922556"
Jul 24 17:17:15.170268 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.170231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s" event={"ID":"d00bea80-48c1-4b45-9e7f-549024f29c20","Type":"ContainerStarted","Data":"eae38463d6107959b26125e5bb53ab203546167a25fbb604cd0e1e57611e2042"}
Jul 24 17:17:15.170730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.170328    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"
Jul 24 17:17:15.187697 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.187646    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s" podStartSLOduration=1.128191184 podStartE2EDuration="3.18763118s" totalImagesPullingTime="2.059439996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:15.185559335 +0000 UTC m=+427.813437187" watchObservedRunningTime="2026-07-24 17:17:15.18763118 +0000 UTC m=+427.815509031"
Jul 24 17:17:15.746325 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.746292    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"]
Jul 24 17:17:15.748694 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.748674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:15.751414 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.751390    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tg7bv\""
Jul 24 17:17:15.759304 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.759278    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"]
Jul 24 17:17:15.844559 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.844523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2d7z\" (UniqueName: \"kubernetes.io/projected/7ace9bc4-96d6-4da6-ba21-1f6471676583-kube-api-access-f2d7z\") pod \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" (UID: \"7ace9bc4-96d6-4da6-ba21-1f6471676583\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:15.945446 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.945404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2d7z\" (UniqueName: \"kubernetes.io/projected/7ace9bc4-96d6-4da6-ba21-1f6471676583-kube-api-access-f2d7z\") pod \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" (UID: \"7ace9bc4-96d6-4da6-ba21-1f6471676583\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:15.953503 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:15.953475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2d7z\" (UniqueName: \"kubernetes.io/projected/7ace9bc4-96d6-4da6-ba21-1f6471676583-kube-api-access-f2d7z\") pod \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" (UID: \"7ace9bc4-96d6-4da6-ba21-1f6471676583\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:16.059250 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:16.059162    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:16.191668 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:16.191643    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"]
Jul 24 17:17:16.194402 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:17:16.194373    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ace9bc4_96d6_4da6_ba21_1f6471676583.slice/crio-8ce1d385046929520ea0feff55b1ef0a9d5056ebe8aa1db5358755e02dbffa34 WatchSource:0}: Error finding container 8ce1d385046929520ea0feff55b1ef0a9d5056ebe8aa1db5358755e02dbffa34: Status 404 returned error can't find the container with id 8ce1d385046929520ea0feff55b1ef0a9d5056ebe8aa1db5358755e02dbffa34
Jul 24 17:17:17.184987 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:17.184950    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk" event={"ID":"7ace9bc4-96d6-4da6-ba21-1f6471676583","Type":"ContainerStarted","Data":"8ce1d385046929520ea0feff55b1ef0a9d5056ebe8aa1db5358755e02dbffa34"}
Jul 24 17:17:18.191142 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:18.191099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk" event={"ID":"7ace9bc4-96d6-4da6-ba21-1f6471676583","Type":"ContainerStarted","Data":"9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288"}
Jul 24 17:17:18.191539 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:18.191245    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:18.208633 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:18.208579    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk" podStartSLOduration=1.790056645 podStartE2EDuration="3.20856141s" totalImagesPullingTime="1.418504765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:18.207044997 +0000 UTC m=+430.834922846" watchObservedRunningTime="2026-07-24 17:17:18.20856141 +0000 UTC m=+430.836439262"
Jul 24 17:17:20.655205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.655167    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"]
Jul 24 17:17:20.657708 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.657688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:20.662191 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.662171    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7l84j\""
Jul 24 17:17:20.671272 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.671249    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"]
Jul 24 17:17:20.788125 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.788082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p7wl\" (UniqueName: \"kubernetes.io/projected/14c5390d-5b34-4ae0-8415-405fe5a8f439-kube-api-access-4p7wl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" (UID: \"14c5390d-5b34-4ae0-8415-405fe5a8f439\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:20.788270 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.788145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c5390d-5b34-4ae0-8415-405fe5a8f439-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" (UID: \"14c5390d-5b34-4ae0-8415-405fe5a8f439\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:20.889288 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.889244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p7wl\" (UniqueName: \"kubernetes.io/projected/14c5390d-5b34-4ae0-8415-405fe5a8f439-kube-api-access-4p7wl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" (UID: \"14c5390d-5b34-4ae0-8415-405fe5a8f439\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:20.889288 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.889292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c5390d-5b34-4ae0-8415-405fe5a8f439-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" (UID: \"14c5390d-5b34-4ae0-8415-405fe5a8f439\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:20.889645 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.889628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c5390d-5b34-4ae0-8415-405fe5a8f439-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" (UID: \"14c5390d-5b34-4ae0-8415-405fe5a8f439\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:20.901245 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.901216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p7wl\" (UniqueName: \"kubernetes.io/projected/14c5390d-5b34-4ae0-8415-405fe5a8f439-kube-api-access-4p7wl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" (UID: \"14c5390d-5b34-4ae0-8415-405fe5a8f439\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:20.968550 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:20.968521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:21.108670 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:21.108641    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"]
Jul 24 17:17:21.110628 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:17:21.110593    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c5390d_5b34_4ae0_8415_405fe5a8f439.slice/crio-dafe15676c748836a923a90dfd96c049493825b89d9475599908d8bdcf44e317 WatchSource:0}: Error finding container dafe15676c748836a923a90dfd96c049493825b89d9475599908d8bdcf44e317: Status 404 returned error can't find the container with id dafe15676c748836a923a90dfd96c049493825b89d9475599908d8bdcf44e317
Jul 24 17:17:21.208921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:21.208884    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd" event={"ID":"14c5390d-5b34-4ae0-8415-405fe5a8f439","Type":"ContainerStarted","Data":"dafe15676c748836a923a90dfd96c049493825b89d9475599908d8bdcf44e317"}
Jul 24 17:17:22.330301 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:22.330240    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:22.330735 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:22.330317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:22.336492 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:22.336470    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:23.227444 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:23.227413    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b6f9c667d-gf62b"
Jul 24 17:17:23.280071 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:23.280035    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc985bbb9-hj7w7"]
Jul 24 17:17:23.994031 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:23.994002    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"]
Jul 24 17:17:23.996588 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:23.996567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"
Jul 24 17:17:23.999392 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:23.999374    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wvl5c\""
Jul 24 17:17:24.008541 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:24.008519    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"]
Jul 24 17:17:24.115207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:24.115171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8986\" (UniqueName: \"kubernetes.io/projected/ccf99a8a-a00a-4426-a4fd-300151aa70b5-kube-api-access-h8986\") pod \"authorino-operator-75cc8d5cb7-g7b7q\" (UID: \"ccf99a8a-a00a-4426-a4fd-300151aa70b5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"
Jul 24 17:17:24.216735 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:24.216701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8986\" (UniqueName: \"kubernetes.io/projected/ccf99a8a-a00a-4426-a4fd-300151aa70b5-kube-api-access-h8986\") pod \"authorino-operator-75cc8d5cb7-g7b7q\" (UID: \"ccf99a8a-a00a-4426-a4fd-300151aa70b5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"
Jul 24 17:17:24.236642 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:24.236609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8986\" (UniqueName: \"kubernetes.io/projected/ccf99a8a-a00a-4426-a4fd-300151aa70b5-kube-api-access-h8986\") pod \"authorino-operator-75cc8d5cb7-g7b7q\" (UID: \"ccf99a8a-a00a-4426-a4fd-300151aa70b5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"
Jul 24 17:17:24.307867 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:24.307759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"
Jul 24 17:17:24.446935 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:24.446909    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"]
Jul 24 17:17:24.449280 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:17:24.449252    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf99a8a_a00a_4426_a4fd_300151aa70b5.slice/crio-8515978d6a6437ef7991afb71d0ce147c4977e47c2f4081252acd20965229f97 WatchSource:0}: Error finding container 8515978d6a6437ef7991afb71d0ce147c4977e47c2f4081252acd20965229f97: Status 404 returned error can't find the container with id 8515978d6a6437ef7991afb71d0ce147c4977e47c2f4081252acd20965229f97
Jul 24 17:17:25.241409 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:25.241370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q" event={"ID":"ccf99a8a-a00a-4426-a4fd-300151aa70b5","Type":"ContainerStarted","Data":"8515978d6a6437ef7991afb71d0ce147c4977e47c2f4081252acd20965229f97"}
Jul 24 17:17:26.179153 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:26.179112    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6fn4s"
Jul 24 17:17:26.251218 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:26.251184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd" event={"ID":"14c5390d-5b34-4ae0-8415-405fe5a8f439","Type":"ContainerStarted","Data":"22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b"}
Jul 24 17:17:26.251683 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:26.251315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:26.272572 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:26.272523    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd" podStartSLOduration=1.6945050959999999 podStartE2EDuration="6.272501892s" totalImagesPullingTime="4.577996796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:26.270549474 +0000 UTC m=+438.898427327" watchObservedRunningTime="2026-07-24 17:17:26.272501892 +0000 UTC m=+438.900379743"
Jul 24 17:17:28.265006 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:28.264966    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q" event={"ID":"ccf99a8a-a00a-4426-a4fd-300151aa70b5","Type":"ContainerStarted","Data":"c3b9dd7c393a3f6950be74e7c9eb48392d16f0c321e9913e443b7e147337b9c6"}
Jul 24 17:17:28.265454 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:28.265030    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"
Jul 24 17:17:28.283708 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:28.283640    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q" podStartSLOduration=2.21468495 podStartE2EDuration="5.28362075s" totalImagesPullingTime="3.0689358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:28.282947837 +0000 UTC m=+440.910825689" watchObservedRunningTime="2026-07-24 17:17:28.28362075 +0000 UTC m=+440.911498605"
Jul 24 17:17:29.198708 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:29.198626    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:37.260158 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:37.260124    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:38.656609 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.656574    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"]
Jul 24 17:17:38.660043 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.660025    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:38.685892 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.685860    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"]
Jul 24 17:17:38.746048 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.746012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/405914b0-3356-4b18-baf1-c3274073790d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jmgzx\" (UID: \"405914b0-3356-4b18-baf1-c3274073790d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:38.746218 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.746075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6xmf\" (UniqueName: \"kubernetes.io/projected/405914b0-3356-4b18-baf1-c3274073790d-kube-api-access-g6xmf\") pod \"kuadrant-operator-controller-manager-55467d9f7-jmgzx\" (UID: \"405914b0-3356-4b18-baf1-c3274073790d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:38.846941 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.846911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/405914b0-3356-4b18-baf1-c3274073790d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jmgzx\" (UID: \"405914b0-3356-4b18-baf1-c3274073790d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:38.847117 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.846959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6xmf\" (UniqueName: \"kubernetes.io/projected/405914b0-3356-4b18-baf1-c3274073790d-kube-api-access-g6xmf\") pod \"kuadrant-operator-controller-manager-55467d9f7-jmgzx\" (UID: \"405914b0-3356-4b18-baf1-c3274073790d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:38.847299 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.847280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/405914b0-3356-4b18-baf1-c3274073790d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jmgzx\" (UID: \"405914b0-3356-4b18-baf1-c3274073790d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:38.856466 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.856443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6xmf\" (UniqueName: \"kubernetes.io/projected/405914b0-3356-4b18-baf1-c3274073790d-kube-api-access-g6xmf\") pod \"kuadrant-operator-controller-manager-55467d9f7-jmgzx\" (UID: \"405914b0-3356-4b18-baf1-c3274073790d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:38.965265 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.965179    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"]
Jul 24 17:17:38.965472 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.965459    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:38.969568 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.969540    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"]
Jul 24 17:17:38.978099 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.978073    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"]
Jul 24 17:17:38.978297 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.978255    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" containerName="manager" containerID="cri-o://22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b" gracePeriod=2
Jul 24 17:17:38.991052 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.991014    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"]
Jul 24 17:17:38.995003 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.994981    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"]
Jul 24 17:17:38.995135 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:38.995092    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:38.999154 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:38.999116    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"14c5390d-5b34-4ae0-8415-405fe5a8f439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\": pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.007199 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.007169    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"]
Jul 24 17:17:39.013211 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.013189    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"]
Jul 24 17:17:39.013419 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.013396    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" containerName="manager" containerID="cri-o://9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288" gracePeriod=2
Jul 24 17:17:39.015969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.015920    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"]
Jul 24 17:17:39.016555 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.016532    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" containerName="manager"
Jul 24 17:17:39.016555 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.016555    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" containerName="manager"
Jul 24 17:17:39.016737 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.016703    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" containerName="manager"
Jul 24 17:17:39.020706 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.020685    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"]
Jul 24 17:17:39.020849 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.020821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:39.032975 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.032927    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.037000 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.036977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"]
Jul 24 17:17:39.044995 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.044967    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"]
Jul 24 17:17:39.045502 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.045485    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" containerName="manager"
Jul 24 17:17:39.045502 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.045503    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" containerName="manager"
Jul 24 17:17:39.045655 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.045610    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" containerName="manager"
Jul 24 17:17:39.049135 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.049114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"
Jul 24 17:17:39.064161 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.064129    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.067959 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.067932    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.068914 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.068894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"]
Jul 24 17:17:39.070108 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.070085    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.072320 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.072298    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.149196 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.149155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwhcm\" (UniqueName: \"kubernetes.io/projected/e382ab68-d1dc-417a-8fa4-06c1de35842e-kube-api-access-cwhcm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrk69\" (UID: \"e382ab68-d1dc-417a-8fa4-06c1de35842e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:39.149373 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.149308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c7xl\" (UniqueName: \"kubernetes.io/projected/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-kube-api-access-5c7xl\") pod \"kuadrant-operator-controller-manager-55467d9f7-t7zwj\" (UID: \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:39.149373 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.149336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e382ab68-d1dc-417a-8fa4-06c1de35842e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrk69\" (UID: \"e382ab68-d1dc-417a-8fa4-06c1de35842e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:39.149468 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.149411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8ccd\" (UniqueName: \"kubernetes.io/projected/d6ce209f-8cb8-44f9-84c4-072df632e04b-kube-api-access-z8ccd\") pod \"limitador-operator-controller-manager-859d7b78bd-ptkmw\" (UID: \"d6ce209f-8cb8-44f9-84c4-072df632e04b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"
Jul 24 17:17:39.149468 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.149448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-t7zwj\" (UID: \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:39.246105 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.246023    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.248981 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.248950    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.250040 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.250013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7xl\" (UniqueName: \"kubernetes.io/projected/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-kube-api-access-5c7xl\") pod \"kuadrant-operator-controller-manager-55467d9f7-t7zwj\" (UID: \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:39.250152 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.250057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e382ab68-d1dc-417a-8fa4-06c1de35842e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrk69\" (UID: \"e382ab68-d1dc-417a-8fa4-06c1de35842e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:39.250152 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.250127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8ccd\" (UniqueName: \"kubernetes.io/projected/d6ce209f-8cb8-44f9-84c4-072df632e04b-kube-api-access-z8ccd\") pod \"limitador-operator-controller-manager-859d7b78bd-ptkmw\" (UID: \"d6ce209f-8cb8-44f9-84c4-072df632e04b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"
Jul 24 17:17:39.250283 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.250164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-t7zwj\" (UID: \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:39.250283 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.250236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwhcm\" (UniqueName: \"kubernetes.io/projected/e382ab68-d1dc-417a-8fa4-06c1de35842e-kube-api-access-cwhcm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrk69\" (UID: \"e382ab68-d1dc-417a-8fa4-06c1de35842e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:39.250524 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.250489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e382ab68-d1dc-417a-8fa4-06c1de35842e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrk69\" (UID: \"e382ab68-d1dc-417a-8fa4-06c1de35842e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:39.250633 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.250590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-t7zwj\" (UID: \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:39.251052 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.251021    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.253610 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.253594    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.255949 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.255915    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.258088 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.258055    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.258352 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.258332    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8ccd\" (UniqueName: \"kubernetes.io/projected/d6ce209f-8cb8-44f9-84c4-072df632e04b-kube-api-access-z8ccd\") pod \"limitador-operator-controller-manager-859d7b78bd-ptkmw\" (UID: \"d6ce209f-8cb8-44f9-84c4-072df632e04b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"
Jul 24 17:17:39.258352 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.258346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwhcm\" (UniqueName: \"kubernetes.io/projected/e382ab68-d1dc-417a-8fa4-06c1de35842e-kube-api-access-cwhcm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qrk69\" (UID: \"e382ab68-d1dc-417a-8fa4-06c1de35842e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:39.258448 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.258363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c7xl\" (UniqueName: \"kubernetes.io/projected/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-kube-api-access-5c7xl\") pod \"kuadrant-operator-controller-manager-55467d9f7-t7zwj\" (UID: \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:39.271882 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.271853    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g7b7q"
Jul 24 17:17:39.274071 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.274047    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.295113 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.295087    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.331658 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.331630    2563 generic.go:356] "Generic (PLEG): container finished" podID="7ace9bc4-96d6-4da6-ba21-1f6471676583" containerID="9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288" exitCode=0
Jul 24 17:17:39.331811 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.331672    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.331811 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.331730    2563 scope.go:117] "RemoveContainer" containerID="9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288"
Jul 24 17:17:39.333387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.333338    2563 generic.go:356] "Generic (PLEG): container finished" podID="14c5390d-5b34-4ae0-8415-405fe5a8f439" containerID="22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b" exitCode=0
Jul 24 17:17:39.333496 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.333387    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.334457 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.334433    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.336624 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.336596    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.338972 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.338939    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.340871 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.340853    2563 scope.go:117] "RemoveContainer" containerID="9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288"
Jul 24 17:17:39.341125 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.341096    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.341210 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.341140    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288\": container with ID starting with 9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288 not found: ID does not exist" containerID="9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288"
Jul 24 17:17:39.341210 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.341168    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288"} err="failed to get container status \"9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288\": rpc error: code = NotFound desc = could not find container \"9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288\": container with ID starting with 9dbd6fb448ac61c62c4855d4d6e6d10272c3c56eb7fa2af9993566ff2182b288 not found: ID does not exist"
Jul 24 17:17:39.341210 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.341193    2563 scope.go:117] "RemoveContainer" containerID="22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b"
Jul 24 17:17:39.350515 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.350500    2563 scope.go:117] "RemoveContainer" containerID="22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b"
Jul 24 17:17:39.350728 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.350710    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c5390d-5b34-4ae0-8415-405fe5a8f439-extensions-socket-volume\") pod \"14c5390d-5b34-4ae0-8415-405fe5a8f439\" (UID: \"14c5390d-5b34-4ae0-8415-405fe5a8f439\") "
Jul 24 17:17:39.350776 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.350749    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2d7z\" (UniqueName: \"kubernetes.io/projected/7ace9bc4-96d6-4da6-ba21-1f6471676583-kube-api-access-f2d7z\") pod \"7ace9bc4-96d6-4da6-ba21-1f6471676583\" (UID: \"7ace9bc4-96d6-4da6-ba21-1f6471676583\") "
Jul 24 17:17:39.350853 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.350787    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b\": container with ID starting with 22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b not found: ID does not exist" containerID="22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b"
Jul 24 17:17:39.350853 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.350839    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b"} err="failed to get container status \"22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b\": rpc error: code = NotFound desc = could not find container \"22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b\": container with ID starting with 22639d6c48fd784bfdf6143319eb6abb85e7ad8c7b5a8838fae5bd4b4e3dc46b not found: ID does not exist"
Jul 24 17:17:39.350930 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.350862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p7wl\" (UniqueName: \"kubernetes.io/projected/14c5390d-5b34-4ae0-8415-405fe5a8f439-kube-api-access-4p7wl\") pod \"14c5390d-5b34-4ae0-8415-405fe5a8f439\" (UID: \"14c5390d-5b34-4ae0-8415-405fe5a8f439\") "
Jul 24 17:17:39.351176 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.351151    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14c5390d-5b34-4ae0-8415-405fe5a8f439-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "14c5390d-5b34-4ae0-8415-405fe5a8f439" (UID: "14c5390d-5b34-4ae0-8415-405fe5a8f439"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:39.353035 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.353009    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ace9bc4-96d6-4da6-ba21-1f6471676583-kube-api-access-f2d7z" (OuterVolumeSpecName: "kube-api-access-f2d7z") pod "7ace9bc4-96d6-4da6-ba21-1f6471676583" (UID: "7ace9bc4-96d6-4da6-ba21-1f6471676583"). InnerVolumeSpecName "kube-api-access-f2d7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:39.353117 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.353039    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14c5390d-5b34-4ae0-8415-405fe5a8f439-kube-api-access-4p7wl" (OuterVolumeSpecName: "kube-api-access-4p7wl") pod "14c5390d-5b34-4ae0-8415-405fe5a8f439" (UID: "14c5390d-5b34-4ae0-8415-405fe5a8f439"). InnerVolumeSpecName "kube-api-access-4p7wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:39.408326 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.408295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:39.416707 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.416686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:39.424816 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.424775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"
Jul 24 17:17:39.452433 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.452376    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c5390d-5b34-4ae0-8415-405fe5a8f439-extensions-socket-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:39.452433 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.452402    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2d7z\" (UniqueName: \"kubernetes.io/projected/7ace9bc4-96d6-4da6-ba21-1f6471676583-kube-api-access-f2d7z\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:39.452433 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.452412    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p7wl\" (UniqueName: \"kubernetes.io/projected/14c5390d-5b34-4ae0-8415-405fe5a8f439-kube-api-access-4p7wl\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:39.576287 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.576264    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"]
Jul 24 17:17:39.579225 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:17:39.579201    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031a9b86_a2c0_4c18_a97a_ba6d4c251b92.slice/crio-c10c5ad6cd2496fa2e3ef80e66e3c96585cfb609bb124206d04e0c19fa7cf726 WatchSource:0}: Error finding container c10c5ad6cd2496fa2e3ef80e66e3c96585cfb609bb124206d04e0c19fa7cf726: Status 404 returned error can't find the container with id c10c5ad6cd2496fa2e3ef80e66e3c96585cfb609bb124206d04e0c19fa7cf726
Jul 24 17:17:39.644976 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.644944    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.647514 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.647479    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.649662 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.649643    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tqpcd\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tqpcd"
Jul 24 17:17:39.651645 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:39.651625    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2cfk\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk"
Jul 24 17:17:39.805954 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.805907    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"]
Jul 24 17:17:39.808387 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:17:39.808341    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode382ab68_d1dc_417a_8fa4_06c1de35842e.slice/crio-2ad62dcba1638e8dc2474c4b91abf516bee8ea5c8f8ae7bca6aa18576f651eb3 WatchSource:0}: Error finding container 2ad62dcba1638e8dc2474c4b91abf516bee8ea5c8f8ae7bca6aa18576f651eb3: Status 404 returned error can't find the container with id 2ad62dcba1638e8dc2474c4b91abf516bee8ea5c8f8ae7bca6aa18576f651eb3
Jul 24 17:17:39.808659 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.808641    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"]
Jul 24 17:17:39.809017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:17:39.808996    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ce209f_8cb8_44f9_84c4_072df632e04b.slice/crio-6bdec7a588d68943fa0dac7379a07a3d3056f78bb8c9e1b090ed762a1a679eb3 WatchSource:0}: Error finding container 6bdec7a588d68943fa0dac7379a07a3d3056f78bb8c9e1b090ed762a1a679eb3: Status 404 returned error can't find the container with id 6bdec7a588d68943fa0dac7379a07a3d3056f78bb8c9e1b090ed762a1a679eb3
Jul 24 17:17:39.938776 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.938745    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c5390d-5b34-4ae0-8415-405fe5a8f439" path="/var/lib/kubelet/pods/14c5390d-5b34-4ae0-8415-405fe5a8f439/volumes"
Jul 24 17:17:39.939120 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:39.939107    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" path="/var/lib/kubelet/pods/7ace9bc4-96d6-4da6-ba21-1f6471676583/volumes"
Jul 24 17:17:40.196953 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.196914    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2cfk" podUID="7ace9bc4-96d6-4da6-ba21-1f6471676583" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.44:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:17:40.342362 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.342318    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69" event={"ID":"e382ab68-d1dc-417a-8fa4-06c1de35842e","Type":"ContainerStarted","Data":"af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648"}
Jul 24 17:17:40.342552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.342384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69" event={"ID":"e382ab68-d1dc-417a-8fa4-06c1de35842e","Type":"ContainerStarted","Data":"2ad62dcba1638e8dc2474c4b91abf516bee8ea5c8f8ae7bca6aa18576f651eb3"}
Jul 24 17:17:40.342552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.342501    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:40.343909 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.343887    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw" event={"ID":"d6ce209f-8cb8-44f9-84c4-072df632e04b","Type":"ContainerStarted","Data":"9f3e84dcc07d756414e24b20d84d2939ecde36d94fd32e752e7a7b3168cfd1fe"}
Jul 24 17:17:40.344018 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.343937    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"
Jul 24 17:17:40.344018 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.343955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw" event={"ID":"d6ce209f-8cb8-44f9-84c4-072df632e04b","Type":"ContainerStarted","Data":"6bdec7a588d68943fa0dac7379a07a3d3056f78bb8c9e1b090ed762a1a679eb3"}
Jul 24 17:17:40.345427 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.345405    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj" event={"ID":"031a9b86-a2c0-4c18-a97a-ba6d4c251b92","Type":"ContainerStarted","Data":"d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67"}
Jul 24 17:17:40.345520 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.345440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj" event={"ID":"031a9b86-a2c0-4c18-a97a-ba6d4c251b92","Type":"ContainerStarted","Data":"c10c5ad6cd2496fa2e3ef80e66e3c96585cfb609bb124206d04e0c19fa7cf726"}
Jul 24 17:17:40.345520 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.345468    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:40.380878 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.380835    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69" podStartSLOduration=2.38081871 podStartE2EDuration="2.38081871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:40.377665253 +0000 UTC m=+453.005543105" watchObservedRunningTime="2026-07-24 17:17:40.38081871 +0000 UTC m=+453.008696556"
Jul 24 17:17:40.413502 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.413452    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw" podStartSLOduration=1.413437844 podStartE2EDuration="1.413437844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:40.412049928 +0000 UTC m=+453.039927780" watchObservedRunningTime="2026-07-24 17:17:40.413437844 +0000 UTC m=+453.041315696"
Jul 24 17:17:40.432691 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:40.432642    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj" podStartSLOduration=2.432623941 podStartE2EDuration="2.432623941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:40.431609465 +0000 UTC m=+453.059487318" watchObservedRunningTime="2026-07-24 17:17:40.432623941 +0000 UTC m=+453.060501796"
Jul 24 17:17:41.512737 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:41.512699    2563 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-jmgzx_kuadrant-system_405914b0-3356-4b18-baf1-c3274073790d_0(ab6bcfd262286b73c6563a456cdea9a1c1f8efbc372fa3479eb4e88412a2a06d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-jmgzx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 24 17:17:41.513050 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:41.512768    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-jmgzx_kuadrant-system_405914b0-3356-4b18-baf1-c3274073790d_0(ab6bcfd262286b73c6563a456cdea9a1c1f8efbc372fa3479eb4e88412a2a06d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-jmgzx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:42.356544 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:42.356513    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:42.364736 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:42.364714    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:42.367275 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:42.367247    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jmgzx\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="405914b0-3356-4b18-baf1-c3274073790d" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:42.479663 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:42.479630    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/405914b0-3356-4b18-baf1-c3274073790d-extensions-socket-volume\") pod \"405914b0-3356-4b18-baf1-c3274073790d\" (UID: \"405914b0-3356-4b18-baf1-c3274073790d\") "
Jul 24 17:17:42.479901 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:42.479681    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6xmf\" (UniqueName: \"kubernetes.io/projected/405914b0-3356-4b18-baf1-c3274073790d-kube-api-access-g6xmf\") pod \"405914b0-3356-4b18-baf1-c3274073790d\" (UID: \"405914b0-3356-4b18-baf1-c3274073790d\") "
Jul 24 17:17:42.480041 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:42.480011    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/405914b0-3356-4b18-baf1-c3274073790d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "405914b0-3356-4b18-baf1-c3274073790d" (UID: "405914b0-3356-4b18-baf1-c3274073790d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:42.482181 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:42.482159    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/405914b0-3356-4b18-baf1-c3274073790d-kube-api-access-g6xmf" (OuterVolumeSpecName: "kube-api-access-g6xmf") pod "405914b0-3356-4b18-baf1-c3274073790d" (UID: "405914b0-3356-4b18-baf1-c3274073790d"). InnerVolumeSpecName "kube-api-access-g6xmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:42.581091 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:42.581053    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/405914b0-3356-4b18-baf1-c3274073790d-extensions-socket-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:42.581091 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:42.581085    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6xmf\" (UniqueName: \"kubernetes.io/projected/405914b0-3356-4b18-baf1-c3274073790d-kube-api-access-g6xmf\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:43.361980 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:43.361950    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:43.364679 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:43.364650    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jmgzx\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="405914b0-3356-4b18-baf1-c3274073790d" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:43.370003 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:43.369977    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jmgzx\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="405914b0-3356-4b18-baf1-c3274073790d" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jmgzx"
Jul 24 17:17:43.937303 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:43.937267    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="405914b0-3356-4b18-baf1-c3274073790d" path="/var/lib/kubelet/pods/405914b0-3356-4b18-baf1-c3274073790d/volumes"
Jul 24 17:17:48.303558 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.303521    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bc985bbb9-hj7w7" podUID="a85700f1-6b8e-4fd8-9de1-f94d54c041bf" containerName="console" containerID="cri-o://20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546" gracePeriod=15
Jul 24 17:17:48.563421 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.563361    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:17:48.736134 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736087    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-service-ca\") pod \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") "
Jul 24 17:17:48.736315 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736144    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-trusted-ca-bundle\") pod \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") "
Jul 24 17:17:48.736315 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736200    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbw4j\" (UniqueName: \"kubernetes.io/projected/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-kube-api-access-zbw4j\") pod \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") "
Jul 24 17:17:48.736315 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736232    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-oauth-serving-cert\") pod \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") "
Jul 24 17:17:48.736420 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736389    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-config\") pod \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") "
Jul 24 17:17:48.736482 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736453    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-serving-cert\") pod \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") "
Jul 24 17:17:48.736555 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-oauth-config\") pod \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\" (UID: \"a85700f1-6b8e-4fd8-9de1-f94d54c041bf\") "
Jul 24 17:17:48.736610 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736561    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-service-ca" (OuterVolumeSpecName: "service-ca") pod "a85700f1-6b8e-4fd8-9de1-f94d54c041bf" (UID: "a85700f1-6b8e-4fd8-9de1-f94d54c041bf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:17:48.736683 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736662    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a85700f1-6b8e-4fd8-9de1-f94d54c041bf" (UID: "a85700f1-6b8e-4fd8-9de1-f94d54c041bf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:17:48.736781 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736753    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-config" (OuterVolumeSpecName: "console-config") pod "a85700f1-6b8e-4fd8-9de1-f94d54c041bf" (UID: "a85700f1-6b8e-4fd8-9de1-f94d54c041bf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:17:48.736878 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736849    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-oauth-serving-cert\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:48.736878 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736868    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-config\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:48.736990 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736881    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:48.737042 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.736986    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a85700f1-6b8e-4fd8-9de1-f94d54c041bf" (UID: "a85700f1-6b8e-4fd8-9de1-f94d54c041bf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:17:48.738651 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.738619    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a85700f1-6b8e-4fd8-9de1-f94d54c041bf" (UID: "a85700f1-6b8e-4fd8-9de1-f94d54c041bf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:17:48.738746 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.738653    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-kube-api-access-zbw4j" (OuterVolumeSpecName: "kube-api-access-zbw4j") pod "a85700f1-6b8e-4fd8-9de1-f94d54c041bf" (UID: "a85700f1-6b8e-4fd8-9de1-f94d54c041bf"). InnerVolumeSpecName "kube-api-access-zbw4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:48.738746 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.738672    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a85700f1-6b8e-4fd8-9de1-f94d54c041bf" (UID: "a85700f1-6b8e-4fd8-9de1-f94d54c041bf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:17:48.837782 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.837683    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-serving-cert\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:48.837782 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.837717    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-console-oauth-config\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:48.837782 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.837735    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-trusted-ca-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:48.837782 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:48.837744    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbw4j\" (UniqueName: \"kubernetes.io/projected/a85700f1-6b8e-4fd8-9de1-f94d54c041bf-kube-api-access-zbw4j\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:49.397105 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.397065    2563 generic.go:356] "Generic (PLEG): container finished" podID="a85700f1-6b8e-4fd8-9de1-f94d54c041bf" containerID="20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546" exitCode=0
Jul 24 17:17:49.397526 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.397123    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc985bbb9-hj7w7"
Jul 24 17:17:49.397526 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.397156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc985bbb9-hj7w7" event={"ID":"a85700f1-6b8e-4fd8-9de1-f94d54c041bf","Type":"ContainerDied","Data":"20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546"}
Jul 24 17:17:49.397526 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.397210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc985bbb9-hj7w7" event={"ID":"a85700f1-6b8e-4fd8-9de1-f94d54c041bf","Type":"ContainerDied","Data":"ab33cff43f68ccafe4aeae6950a8a44c32c1f01ba14e9865dd67ed1940dae1fa"}
Jul 24 17:17:49.397526 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.397231    2563 scope.go:117] "RemoveContainer" containerID="20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546"
Jul 24 17:17:49.407160 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.407142    2563 scope.go:117] "RemoveContainer" containerID="20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546"
Jul 24 17:17:49.407431 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:49.407411    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546\": container with ID starting with 20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546 not found: ID does not exist" containerID="20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546"
Jul 24 17:17:49.407489 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.407442    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546"} err="failed to get container status \"20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546\": rpc error: code = NotFound desc = could not find container \"20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546\": container with ID starting with 20bfa1ec6efc17d7d594cb143de5ec842439f3254fc88b0e185440faab3f6546 not found: ID does not exist"
Jul 24 17:17:49.418967 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.418936    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc985bbb9-hj7w7"]
Jul 24 17:17:49.421092 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.421073    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bc985bbb9-hj7w7"]
Jul 24 17:17:49.937387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:49.937349    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a85700f1-6b8e-4fd8-9de1-f94d54c041bf" path="/var/lib/kubelet/pods/a85700f1-6b8e-4fd8-9de1-f94d54c041bf/volumes"
Jul 24 17:17:51.353252 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.353222    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:17:51.353654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.353297    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:51.353654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.353332    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptkmw"
Jul 24 17:17:51.477593 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.477562    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"]
Jul 24 17:17:51.477940 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.477770    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69" podUID="e382ab68-d1dc-417a-8fa4-06c1de35842e" containerName="manager" containerID="cri-o://af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648" gracePeriod=10
Jul 24 17:17:51.662671 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.662644    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"]
Jul 24 17:17:51.663047 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.663034    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a85700f1-6b8e-4fd8-9de1-f94d54c041bf" containerName="console"
Jul 24 17:17:51.663092 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.663049    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a85700f1-6b8e-4fd8-9de1-f94d54c041bf" containerName="console"
Jul 24 17:17:51.663130 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.663112    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a85700f1-6b8e-4fd8-9de1-f94d54c041bf" containerName="console"
Jul 24 17:17:51.666657 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.666640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:17:51.681300 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.681271    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"]
Jul 24 17:17:51.730287 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.730264    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:51.762257 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.762230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x85m\" (UniqueName: \"kubernetes.io/projected/9b5787e9-0060-46b1-ba70-4d706611cdb9-kube-api-access-8x85m\") pod \"kuadrant-operator-controller-manager-86878c769f-76vsw\" (UID: \"9b5787e9-0060-46b1-ba70-4d706611cdb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:17:51.762406 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.762289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5787e9-0060-46b1-ba70-4d706611cdb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-76vsw\" (UID: \"9b5787e9-0060-46b1-ba70-4d706611cdb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:17:51.863176 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.863143    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwhcm\" (UniqueName: \"kubernetes.io/projected/e382ab68-d1dc-417a-8fa4-06c1de35842e-kube-api-access-cwhcm\") pod \"e382ab68-d1dc-417a-8fa4-06c1de35842e\" (UID: \"e382ab68-d1dc-417a-8fa4-06c1de35842e\") "
Jul 24 17:17:51.863393 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.863206    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e382ab68-d1dc-417a-8fa4-06c1de35842e-extensions-socket-volume\") pod \"e382ab68-d1dc-417a-8fa4-06c1de35842e\" (UID: \"e382ab68-d1dc-417a-8fa4-06c1de35842e\") "
Jul 24 17:17:51.863456 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.863414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x85m\" (UniqueName: \"kubernetes.io/projected/9b5787e9-0060-46b1-ba70-4d706611cdb9-kube-api-access-8x85m\") pod \"kuadrant-operator-controller-manager-86878c769f-76vsw\" (UID: \"9b5787e9-0060-46b1-ba70-4d706611cdb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:17:51.863533 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.863516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5787e9-0060-46b1-ba70-4d706611cdb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-76vsw\" (UID: \"9b5787e9-0060-46b1-ba70-4d706611cdb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:17:51.863595 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.863547    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e382ab68-d1dc-417a-8fa4-06c1de35842e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e382ab68-d1dc-417a-8fa4-06c1de35842e" (UID: "e382ab68-d1dc-417a-8fa4-06c1de35842e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:17:51.863923 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.863901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5787e9-0060-46b1-ba70-4d706611cdb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-76vsw\" (UID: \"9b5787e9-0060-46b1-ba70-4d706611cdb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:17:51.865439 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.865408    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e382ab68-d1dc-417a-8fa4-06c1de35842e-kube-api-access-cwhcm" (OuterVolumeSpecName: "kube-api-access-cwhcm") pod "e382ab68-d1dc-417a-8fa4-06c1de35842e" (UID: "e382ab68-d1dc-417a-8fa4-06c1de35842e"). InnerVolumeSpecName "kube-api-access-cwhcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:17:51.874036 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.874016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x85m\" (UniqueName: \"kubernetes.io/projected/9b5787e9-0060-46b1-ba70-4d706611cdb9-kube-api-access-8x85m\") pod \"kuadrant-operator-controller-manager-86878c769f-76vsw\" (UID: \"9b5787e9-0060-46b1-ba70-4d706611cdb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:17:51.964260 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.964223    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwhcm\" (UniqueName: \"kubernetes.io/projected/e382ab68-d1dc-417a-8fa4-06c1de35842e-kube-api-access-cwhcm\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:51.964434 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.964287    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e382ab68-d1dc-417a-8fa4-06c1de35842e-extensions-socket-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:17:51.980164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:51.980133    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:17:52.121169 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.121145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"]
Jul 24 17:17:52.123207 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:17:52.123179    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5787e9_0060_46b1_ba70_4d706611cdb9.slice/crio-9e864d88296dc6adecd0c4a623127f9339ea6eeab01d8f7587dd06f2646424e0 WatchSource:0}: Error finding container 9e864d88296dc6adecd0c4a623127f9339ea6eeab01d8f7587dd06f2646424e0: Status 404 returned error can't find the container with id 9e864d88296dc6adecd0c4a623127f9339ea6eeab01d8f7587dd06f2646424e0
Jul 24 17:17:52.416316 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.416282    2563 generic.go:356] "Generic (PLEG): container finished" podID="e382ab68-d1dc-417a-8fa4-06c1de35842e" containerID="af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648" exitCode=0
Jul 24 17:17:52.416762 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.416359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69" event={"ID":"e382ab68-d1dc-417a-8fa4-06c1de35842e","Type":"ContainerDied","Data":"af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648"}
Jul 24 17:17:52.416762 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.416364    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"
Jul 24 17:17:52.416762 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.416448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69" event={"ID":"e382ab68-d1dc-417a-8fa4-06c1de35842e","Type":"ContainerDied","Data":"2ad62dcba1638e8dc2474c4b91abf516bee8ea5c8f8ae7bca6aa18576f651eb3"}
Jul 24 17:17:52.416762 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.416482    2563 scope.go:117] "RemoveContainer" containerID="af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648"
Jul 24 17:17:52.418651 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.418622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw" event={"ID":"9b5787e9-0060-46b1-ba70-4d706611cdb9","Type":"ContainerStarted","Data":"e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357"}
Jul 24 17:17:52.418763 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.418677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw" event={"ID":"9b5787e9-0060-46b1-ba70-4d706611cdb9","Type":"ContainerStarted","Data":"9e864d88296dc6adecd0c4a623127f9339ea6eeab01d8f7587dd06f2646424e0"}
Jul 24 17:17:52.418763 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.418747    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:17:52.425989 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.425914    2563 scope.go:117] "RemoveContainer" containerID="af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648"
Jul 24 17:17:52.426177 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:17:52.426156    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648\": container with ID starting with af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648 not found: ID does not exist" containerID="af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648"
Jul 24 17:17:52.426235 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.426185    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648"} err="failed to get container status \"af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648\": rpc error: code = NotFound desc = could not find container \"af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648\": container with ID starting with af67182c54c5827ed08c3c18fffb49421783d8294995a0034b0939cedd233648 not found: ID does not exist"
Jul 24 17:17:52.441233 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.441212    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"]
Jul 24 17:17:52.445007 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.444987    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qrk69"]
Jul 24 17:17:52.463723 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:52.463683    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw" podStartSLOduration=1.4636707709999999 podStartE2EDuration="1.463670771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:52.461312276 +0000 UTC m=+465.089190150" watchObservedRunningTime="2026-07-24 17:17:52.463670771 +0000 UTC m=+465.091548622"
Jul 24 17:17:53.937845 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:17:53.937814    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e382ab68-d1dc-417a-8fa4-06c1de35842e" path="/var/lib/kubelet/pods/e382ab68-d1dc-417a-8fa4-06c1de35842e/volumes"
Jul 24 17:18:03.428365 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.428334    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:18:03.483132 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.483098    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"]
Jul 24 17:18:03.483369 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.483340    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj" podUID="031a9b86-a2c0-4c18-a97a-ba6d4c251b92" containerName="manager" containerID="cri-o://d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67" gracePeriod=10
Jul 24 17:18:03.746206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.746183    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:18:03.862084 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.862051    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c7xl\" (UniqueName: \"kubernetes.io/projected/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-kube-api-access-5c7xl\") pod \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\" (UID: \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\") "
Jul 24 17:18:03.862265 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.862106    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-extensions-socket-volume\") pod \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\" (UID: \"031a9b86-a2c0-4c18-a97a-ba6d4c251b92\") "
Jul 24 17:18:03.862495 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.862464    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "031a9b86-a2c0-4c18-a97a-ba6d4c251b92" (UID: "031a9b86-a2c0-4c18-a97a-ba6d4c251b92"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:18:03.864348 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.864327    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-kube-api-access-5c7xl" (OuterVolumeSpecName: "kube-api-access-5c7xl") pod "031a9b86-a2c0-4c18-a97a-ba6d4c251b92" (UID: "031a9b86-a2c0-4c18-a97a-ba6d4c251b92"). InnerVolumeSpecName "kube-api-access-5c7xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:18:03.963063 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.963033    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c7xl\" (UniqueName: \"kubernetes.io/projected/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-kube-api-access-5c7xl\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:18:03.963063 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:03.963063    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031a9b86-a2c0-4c18-a97a-ba6d4c251b92-extensions-socket-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:18:04.488251 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:04.488210    2563 generic.go:356] "Generic (PLEG): container finished" podID="031a9b86-a2c0-4c18-a97a-ba6d4c251b92" containerID="d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67" exitCode=0
Jul 24 17:18:04.488730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:04.488273    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"
Jul 24 17:18:04.488730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:04.488295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj" event={"ID":"031a9b86-a2c0-4c18-a97a-ba6d4c251b92","Type":"ContainerDied","Data":"d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67"}
Jul 24 17:18:04.488730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:04.488370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj" event={"ID":"031a9b86-a2c0-4c18-a97a-ba6d4c251b92","Type":"ContainerDied","Data":"c10c5ad6cd2496fa2e3ef80e66e3c96585cfb609bb124206d04e0c19fa7cf726"}
Jul 24 17:18:04.488730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:04.488392    2563 scope.go:117] "RemoveContainer" containerID="d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67"
Jul 24 17:18:04.497464 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:04.497432    2563 scope.go:117] "RemoveContainer" containerID="d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67"
Jul 24 17:18:04.497814 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:18:04.497773    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67\": container with ID starting with d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67 not found: ID does not exist" containerID="d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67"
Jul 24 17:18:04.497894 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:04.497831    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67"} err="failed to get container status \"d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67\": rpc error: code = NotFound desc = could not find container \"d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67\": container with ID starting with d66036a4791435dc2f837b41622b24678753525a2e21c8fe26daaea5d1a6ac67 not found: ID does not exist"
Jul 24 17:18:04.533807 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:04.533764    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"]
Jul 24 17:18:04.548889 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:04.548868    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t7zwj"]
Jul 24 17:18:05.936842 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:05.936788    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="031a9b86-a2c0-4c18-a97a-ba6d4c251b92" path="/var/lib/kubelet/pods/031a9b86-a2c0-4c18-a97a-ba6d4c251b92/volumes"
Jul 24 17:18:23.245876 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.245840    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"]
Jul 24 17:18:23.246246 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.246233    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031a9b86-a2c0-4c18-a97a-ba6d4c251b92" containerName="manager"
Jul 24 17:18:23.246246 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.246244    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="031a9b86-a2c0-4c18-a97a-ba6d4c251b92" containerName="manager"
Jul 24 17:18:23.246319 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.246253    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e382ab68-d1dc-417a-8fa4-06c1de35842e" containerName="manager"
Jul 24 17:18:23.246319 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.246259    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e382ab68-d1dc-417a-8fa4-06c1de35842e" containerName="manager"
Jul 24 17:18:23.246383 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.246335    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="031a9b86-a2c0-4c18-a97a-ba6d4c251b92" containerName="manager"
Jul 24 17:18:23.246383 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.246348    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e382ab68-d1dc-417a-8fa4-06c1de35842e" containerName="manager"
Jul 24 17:18:23.251081 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.251060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:23.253921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.253896    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 17:18:23.254029 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.253943    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gwqqm\""
Jul 24 17:18:23.259772 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.259745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"]
Jul 24 17:18:23.336392 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.336353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r74xc\" (UniqueName: \"kubernetes.io/projected/13a4cdf6-9119-49db-b55b-b030a9db71ac-kube-api-access-r74xc\") pod \"limitador-limitador-64c94fd64f-8xzbp\" (UID: \"13a4cdf6-9119-49db-b55b-b030a9db71ac\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:23.336707 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.336687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13a4cdf6-9119-49db-b55b-b030a9db71ac-config-file\") pod \"limitador-limitador-64c94fd64f-8xzbp\" (UID: \"13a4cdf6-9119-49db-b55b-b030a9db71ac\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:23.339395 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.339373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"]
Jul 24 17:18:23.437856 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.437821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r74xc\" (UniqueName: \"kubernetes.io/projected/13a4cdf6-9119-49db-b55b-b030a9db71ac-kube-api-access-r74xc\") pod \"limitador-limitador-64c94fd64f-8xzbp\" (UID: \"13a4cdf6-9119-49db-b55b-b030a9db71ac\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:23.438014 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.437881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13a4cdf6-9119-49db-b55b-b030a9db71ac-config-file\") pod \"limitador-limitador-64c94fd64f-8xzbp\" (UID: \"13a4cdf6-9119-49db-b55b-b030a9db71ac\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:23.438417 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.438398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13a4cdf6-9119-49db-b55b-b030a9db71ac-config-file\") pod \"limitador-limitador-64c94fd64f-8xzbp\" (UID: \"13a4cdf6-9119-49db-b55b-b030a9db71ac\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:23.447079 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.447053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r74xc\" (UniqueName: \"kubernetes.io/projected/13a4cdf6-9119-49db-b55b-b030a9db71ac-kube-api-access-r74xc\") pod \"limitador-limitador-64c94fd64f-8xzbp\" (UID: \"13a4cdf6-9119-49db-b55b-b030a9db71ac\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:23.562398 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.562308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:23.713021 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:23.712998    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"]
Jul 24 17:18:23.715581 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:18:23.715553    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a4cdf6_9119_49db_b55b_b030a9db71ac.slice/crio-4a8744e96a2470bbeca267832cb5245b7f4e3a3be8ca32b9b967b92ad9bb46f3 WatchSource:0}: Error finding container 4a8744e96a2470bbeca267832cb5245b7f4e3a3be8ca32b9b967b92ad9bb46f3: Status 404 returned error can't find the container with id 4a8744e96a2470bbeca267832cb5245b7f4e3a3be8ca32b9b967b92ad9bb46f3
Jul 24 17:18:24.059549 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.059514    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bn6jh"]
Jul 24 17:18:24.063932 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.063909    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bn6jh"
Jul 24 17:18:24.067586 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.067569    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jjkvj\""
Jul 24 17:18:24.073194 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.073172    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bn6jh"]
Jul 24 17:18:24.143290 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.143252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sptz\" (UniqueName: \"kubernetes.io/projected/b3b3f412-6b4f-47d3-8f74-441a798b6cc5-kube-api-access-2sptz\") pod \"authorino-58cd955675-bn6jh\" (UID: \"b3b3f412-6b4f-47d3-8f74-441a798b6cc5\") " pod="kuadrant-system/authorino-58cd955675-bn6jh"
Jul 24 17:18:24.243812 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.243745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sptz\" (UniqueName: \"kubernetes.io/projected/b3b3f412-6b4f-47d3-8f74-441a798b6cc5-kube-api-access-2sptz\") pod \"authorino-58cd955675-bn6jh\" (UID: \"b3b3f412-6b4f-47d3-8f74-441a798b6cc5\") " pod="kuadrant-system/authorino-58cd955675-bn6jh"
Jul 24 17:18:24.254712 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.254683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sptz\" (UniqueName: \"kubernetes.io/projected/b3b3f412-6b4f-47d3-8f74-441a798b6cc5-kube-api-access-2sptz\") pod \"authorino-58cd955675-bn6jh\" (UID: \"b3b3f412-6b4f-47d3-8f74-441a798b6cc5\") " pod="kuadrant-system/authorino-58cd955675-bn6jh"
Jul 24 17:18:24.374609 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.374537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bn6jh"
Jul 24 17:18:24.565918 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.565846    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bn6jh"]
Jul 24 17:18:24.567727 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:18:24.567686    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3b3f412_6b4f_47d3_8f74_441a798b6cc5.slice/crio-80d564df73d29bd62d119639b5ccf39c22d4f7577b9eb6f8370cfe63e6e622c0 WatchSource:0}: Error finding container 80d564df73d29bd62d119639b5ccf39c22d4f7577b9eb6f8370cfe63e6e622c0: Status 404 returned error can't find the container with id 80d564df73d29bd62d119639b5ccf39c22d4f7577b9eb6f8370cfe63e6e622c0
Jul 24 17:18:24.608059 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.607988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bn6jh" event={"ID":"b3b3f412-6b4f-47d3-8f74-441a798b6cc5","Type":"ContainerStarted","Data":"80d564df73d29bd62d119639b5ccf39c22d4f7577b9eb6f8370cfe63e6e622c0"}
Jul 24 17:18:24.611774 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:24.611694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp" event={"ID":"13a4cdf6-9119-49db-b55b-b030a9db71ac","Type":"ContainerStarted","Data":"4a8744e96a2470bbeca267832cb5245b7f4e3a3be8ca32b9b967b92ad9bb46f3"}
Jul 24 17:18:28.640007 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:28.639912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bn6jh" event={"ID":"b3b3f412-6b4f-47d3-8f74-441a798b6cc5","Type":"ContainerStarted","Data":"b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56"}
Jul 24 17:18:28.641500 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:28.641474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp" event={"ID":"13a4cdf6-9119-49db-b55b-b030a9db71ac","Type":"ContainerStarted","Data":"bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026"}
Jul 24 17:18:28.641623 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:28.641552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:28.655286 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:28.655246    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bn6jh" podStartSLOduration=0.863467231 podStartE2EDuration="4.655231382s" totalImagesPullingTime="3.791764151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:28.653198062 +0000 UTC m=+501.281075918" watchObservedRunningTime="2026-07-24 17:18:28.655231382 +0000 UTC m=+501.283109233"
Jul 24 17:18:28.671831 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:28.671753    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp" podStartSLOduration=1.028692807 podStartE2EDuration="5.671732895s" totalImagesPullingTime="4.643040088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:28.668331167 +0000 UTC m=+501.296209041" watchObservedRunningTime="2026-07-24 17:18:28.671732895 +0000 UTC m=+501.299610748"
Jul 24 17:18:28.914511 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:28.914482    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bn6jh"]
Jul 24 17:18:30.652243 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:30.652192    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bn6jh" podUID="b3b3f412-6b4f-47d3-8f74-441a798b6cc5" containerName="authorino" containerID="cri-o://b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56" gracePeriod=30
Jul 24 17:18:30.894205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:30.894178    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bn6jh"
Jul 24 17:18:31.010445 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.010418    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sptz\" (UniqueName: \"kubernetes.io/projected/b3b3f412-6b4f-47d3-8f74-441a798b6cc5-kube-api-access-2sptz\") pod \"b3b3f412-6b4f-47d3-8f74-441a798b6cc5\" (UID: \"b3b3f412-6b4f-47d3-8f74-441a798b6cc5\") "
Jul 24 17:18:31.012567 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.012541    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3b3f412-6b4f-47d3-8f74-441a798b6cc5-kube-api-access-2sptz" (OuterVolumeSpecName: "kube-api-access-2sptz") pod "b3b3f412-6b4f-47d3-8f74-441a798b6cc5" (UID: "b3b3f412-6b4f-47d3-8f74-441a798b6cc5"). InnerVolumeSpecName "kube-api-access-2sptz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:18:31.112163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.112135    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sptz\" (UniqueName: \"kubernetes.io/projected/b3b3f412-6b4f-47d3-8f74-441a798b6cc5-kube-api-access-2sptz\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:18:31.658955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.658922    2563 generic.go:356] "Generic (PLEG): container finished" podID="b3b3f412-6b4f-47d3-8f74-441a798b6cc5" containerID="b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56" exitCode=0
Jul 24 17:18:31.659408 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.658966    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bn6jh"
Jul 24 17:18:31.659408 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.659012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bn6jh" event={"ID":"b3b3f412-6b4f-47d3-8f74-441a798b6cc5","Type":"ContainerDied","Data":"b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56"}
Jul 24 17:18:31.659408 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.659061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bn6jh" event={"ID":"b3b3f412-6b4f-47d3-8f74-441a798b6cc5","Type":"ContainerDied","Data":"80d564df73d29bd62d119639b5ccf39c22d4f7577b9eb6f8370cfe63e6e622c0"}
Jul 24 17:18:31.659408 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.659087    2563 scope.go:117] "RemoveContainer" containerID="b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56"
Jul 24 17:18:31.670495 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.670479    2563 scope.go:117] "RemoveContainer" containerID="b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56"
Jul 24 17:18:31.670729 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:18:31.670715    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56\": container with ID starting with b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56 not found: ID does not exist" containerID="b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56"
Jul 24 17:18:31.670780 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.670737    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56"} err="failed to get container status \"b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56\": rpc error: code = NotFound desc = could not find container \"b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56\": container with ID starting with b96a2952fe8f4682d99f8cd36c40221ffec631e4467bf535c984fb8e2054aa56 not found: ID does not exist"
Jul 24 17:18:31.681389 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.681369    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bn6jh"]
Jul 24 17:18:31.684679 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.684660    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bn6jh"]
Jul 24 17:18:31.937576 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:31.937498    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3b3f412-6b4f-47d3-8f74-441a798b6cc5" path="/var/lib/kubelet/pods/b3b3f412-6b4f-47d3-8f74-441a798b6cc5/volumes"
Jul 24 17:18:39.648187 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:39.648155    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:39.922939 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:39.922904    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"]
Jul 24 17:18:39.923143 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:39.923096    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp" podUID="13a4cdf6-9119-49db-b55b-b030a9db71ac" containerName="limitador" containerID="cri-o://bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026" gracePeriod=30
Jul 24 17:18:40.489061 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.488998    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:40.589903 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.589875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r74xc\" (UniqueName: \"kubernetes.io/projected/13a4cdf6-9119-49db-b55b-b030a9db71ac-kube-api-access-r74xc\") pod \"13a4cdf6-9119-49db-b55b-b030a9db71ac\" (UID: \"13a4cdf6-9119-49db-b55b-b030a9db71ac\") "
Jul 24 17:18:40.590070 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.590007    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13a4cdf6-9119-49db-b55b-b030a9db71ac-config-file\") pod \"13a4cdf6-9119-49db-b55b-b030a9db71ac\" (UID: \"13a4cdf6-9119-49db-b55b-b030a9db71ac\") "
Jul 24 17:18:40.590352 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.590333    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a4cdf6-9119-49db-b55b-b030a9db71ac-config-file" (OuterVolumeSpecName: "config-file") pod "13a4cdf6-9119-49db-b55b-b030a9db71ac" (UID: "13a4cdf6-9119-49db-b55b-b030a9db71ac"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:18:40.592068 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.592045    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a4cdf6-9119-49db-b55b-b030a9db71ac-kube-api-access-r74xc" (OuterVolumeSpecName: "kube-api-access-r74xc") pod "13a4cdf6-9119-49db-b55b-b030a9db71ac" (UID: "13a4cdf6-9119-49db-b55b-b030a9db71ac"). InnerVolumeSpecName "kube-api-access-r74xc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:18:40.691032 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.691002    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13a4cdf6-9119-49db-b55b-b030a9db71ac-config-file\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:18:40.691032 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.691025    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r74xc\" (UniqueName: \"kubernetes.io/projected/13a4cdf6-9119-49db-b55b-b030a9db71ac-kube-api-access-r74xc\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:18:40.708012 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.707977    2563 generic.go:356] "Generic (PLEG): container finished" podID="13a4cdf6-9119-49db-b55b-b030a9db71ac" containerID="bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026" exitCode=0
Jul 24 17:18:40.708171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.708030    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"
Jul 24 17:18:40.708171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.708063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp" event={"ID":"13a4cdf6-9119-49db-b55b-b030a9db71ac","Type":"ContainerDied","Data":"bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026"}
Jul 24 17:18:40.708171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.708130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8xzbp" event={"ID":"13a4cdf6-9119-49db-b55b-b030a9db71ac","Type":"ContainerDied","Data":"4a8744e96a2470bbeca267832cb5245b7f4e3a3be8ca32b9b967b92ad9bb46f3"}
Jul 24 17:18:40.708171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.708158    2563 scope.go:117] "RemoveContainer" containerID="bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026"
Jul 24 17:18:40.716994 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.716974    2563 scope.go:117] "RemoveContainer" containerID="bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026"
Jul 24 17:18:40.717234 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:18:40.717215    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026\": container with ID starting with bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026 not found: ID does not exist" containerID="bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026"
Jul 24 17:18:40.717285 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.717243    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026"} err="failed to get container status \"bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026\": rpc error: code = NotFound desc = could not find container \"bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026\": container with ID starting with bf8afb7e6883840ad129bad275e32915006c30a5ff1cd181d437357e34710026 not found: ID does not exist"
Jul 24 17:18:40.729596 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.729571    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"]
Jul 24 17:18:40.733774 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:40.733752    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8xzbp"]
Jul 24 17:18:41.936164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:41.936132    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13a4cdf6-9119-49db-b55b-b030a9db71ac" path="/var/lib/kubelet/pods/13a4cdf6-9119-49db-b55b-b030a9db71ac/volumes"
Jul 24 17:18:46.466537 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.466505    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"]
Jul 24 17:18:46.466921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.466868    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a4cdf6-9119-49db-b55b-b030a9db71ac" containerName="limitador"
Jul 24 17:18:46.466921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.466879    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a4cdf6-9119-49db-b55b-b030a9db71ac" containerName="limitador"
Jul 24 17:18:46.466921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.466898    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3b3f412-6b4f-47d3-8f74-441a798b6cc5" containerName="authorino"
Jul 24 17:18:46.466921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.466904    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3b3f412-6b4f-47d3-8f74-441a798b6cc5" containerName="authorino"
Jul 24 17:18:46.467048 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.466962    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a4cdf6-9119-49db-b55b-b030a9db71ac" containerName="limitador"
Jul 24 17:18:46.467048 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.466969    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3b3f412-6b4f-47d3-8f74-441a798b6cc5" containerName="authorino"
Jul 24 17:18:46.471374 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.471351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:46.474508 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.474481    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 24 17:18:46.474640 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.474621    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:18:46.475894 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.475878    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bqhdw\""
Jul 24 17:18:46.475894 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.475888    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 17:18:46.491151 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.491125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"]
Jul 24 17:18:46.544210 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.544186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/90d4a2d3-f033-4ba3-8a89-8b94d717c52b-data\") pod \"postgres-69fb4594cf-rwwjc\" (UID: \"90d4a2d3-f033-4ba3-8a89-8b94d717c52b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:46.544328 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.544277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-868wm\" (UniqueName: \"kubernetes.io/projected/90d4a2d3-f033-4ba3-8a89-8b94d717c52b-kube-api-access-868wm\") pod \"postgres-69fb4594cf-rwwjc\" (UID: \"90d4a2d3-f033-4ba3-8a89-8b94d717c52b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:46.644879 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.644845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/90d4a2d3-f033-4ba3-8a89-8b94d717c52b-data\") pod \"postgres-69fb4594cf-rwwjc\" (UID: \"90d4a2d3-f033-4ba3-8a89-8b94d717c52b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:46.645050 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.644924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-868wm\" (UniqueName: \"kubernetes.io/projected/90d4a2d3-f033-4ba3-8a89-8b94d717c52b-kube-api-access-868wm\") pod \"postgres-69fb4594cf-rwwjc\" (UID: \"90d4a2d3-f033-4ba3-8a89-8b94d717c52b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:46.645227 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.645206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/90d4a2d3-f033-4ba3-8a89-8b94d717c52b-data\") pod \"postgres-69fb4594cf-rwwjc\" (UID: \"90d4a2d3-f033-4ba3-8a89-8b94d717c52b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:46.653011 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.652989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-868wm\" (UniqueName: \"kubernetes.io/projected/90d4a2d3-f033-4ba3-8a89-8b94d717c52b-kube-api-access-868wm\") pod \"postgres-69fb4594cf-rwwjc\" (UID: \"90d4a2d3-f033-4ba3-8a89-8b94d717c52b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:46.782028 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.781932    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:46.918825 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:46.918781    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"]
Jul 24 17:18:46.920821 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:18:46.920775    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d4a2d3_f033_4ba3_8a89_8b94d717c52b.slice/crio-0ec1296b7effc5d181f0d3234f3dedd1bada679d634dc43648d07968e7f63fa3 WatchSource:0}: Error finding container 0ec1296b7effc5d181f0d3234f3dedd1bada679d634dc43648d07968e7f63fa3: Status 404 returned error can't find the container with id 0ec1296b7effc5d181f0d3234f3dedd1bada679d634dc43648d07968e7f63fa3
Jul 24 17:18:47.755658 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:47.755618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc" event={"ID":"90d4a2d3-f033-4ba3-8a89-8b94d717c52b","Type":"ContainerStarted","Data":"0ec1296b7effc5d181f0d3234f3dedd1bada679d634dc43648d07968e7f63fa3"}
Jul 24 17:18:51.782859 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:51.782824    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc" event={"ID":"90d4a2d3-f033-4ba3-8a89-8b94d717c52b","Type":"ContainerStarted","Data":"d888aa4d3d52b23568150fa0d2d8e1e4650322959dacfeb5cd5395492720afe4"}
Jul 24 17:18:51.783279 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:51.782889    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:51.798657 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:51.798600    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc" podStartSLOduration=1.086076825 podStartE2EDuration="5.798581858s" totalImagesPullingTime="4.712505033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:51.796957974 +0000 UTC m=+524.424835826" watchObservedRunningTime="2026-07-24 17:18:51.798581858 +0000 UTC m=+524.426459710"
Jul 24 17:18:57.817253 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:57.817221    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rwwjc"
Jul 24 17:18:58.350169 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.350135    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kr84j"]
Jul 24 17:18:58.356472 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.356451    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kr84j"
Jul 24 17:18:58.359037 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.359018    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jjkvj\""
Jul 24 17:18:58.361076 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.361050    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kr84j"]
Jul 24 17:18:58.452276 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.452249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzsm7\" (UniqueName: \"kubernetes.io/projected/8adc79c9-cfab-40d3-8e79-ad0d2c484345-kube-api-access-lzsm7\") pod \"authorino-5d4b67c446-kr84j\" (UID: \"8adc79c9-cfab-40d3-8e79-ad0d2c484345\") " pod="kuadrant-system/authorino-5d4b67c446-kr84j"
Jul 24 17:18:58.552725 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.552687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzsm7\" (UniqueName: \"kubernetes.io/projected/8adc79c9-cfab-40d3-8e79-ad0d2c484345-kube-api-access-lzsm7\") pod \"authorino-5d4b67c446-kr84j\" (UID: \"8adc79c9-cfab-40d3-8e79-ad0d2c484345\") " pod="kuadrant-system/authorino-5d4b67c446-kr84j"
Jul 24 17:18:58.561669 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.561640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzsm7\" (UniqueName: \"kubernetes.io/projected/8adc79c9-cfab-40d3-8e79-ad0d2c484345-kube-api-access-lzsm7\") pod \"authorino-5d4b67c446-kr84j\" (UID: \"8adc79c9-cfab-40d3-8e79-ad0d2c484345\") " pod="kuadrant-system/authorino-5d4b67c446-kr84j"
Jul 24 17:18:58.581324 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.581299    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kr84j"]
Jul 24 17:18:58.581540 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.581527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kr84j"
Jul 24 17:18:58.602429 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.602375    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58549f99d4-9xn7d"]
Jul 24 17:18:58.607552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.607530    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58549f99d4-9xn7d"
Jul 24 17:18:58.612958 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.612926    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58549f99d4-9xn7d"]
Jul 24 17:18:58.654062 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.654028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkrn7\" (UniqueName: \"kubernetes.io/projected/461b271a-f040-489e-b570-5f66581af626-kube-api-access-zkrn7\") pod \"authorino-58549f99d4-9xn7d\" (UID: \"461b271a-f040-489e-b570-5f66581af626\") " pod="kuadrant-system/authorino-58549f99d4-9xn7d"
Jul 24 17:18:58.696222 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.696152    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58549f99d4-9xn7d"]
Jul 24 17:18:58.696470 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:18:58.696447    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zkrn7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-58549f99d4-9xn7d" podUID="461b271a-f040-489e-b570-5f66581af626"
Jul 24 17:18:58.716909 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.716874    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7647bf59d4-gw54b"]
Jul 24 17:18:58.721109 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.721087    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kr84j"]
Jul 24 17:18:58.721210 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.721168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:18:58.722415 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:18:58.722392    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8adc79c9_cfab_40d3_8e79_ad0d2c484345.slice/crio-ae3318d474aea459149306dfe046421b776343d229bbe4702bc453b61b662033 WatchSource:0}: Error finding container ae3318d474aea459149306dfe046421b776343d229bbe4702bc453b61b662033: Status 404 returned error can't find the container with id ae3318d474aea459149306dfe046421b776343d229bbe4702bc453b61b662033
Jul 24 17:18:58.723863 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.723841    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 17:18:58.735761 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.735736    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7647bf59d4-gw54b"]
Jul 24 17:18:58.755073 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.755050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkrn7\" (UniqueName: \"kubernetes.io/projected/461b271a-f040-489e-b570-5f66581af626-kube-api-access-zkrn7\") pod \"authorino-58549f99d4-9xn7d\" (UID: \"461b271a-f040-489e-b570-5f66581af626\") " pod="kuadrant-system/authorino-58549f99d4-9xn7d"
Jul 24 17:18:58.755172 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.755085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd87p\" (UniqueName: \"kubernetes.io/projected/15d489fb-30b2-42cc-bfb0-361da9712851-kube-api-access-vd87p\") pod \"authorino-7647bf59d4-gw54b\" (UID: \"15d489fb-30b2-42cc-bfb0-361da9712851\") " pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:18:58.755172 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.755127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15d489fb-30b2-42cc-bfb0-361da9712851-tls-cert\") pod \"authorino-7647bf59d4-gw54b\" (UID: \"15d489fb-30b2-42cc-bfb0-361da9712851\") " pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:18:58.762580 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.762559    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkrn7\" (UniqueName: \"kubernetes.io/projected/461b271a-f040-489e-b570-5f66581af626-kube-api-access-zkrn7\") pod \"authorino-58549f99d4-9xn7d\" (UID: \"461b271a-f040-489e-b570-5f66581af626\") " pod="kuadrant-system/authorino-58549f99d4-9xn7d"
Jul 24 17:18:58.822303 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.822274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58549f99d4-9xn7d"
Jul 24 17:18:58.822665 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.822294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kr84j" event={"ID":"8adc79c9-cfab-40d3-8e79-ad0d2c484345","Type":"ContainerStarted","Data":"ae3318d474aea459149306dfe046421b776343d229bbe4702bc453b61b662033"}
Jul 24 17:18:58.829597 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.829578    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58549f99d4-9xn7d"
Jul 24 17:18:58.856572 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.856515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkrn7\" (UniqueName: \"kubernetes.io/projected/461b271a-f040-489e-b570-5f66581af626-kube-api-access-zkrn7\") pod \"461b271a-f040-489e-b570-5f66581af626\" (UID: \"461b271a-f040-489e-b570-5f66581af626\") "
Jul 24 17:18:58.856687 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.856585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd87p\" (UniqueName: \"kubernetes.io/projected/15d489fb-30b2-42cc-bfb0-361da9712851-kube-api-access-vd87p\") pod \"authorino-7647bf59d4-gw54b\" (UID: \"15d489fb-30b2-42cc-bfb0-361da9712851\") " pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:18:58.856687 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.856629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15d489fb-30b2-42cc-bfb0-361da9712851-tls-cert\") pod \"authorino-7647bf59d4-gw54b\" (UID: \"15d489fb-30b2-42cc-bfb0-361da9712851\") " pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:18:58.858692 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.858659    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461b271a-f040-489e-b570-5f66581af626-kube-api-access-zkrn7" (OuterVolumeSpecName: "kube-api-access-zkrn7") pod "461b271a-f040-489e-b570-5f66581af626" (UID: "461b271a-f040-489e-b570-5f66581af626"). InnerVolumeSpecName "kube-api-access-zkrn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:18:58.859145 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.859129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15d489fb-30b2-42cc-bfb0-361da9712851-tls-cert\") pod \"authorino-7647bf59d4-gw54b\" (UID: \"15d489fb-30b2-42cc-bfb0-361da9712851\") " pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:18:58.863986 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.863970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd87p\" (UniqueName: \"kubernetes.io/projected/15d489fb-30b2-42cc-bfb0-361da9712851-kube-api-access-vd87p\") pod \"authorino-7647bf59d4-gw54b\" (UID: \"15d489fb-30b2-42cc-bfb0-361da9712851\") " pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:18:58.958077 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:58.958048    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkrn7\" (UniqueName: \"kubernetes.io/projected/461b271a-f040-489e-b570-5f66581af626-kube-api-access-zkrn7\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:18:59.043199 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.043172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:18:59.182518 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.182482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7647bf59d4-gw54b"]
Jul 24 17:18:59.185955 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:18:59.185934    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15d489fb_30b2_42cc_bfb0_361da9712851.slice/crio-42ac3c43a2bd191190047d4f0c1c2c6f07df97d16c8e24d8d863e676dc978b72 WatchSource:0}: Error finding container 42ac3c43a2bd191190047d4f0c1c2c6f07df97d16c8e24d8d863e676dc978b72: Status 404 returned error can't find the container with id 42ac3c43a2bd191190047d4f0c1c2c6f07df97d16c8e24d8d863e676dc978b72
Jul 24 17:18:59.829828 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.829717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7647bf59d4-gw54b" event={"ID":"15d489fb-30b2-42cc-bfb0-361da9712851","Type":"ContainerStarted","Data":"88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9"}
Jul 24 17:18:59.829828 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.829766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7647bf59d4-gw54b" event={"ID":"15d489fb-30b2-42cc-bfb0-361da9712851","Type":"ContainerStarted","Data":"42ac3c43a2bd191190047d4f0c1c2c6f07df97d16c8e24d8d863e676dc978b72"}
Jul 24 17:18:59.831451 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.831428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kr84j" event={"ID":"8adc79c9-cfab-40d3-8e79-ad0d2c484345","Type":"ContainerStarted","Data":"428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1"}
Jul 24 17:18:59.831451 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.831432    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58549f99d4-9xn7d"
Jul 24 17:18:59.831645 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.831450    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kr84j" podUID="8adc79c9-cfab-40d3-8e79-ad0d2c484345" containerName="authorino" containerID="cri-o://428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1" gracePeriod=30
Jul 24 17:18:59.846159 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.846109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7647bf59d4-gw54b" podStartSLOduration=1.450212976 podStartE2EDuration="1.84608887s" totalImagesPullingTime="395.875894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:59.844566135 +0000 UTC m=+532.472444014" watchObservedRunningTime="2026-07-24 17:18:59.84608887 +0000 UTC m=+532.473966722"
Jul 24 17:18:59.860619 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.860572    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kr84j" podStartSLOduration=1.398993107 podStartE2EDuration="1.860557402s" totalImagesPullingTime="461.564295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:59.859001486 +0000 UTC m=+532.486879340" watchObservedRunningTime="2026-07-24 17:18:59.860557402 +0000 UTC m=+532.488435253"
Jul 24 17:18:59.884242 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.884211    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58549f99d4-9xn7d"]
Jul 24 17:18:59.886590 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.886561    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58549f99d4-9xn7d"]
Jul 24 17:18:59.937149 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:18:59.937114    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461b271a-f040-489e-b570-5f66581af626" path="/var/lib/kubelet/pods/461b271a-f040-489e-b570-5f66581af626/volumes"
Jul 24 17:19:00.084515 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.084444    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kr84j"
Jul 24 17:19:00.168218 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.168186    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzsm7\" (UniqueName: \"kubernetes.io/projected/8adc79c9-cfab-40d3-8e79-ad0d2c484345-kube-api-access-lzsm7\") pod \"8adc79c9-cfab-40d3-8e79-ad0d2c484345\" (UID: \"8adc79c9-cfab-40d3-8e79-ad0d2c484345\") "
Jul 24 17:19:00.170268 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.170245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8adc79c9-cfab-40d3-8e79-ad0d2c484345-kube-api-access-lzsm7" (OuterVolumeSpecName: "kube-api-access-lzsm7") pod "8adc79c9-cfab-40d3-8e79-ad0d2c484345" (UID: "8adc79c9-cfab-40d3-8e79-ad0d2c484345"). InnerVolumeSpecName "kube-api-access-lzsm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:19:00.269552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.269514    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzsm7\" (UniqueName: \"kubernetes.io/projected/8adc79c9-cfab-40d3-8e79-ad0d2c484345-kube-api-access-lzsm7\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:19:00.838222 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.838134    2563 generic.go:356] "Generic (PLEG): container finished" podID="8adc79c9-cfab-40d3-8e79-ad0d2c484345" containerID="428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1" exitCode=0
Jul 24 17:19:00.838222 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.838172    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kr84j"
Jul 24 17:19:00.838697 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.838220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kr84j" event={"ID":"8adc79c9-cfab-40d3-8e79-ad0d2c484345","Type":"ContainerDied","Data":"428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1"}
Jul 24 17:19:00.838697 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.838262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kr84j" event={"ID":"8adc79c9-cfab-40d3-8e79-ad0d2c484345","Type":"ContainerDied","Data":"ae3318d474aea459149306dfe046421b776343d229bbe4702bc453b61b662033"}
Jul 24 17:19:00.838697 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.838279    2563 scope.go:117] "RemoveContainer" containerID="428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1"
Jul 24 17:19:00.847220 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.847204    2563 scope.go:117] "RemoveContainer" containerID="428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1"
Jul 24 17:19:00.847456 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:19:00.847440    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1\": container with ID starting with 428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1 not found: ID does not exist" containerID="428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1"
Jul 24 17:19:00.847523 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.847463    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1"} err="failed to get container status \"428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1\": rpc error: code = NotFound desc = could not find container \"428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1\": container with ID starting with 428392e6d369fa95a3409344ac825b6e0de1b5a745dc1886e58bd9124cadc9b1 not found: ID does not exist"
Jul 24 17:19:00.858870 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.858846    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kr84j"]
Jul 24 17:19:00.862502 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:00.862481    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kr84j"]
Jul 24 17:19:01.937137 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:01.937098    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8adc79c9-cfab-40d3-8e79-ad0d2c484345" path="/var/lib/kubelet/pods/8adc79c9-cfab-40d3-8e79-ad0d2c484345/volumes"
Jul 24 17:19:04.540574 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.540540    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f7c655fbd-zgth2"]
Jul 24 17:19:04.541083 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.540968    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adc79c9-cfab-40d3-8e79-ad0d2c484345" containerName="authorino"
Jul 24 17:19:04.541083 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.540979    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adc79c9-cfab-40d3-8e79-ad0d2c484345" containerName="authorino"
Jul 24 17:19:04.541083 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.541038    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adc79c9-cfab-40d3-8e79-ad0d2c484345" containerName="authorino"
Jul 24 17:19:04.751306 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.751271    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f7c655fbd-zgth2"]
Jul 24 17:19:04.751469 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.751377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:04.754227 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.754158    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 17:19:04.754227 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.754212    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 17:19:04.754430 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.754222    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5lnmt\""
Jul 24 17:19:04.809780 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.809700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df4369a0-9bc3-4dba-b5c9-390341c8ef04-webhook-cert\") pod \"maas-controller-6f7c655fbd-zgth2\" (UID: \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\") " pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:04.809780 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.809747    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq78c\" (UniqueName: \"kubernetes.io/projected/df4369a0-9bc3-4dba-b5c9-390341c8ef04-kube-api-access-cq78c\") pod \"maas-controller-6f7c655fbd-zgth2\" (UID: \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\") " pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:04.911037 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.911003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df4369a0-9bc3-4dba-b5c9-390341c8ef04-webhook-cert\") pod \"maas-controller-6f7c655fbd-zgth2\" (UID: \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\") " pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:04.911206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.911047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq78c\" (UniqueName: \"kubernetes.io/projected/df4369a0-9bc3-4dba-b5c9-390341c8ef04-kube-api-access-cq78c\") pod \"maas-controller-6f7c655fbd-zgth2\" (UID: \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\") " pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:04.913618 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.913599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df4369a0-9bc3-4dba-b5c9-390341c8ef04-webhook-cert\") pod \"maas-controller-6f7c655fbd-zgth2\" (UID: \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\") " pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:04.920819 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:04.920769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq78c\" (UniqueName: \"kubernetes.io/projected/df4369a0-9bc3-4dba-b5c9-390341c8ef04-kube-api-access-cq78c\") pod \"maas-controller-6f7c655fbd-zgth2\" (UID: \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\") " pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:05.061418 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:05.061332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:05.214495 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:05.214472    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f7c655fbd-zgth2"]
Jul 24 17:19:05.216049 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:19:05.216022    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4369a0_9bc3_4dba_b5c9_390341c8ef04.slice/crio-1248083d0c4fa383f99d7ccb546d559bcd38853a1189f9d56a60bec1424514b9 WatchSource:0}: Error finding container 1248083d0c4fa383f99d7ccb546d559bcd38853a1189f9d56a60bec1424514b9: Status 404 returned error can't find the container with id 1248083d0c4fa383f99d7ccb546d559bcd38853a1189f9d56a60bec1424514b9
Jul 24 17:19:05.872378 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:05.872337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7c655fbd-zgth2" event={"ID":"df4369a0-9bc3-4dba-b5c9-390341c8ef04","Type":"ContainerStarted","Data":"1248083d0c4fa383f99d7ccb546d559bcd38853a1189f9d56a60bec1424514b9"}
Jul 24 17:19:07.886438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:07.886342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7c655fbd-zgth2" event={"ID":"df4369a0-9bc3-4dba-b5c9-390341c8ef04","Type":"ContainerStarted","Data":"83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e"}
Jul 24 17:19:07.886878 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:07.886439    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:07.905887 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:07.905834    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f7c655fbd-zgth2" podStartSLOduration=1.689821751 podStartE2EDuration="3.905816205s" totalImagesPullingTime="2.215994454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:19:07.904092501 +0000 UTC m=+540.531970354" watchObservedRunningTime="2026-07-24 17:19:07.905816205 +0000 UTC m=+540.533694058"
Jul 24 17:19:18.895412 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:18.895379    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:19.660011 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.659979    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f7c655fbd-zgth2"]
Jul 24 17:19:19.660192 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.660162    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f7c655fbd-zgth2" podUID="df4369a0-9bc3-4dba-b5c9-390341c8ef04" containerName="manager" containerID="cri-o://83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e" gracePeriod=30
Jul 24 17:19:19.908973 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.908950    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:19.950473 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.950396    2563 generic.go:356] "Generic (PLEG): container finished" podID="df4369a0-9bc3-4dba-b5c9-390341c8ef04" containerID="83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e" exitCode=0
Jul 24 17:19:19.950473 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.950449    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7c655fbd-zgth2"
Jul 24 17:19:19.950654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.950489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7c655fbd-zgth2" event={"ID":"df4369a0-9bc3-4dba-b5c9-390341c8ef04","Type":"ContainerDied","Data":"83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e"}
Jul 24 17:19:19.950654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.950540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7c655fbd-zgth2" event={"ID":"df4369a0-9bc3-4dba-b5c9-390341c8ef04","Type":"ContainerDied","Data":"1248083d0c4fa383f99d7ccb546d559bcd38853a1189f9d56a60bec1424514b9"}
Jul 24 17:19:19.950654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.950568    2563 scope.go:117] "RemoveContainer" containerID="83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e"
Jul 24 17:19:19.959499 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.959484    2563 scope.go:117] "RemoveContainer" containerID="83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e"
Jul 24 17:19:19.959743 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:19:19.959719    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e\": container with ID starting with 83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e not found: ID does not exist" containerID="83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e"
Jul 24 17:19:19.959874 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:19.959749    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e"} err="failed to get container status \"83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e\": rpc error: code = NotFound desc = could not find container \"83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e\": container with ID starting with 83cd8a6dfb73b0b178cb45bf242dfd0f756d1363fe047845e44c33e8fd87b15e not found: ID does not exist"
Jul 24 17:19:20.055262 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:20.055228    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq78c\" (UniqueName: \"kubernetes.io/projected/df4369a0-9bc3-4dba-b5c9-390341c8ef04-kube-api-access-cq78c\") pod \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\" (UID: \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\") "
Jul 24 17:19:20.055465 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:20.055353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df4369a0-9bc3-4dba-b5c9-390341c8ef04-webhook-cert\") pod \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\" (UID: \"df4369a0-9bc3-4dba-b5c9-390341c8ef04\") "
Jul 24 17:19:20.057777 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:20.057747    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df4369a0-9bc3-4dba-b5c9-390341c8ef04-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "df4369a0-9bc3-4dba-b5c9-390341c8ef04" (UID: "df4369a0-9bc3-4dba-b5c9-390341c8ef04"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:19:20.057777 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:20.057763    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df4369a0-9bc3-4dba-b5c9-390341c8ef04-kube-api-access-cq78c" (OuterVolumeSpecName: "kube-api-access-cq78c") pod "df4369a0-9bc3-4dba-b5c9-390341c8ef04" (UID: "df4369a0-9bc3-4dba-b5c9-390341c8ef04"). InnerVolumeSpecName "kube-api-access-cq78c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:19:20.156949 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:20.156921    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df4369a0-9bc3-4dba-b5c9-390341c8ef04-webhook-cert\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:19:20.156949 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:20.156947    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq78c\" (UniqueName: \"kubernetes.io/projected/df4369a0-9bc3-4dba-b5c9-390341c8ef04-kube-api-access-cq78c\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:19:20.274055 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:20.274026    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f7c655fbd-zgth2"]
Jul 24 17:19:20.277928 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:20.277905    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f7c655fbd-zgth2"]
Jul 24 17:19:21.936664 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:21.936630    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df4369a0-9bc3-4dba-b5c9-390341c8ef04" path="/var/lib/kubelet/pods/df4369a0-9bc3-4dba-b5c9-390341c8ef04/volumes"
Jul 24 17:19:39.923348 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:39.923313    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"]
Jul 24 17:19:39.923817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:39.923695    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df4369a0-9bc3-4dba-b5c9-390341c8ef04" containerName="manager"
Jul 24 17:19:39.923817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:39.923706    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="df4369a0-9bc3-4dba-b5c9-390341c8ef04" containerName="manager"
Jul 24 17:19:39.923817 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:39.923783    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="df4369a0-9bc3-4dba-b5c9-390341c8ef04" containerName="manager"
Jul 24 17:19:39.927097 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:39.927076    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:39.931621 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:39.931591    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7gnds\""
Jul 24 17:19:39.931621 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:39.931597    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 24 17:19:39.951946 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:39.951917    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"]
Jul 24 17:19:40.016054 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.016021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/915b6c04-a671-400e-9fca-2812cdc9fb6e-openshift-service-ca\") pod \"maas-api-6f46495b76-m2lrd\" (UID: \"915b6c04-a671-400e-9fca-2812cdc9fb6e\") " pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.016207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.016064    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sll24\" (UniqueName: \"kubernetes.io/projected/915b6c04-a671-400e-9fca-2812cdc9fb6e-kube-api-access-sll24\") pod \"maas-api-6f46495b76-m2lrd\" (UID: \"915b6c04-a671-400e-9fca-2812cdc9fb6e\") " pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.016207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.016161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/915b6c04-a671-400e-9fca-2812cdc9fb6e-maas-api-tls\") pod \"maas-api-6f46495b76-m2lrd\" (UID: \"915b6c04-a671-400e-9fca-2812cdc9fb6e\") " pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.117522 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.117490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/915b6c04-a671-400e-9fca-2812cdc9fb6e-maas-api-tls\") pod \"maas-api-6f46495b76-m2lrd\" (UID: \"915b6c04-a671-400e-9fca-2812cdc9fb6e\") " pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.117730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.117576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/915b6c04-a671-400e-9fca-2812cdc9fb6e-openshift-service-ca\") pod \"maas-api-6f46495b76-m2lrd\" (UID: \"915b6c04-a671-400e-9fca-2812cdc9fb6e\") " pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.117730 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.117608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sll24\" (UniqueName: \"kubernetes.io/projected/915b6c04-a671-400e-9fca-2812cdc9fb6e-kube-api-access-sll24\") pod \"maas-api-6f46495b76-m2lrd\" (UID: \"915b6c04-a671-400e-9fca-2812cdc9fb6e\") " pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.118343 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.118278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/915b6c04-a671-400e-9fca-2812cdc9fb6e-openshift-service-ca\") pod \"maas-api-6f46495b76-m2lrd\" (UID: \"915b6c04-a671-400e-9fca-2812cdc9fb6e\") " pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.120242 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.120219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/915b6c04-a671-400e-9fca-2812cdc9fb6e-maas-api-tls\") pod \"maas-api-6f46495b76-m2lrd\" (UID: \"915b6c04-a671-400e-9fca-2812cdc9fb6e\") " pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.127268 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.127242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sll24\" (UniqueName: \"kubernetes.io/projected/915b6c04-a671-400e-9fca-2812cdc9fb6e-kube-api-access-sll24\") pod \"maas-api-6f46495b76-m2lrd\" (UID: \"915b6c04-a671-400e-9fca-2812cdc9fb6e\") " pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.238008 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.237917    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:40.382151 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.382126    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"]
Jul 24 17:19:40.384026 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:19:40.384002    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915b6c04_a671_400e_9fca_2812cdc9fb6e.slice/crio-fba217f4a9e61463f9f6de26effcb71b2d659759086e902a4a3dbcaa6bdb5210 WatchSource:0}: Error finding container fba217f4a9e61463f9f6de26effcb71b2d659759086e902a4a3dbcaa6bdb5210: Status 404 returned error can't find the container with id fba217f4a9e61463f9f6de26effcb71b2d659759086e902a4a3dbcaa6bdb5210
Jul 24 17:19:40.742766 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.742726    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-44t9h"]
Jul 24 17:19:40.746371 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.746350    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:19:40.749186 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.749160    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 17:19:40.749322 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.749266    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k5452\""
Jul 24 17:19:40.759343 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.759314    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-44t9h"]
Jul 24 17:19:40.824143 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.824111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfbfdcdc-ff69-44e5-afea-1aac1f907044-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-44t9h\" (UID: \"dfbfdcdc-ff69-44e5-afea-1aac1f907044\") " pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:19:40.824331 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.824181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslkn\" (UniqueName: \"kubernetes.io/projected/dfbfdcdc-ff69-44e5-afea-1aac1f907044-kube-api-access-cslkn\") pod \"payload-processing-5cc6cd444b-44t9h\" (UID: \"dfbfdcdc-ff69-44e5-afea-1aac1f907044\") " pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:19:40.925330 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.925301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslkn\" (UniqueName: \"kubernetes.io/projected/dfbfdcdc-ff69-44e5-afea-1aac1f907044-kube-api-access-cslkn\") pod \"payload-processing-5cc6cd444b-44t9h\" (UID: \"dfbfdcdc-ff69-44e5-afea-1aac1f907044\") " pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:19:40.925727 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.925372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfbfdcdc-ff69-44e5-afea-1aac1f907044-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-44t9h\" (UID: \"dfbfdcdc-ff69-44e5-afea-1aac1f907044\") " pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:19:40.926084 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.926060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfbfdcdc-ff69-44e5-afea-1aac1f907044-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-44t9h\" (UID: \"dfbfdcdc-ff69-44e5-afea-1aac1f907044\") " pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:19:40.934233 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:40.934211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslkn\" (UniqueName: \"kubernetes.io/projected/dfbfdcdc-ff69-44e5-afea-1aac1f907044-kube-api-access-cslkn\") pod \"payload-processing-5cc6cd444b-44t9h\" (UID: \"dfbfdcdc-ff69-44e5-afea-1aac1f907044\") " pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:19:41.058077 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:41.057993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:19:41.062886 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:41.062858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd" event={"ID":"915b6c04-a671-400e-9fca-2812cdc9fb6e","Type":"ContainerStarted","Data":"fba217f4a9e61463f9f6de26effcb71b2d659759086e902a4a3dbcaa6bdb5210"}
Jul 24 17:19:41.216832 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:41.216653    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-44t9h"]
Jul 24 17:19:41.221028 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:19:41.220997    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbfdcdc_ff69_44e5_afea_1aac1f907044.slice/crio-1ebc5befe766b550d38b9e9f72b61d66a08b7e025ba571913bfcdd4c9e0f2d87 WatchSource:0}: Error finding container 1ebc5befe766b550d38b9e9f72b61d66a08b7e025ba571913bfcdd4c9e0f2d87: Status 404 returned error can't find the container with id 1ebc5befe766b550d38b9e9f72b61d66a08b7e025ba571913bfcdd4c9e0f2d87
Jul 24 17:19:42.080214 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:42.080171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h" event={"ID":"dfbfdcdc-ff69-44e5-afea-1aac1f907044","Type":"ContainerStarted","Data":"1ebc5befe766b550d38b9e9f72b61d66a08b7e025ba571913bfcdd4c9e0f2d87"}
Jul 24 17:19:43.088200 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:43.088102    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h" event={"ID":"dfbfdcdc-ff69-44e5-afea-1aac1f907044","Type":"ContainerStarted","Data":"a37c1aafb509123c6b10aec5c33a1c060b7d80f641aeb61dcffaa2e9e7d34f80"}
Jul 24 17:19:43.088200 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:43.088168    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:19:43.089663 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:43.089638    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd" event={"ID":"915b6c04-a671-400e-9fca-2812cdc9fb6e","Type":"ContainerStarted","Data":"c0781d966c9ccd8ea7859dd5d767aee0327e3b4bc724c990de1bfef30755412d"}
Jul 24 17:19:43.089823 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:43.089765    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:43.113605 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:43.113559    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h" podStartSLOduration=1.608551936 podStartE2EDuration="3.113546777s" totalImagesPullingTime="1.504994841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:19:43.112658354 +0000 UTC m=+575.740536210" watchObservedRunningTime="2026-07-24 17:19:43.113546777 +0000 UTC m=+575.741424629"
Jul 24 17:19:43.133931 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:43.133892    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd" podStartSLOduration=2.308440126 podStartE2EDuration="4.133875261s" totalImagesPullingTime="1.825435135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:19:43.132355278 +0000 UTC m=+575.760233129" watchObservedRunningTime="2026-07-24 17:19:43.133875261 +0000 UTC m=+575.761753112"
Jul 24 17:19:49.100625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:49.100594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6f46495b76-m2lrd"
Jul 24 17:19:54.096742 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:19:54.096714    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-44t9h"
Jul 24 17:20:07.862266 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:07.862242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:20:07.862744 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:07.862242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:20:18.072948 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.068910    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"]
Jul 24 17:20:18.079283 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.079260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.084727 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.084698    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 17:20:18.084887 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.084733    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 17:20:18.084887 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.084756    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 24 17:20:18.085101 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.085081    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7nbv9\""
Jul 24 17:20:18.086278 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.086259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"]
Jul 24 17:20:18.254466 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.254430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8db66891-f242-42f0-9acc-613bf68c321b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.254640 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.254478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.254640 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.254499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.254640 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.254527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd24r\" (UniqueName: \"kubernetes.io/projected/8db66891-f242-42f0-9acc-613bf68c321b-kube-api-access-vd24r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.254640 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.254581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.254640 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.254613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.355267 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.355179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.355267 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.355220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.355267 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.355247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd24r\" (UniqueName: \"kubernetes.io/projected/8db66891-f242-42f0-9acc-613bf68c321b-kube-api-access-vd24r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.355506 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.355280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.355506 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.355322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.355506 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.355402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8db66891-f242-42f0-9acc-613bf68c321b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.355663 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.355642    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.355781 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.355746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.355889 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.355871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.357827 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.357769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8db66891-f242-42f0-9acc-613bf68c321b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.357947 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.357867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8db66891-f242-42f0-9acc-613bf68c321b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.365011 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.364990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd24r\" (UniqueName: \"kubernetes.io/projected/8db66891-f242-42f0-9acc-613bf68c321b-kube-api-access-vd24r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jqsnk\" (UID: \"8db66891-f242-42f0-9acc-613bf68c321b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.391028 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.390999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:18.540372 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:18.540343    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"]
Jul 24 17:20:18.541333 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:20:18.541308    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db66891_f242_42f0_9acc_613bf68c321b.slice/crio-53a64c3580542f2209ddbaff5fd40487fab17b100b4eb4957073008c58baca30 WatchSource:0}: Error finding container 53a64c3580542f2209ddbaff5fd40487fab17b100b4eb4957073008c58baca30: Status 404 returned error can't find the container with id 53a64c3580542f2209ddbaff5fd40487fab17b100b4eb4957073008c58baca30
Jul 24 17:20:19.286684 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:19.286644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk" event={"ID":"8db66891-f242-42f0-9acc-613bf68c321b","Type":"ContainerStarted","Data":"53a64c3580542f2209ddbaff5fd40487fab17b100b4eb4957073008c58baca30"}
Jul 24 17:20:20.293598 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:20.293564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk" event={"ID":"8db66891-f242-42f0-9acc-613bf68c321b","Type":"ContainerStarted","Data":"0dacabc6219c87af97c1160defb376cf0adb3894e144535e4898f548c6bcc60d"}
Jul 24 17:20:20.322508 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:20.322457    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk" podStartSLOduration=1.149353644 podStartE2EDuration="2.322442094s" totalImagesPullingTime="1.17308845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:20.318146696 +0000 UTC m=+612.946024645" watchObservedRunningTime="2026-07-24 17:20:20.322442094 +0000 UTC m=+612.950319945"
Jul 24 17:20:25.947188 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:25.947158    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"]
Jul 24 17:20:25.950806 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:25.950762    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:25.953670 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:25.953648    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 24 17:20:25.962929 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:25.962909    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"]
Jul 24 17:20:26.023720 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.023694    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.023875 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.023743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.023875 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.023828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.023875 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.023861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.024021 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.023883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.024021 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.023910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvdsd\" (UniqueName: \"kubernetes.io/projected/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-kube-api-access-jvdsd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.124551 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.124515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.124709 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.124564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.124709 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.124598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.124709 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.124627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.124709 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.124663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvdsd\" (UniqueName: \"kubernetes.io/projected/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-kube-api-access-jvdsd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.124949 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.124757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.124949 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.124935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.125205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.125172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.125205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.125191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.127138 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.127115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.127632 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.127612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.134081 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.134056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvdsd\" (UniqueName: \"kubernetes.io/projected/dace38e1-8367-4ac8-8f18-dfb5ff8f3674-kube-api-access-jvdsd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dsmbb\" (UID: \"dace38e1-8367-4ac8-8f18-dfb5ff8f3674\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.261063 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.260988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:26.407960 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.407933    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"]
Jul 24 17:20:26.409017 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:20:26.408991    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddace38e1_8367_4ac8_8f18_dfb5ff8f3674.slice/crio-fa98a0a2dbe5e00f94f407adfbb5e5000eab34dbb9578ab16e2c2bb0e677e07b WatchSource:0}: Error finding container fa98a0a2dbe5e00f94f407adfbb5e5000eab34dbb9578ab16e2c2bb0e677e07b: Status 404 returned error can't find the container with id fa98a0a2dbe5e00f94f407adfbb5e5000eab34dbb9578ab16e2c2bb0e677e07b
Jul 24 17:20:26.410388 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:26.410370    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:20:27.333867 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:27.333828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb" event={"ID":"dace38e1-8367-4ac8-8f18-dfb5ff8f3674","Type":"ContainerStarted","Data":"bdb53b25a30b3bed55fee94b6e75ec7d670f02096a74f5c6b4153e5cb220dc89"}
Jul 24 17:20:27.334318 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:27.333880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb" event={"ID":"dace38e1-8367-4ac8-8f18-dfb5ff8f3674","Type":"ContainerStarted","Data":"fa98a0a2dbe5e00f94f407adfbb5e5000eab34dbb9578ab16e2c2bb0e677e07b"}
Jul 24 17:20:27.359179 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:27.359124    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb" podStartSLOduration=2.171624445 podStartE2EDuration="2.359109303s" totalImagesPullingTime="187.484858ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:27.356747433 +0000 UTC m=+619.984625285" watchObservedRunningTime="2026-07-24 17:20:27.359109303 +0000 UTC m=+619.986987155"
Jul 24 17:20:28.391142 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:28.391108    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:28.391633 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:28.391218    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:28.404748 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:28.404722    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:29.356868 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:29.356780    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jqsnk"
Jul 24 17:20:36.261967 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:36.261933    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:36.262354 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:36.262031    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:36.275322 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:36.275299    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:20:36.403661 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:20:36.403626    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dsmbb"
Jul 24 17:22:04.897295 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:04.897200    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68d8dcb677-ndrsf"]
Jul 24 17:22:04.900619 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:04.900602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d8dcb677-ndrsf"
Jul 24 17:22:04.908836 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:04.908699    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68d8dcb677-ndrsf"]
Jul 24 17:22:04.984717 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:04.984687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5dc0b41b-995a-44c2-ad43-511bcaf585a5-tls-cert\") pod \"authorino-68d8dcb677-ndrsf\" (UID: \"5dc0b41b-995a-44c2-ad43-511bcaf585a5\") " pod="kuadrant-system/authorino-68d8dcb677-ndrsf"
Jul 24 17:22:04.984889 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:04.984741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swzqj\" (UniqueName: \"kubernetes.io/projected/5dc0b41b-995a-44c2-ad43-511bcaf585a5-kube-api-access-swzqj\") pod \"authorino-68d8dcb677-ndrsf\" (UID: \"5dc0b41b-995a-44c2-ad43-511bcaf585a5\") " pod="kuadrant-system/authorino-68d8dcb677-ndrsf"
Jul 24 17:22:05.086172 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.086144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swzqj\" (UniqueName: \"kubernetes.io/projected/5dc0b41b-995a-44c2-ad43-511bcaf585a5-kube-api-access-swzqj\") pod \"authorino-68d8dcb677-ndrsf\" (UID: \"5dc0b41b-995a-44c2-ad43-511bcaf585a5\") " pod="kuadrant-system/authorino-68d8dcb677-ndrsf"
Jul 24 17:22:05.086334 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.086230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5dc0b41b-995a-44c2-ad43-511bcaf585a5-tls-cert\") pod \"authorino-68d8dcb677-ndrsf\" (UID: \"5dc0b41b-995a-44c2-ad43-511bcaf585a5\") " pod="kuadrant-system/authorino-68d8dcb677-ndrsf"
Jul 24 17:22:05.088924 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.088902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5dc0b41b-995a-44c2-ad43-511bcaf585a5-tls-cert\") pod \"authorino-68d8dcb677-ndrsf\" (UID: \"5dc0b41b-995a-44c2-ad43-511bcaf585a5\") " pod="kuadrant-system/authorino-68d8dcb677-ndrsf"
Jul 24 17:22:05.095976 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.095948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swzqj\" (UniqueName: \"kubernetes.io/projected/5dc0b41b-995a-44c2-ad43-511bcaf585a5-kube-api-access-swzqj\") pod \"authorino-68d8dcb677-ndrsf\" (UID: \"5dc0b41b-995a-44c2-ad43-511bcaf585a5\") " pod="kuadrant-system/authorino-68d8dcb677-ndrsf"
Jul 24 17:22:05.212398 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.212364    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d8dcb677-ndrsf"
Jul 24 17:22:05.351996 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.351969    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68d8dcb677-ndrsf"]
Jul 24 17:22:05.353440 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:22:05.353412    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dc0b41b_995a_44c2_ad43_511bcaf585a5.slice/crio-ed0af810841bcc00a51e58e5edb2be90192796554291eaef9a481db1ab5a088f WatchSource:0}: Error finding container ed0af810841bcc00a51e58e5edb2be90192796554291eaef9a481db1ab5a088f: Status 404 returned error can't find the container with id ed0af810841bcc00a51e58e5edb2be90192796554291eaef9a481db1ab5a088f
Jul 24 17:22:05.911663 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.911612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68d8dcb677-ndrsf" event={"ID":"5dc0b41b-995a-44c2-ad43-511bcaf585a5","Type":"ContainerStarted","Data":"16bf1eb368ce90da93191f76438859c7580297b14baf72c3dab529e39a49f45c"}
Jul 24 17:22:05.912166 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.911676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68d8dcb677-ndrsf" event={"ID":"5dc0b41b-995a-44c2-ad43-511bcaf585a5","Type":"ContainerStarted","Data":"ed0af810841bcc00a51e58e5edb2be90192796554291eaef9a481db1ab5a088f"}
Jul 24 17:22:05.929215 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.929166    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68d8dcb677-ndrsf" podStartSLOduration=1.532249425 podStartE2EDuration="1.929152278s" totalImagesPullingTime="396.902853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:05.927211609 +0000 UTC m=+718.555089474" watchObservedRunningTime="2026-07-24 17:22:05.929152278 +0000 UTC m=+718.557030130"
Jul 24 17:22:05.955591 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.955557    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7647bf59d4-gw54b"]
Jul 24 17:22:05.955849 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:05.955763    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7647bf59d4-gw54b" podUID="15d489fb-30b2-42cc-bfb0-361da9712851" containerName="authorino" containerID="cri-o://88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9" gracePeriod=30
Jul 24 17:22:06.234121 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.234093    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:22:06.400944 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.400145    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15d489fb-30b2-42cc-bfb0-361da9712851-tls-cert\") pod \"15d489fb-30b2-42cc-bfb0-361da9712851\" (UID: \"15d489fb-30b2-42cc-bfb0-361da9712851\") "
Jul 24 17:22:06.400944 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.400318    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd87p\" (UniqueName: \"kubernetes.io/projected/15d489fb-30b2-42cc-bfb0-361da9712851-kube-api-access-vd87p\") pod \"15d489fb-30b2-42cc-bfb0-361da9712851\" (UID: \"15d489fb-30b2-42cc-bfb0-361da9712851\") "
Jul 24 17:22:06.407482 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.407440    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d489fb-30b2-42cc-bfb0-361da9712851-kube-api-access-vd87p" (OuterVolumeSpecName: "kube-api-access-vd87p") pod "15d489fb-30b2-42cc-bfb0-361da9712851" (UID: "15d489fb-30b2-42cc-bfb0-361da9712851"). InnerVolumeSpecName "kube-api-access-vd87p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:22:06.418907 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.418873    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15d489fb-30b2-42cc-bfb0-361da9712851-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "15d489fb-30b2-42cc-bfb0-361da9712851" (UID: "15d489fb-30b2-42cc-bfb0-361da9712851"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:22:06.501586 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.501545    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd87p\" (UniqueName: \"kubernetes.io/projected/15d489fb-30b2-42cc-bfb0-361da9712851-kube-api-access-vd87p\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:22:06.501586 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.501589    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15d489fb-30b2-42cc-bfb0-361da9712851-tls-cert\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:22:06.919489 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.919445    2563 generic.go:356] "Generic (PLEG): container finished" podID="15d489fb-30b2-42cc-bfb0-361da9712851" containerID="88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9" exitCode=0
Jul 24 17:22:06.919489 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.919488    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7647bf59d4-gw54b"
Jul 24 17:22:06.920115 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.919525    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7647bf59d4-gw54b" event={"ID":"15d489fb-30b2-42cc-bfb0-361da9712851","Type":"ContainerDied","Data":"88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9"}
Jul 24 17:22:06.920115 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.919569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7647bf59d4-gw54b" event={"ID":"15d489fb-30b2-42cc-bfb0-361da9712851","Type":"ContainerDied","Data":"42ac3c43a2bd191190047d4f0c1c2c6f07df97d16c8e24d8d863e676dc978b72"}
Jul 24 17:22:06.920115 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.919587    2563 scope.go:117] "RemoveContainer" containerID="88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9"
Jul 24 17:22:06.930488 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.930464    2563 scope.go:117] "RemoveContainer" containerID="88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9"
Jul 24 17:22:06.930753 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:22:06.930734    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9\": container with ID starting with 88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9 not found: ID does not exist" containerID="88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9"
Jul 24 17:22:06.930861 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.930762    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9"} err="failed to get container status \"88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9\": rpc error: code = NotFound desc = could not find container \"88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9\": container with ID starting with 88921db5cb754c72f70b9557f8623b25f8e427e606b2a6d3e78563b7c7737ab9 not found: ID does not exist"
Jul 24 17:22:06.943222 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.943191    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7647bf59d4-gw54b"]
Jul 24 17:22:06.955267 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:06.955231    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7647bf59d4-gw54b"]
Jul 24 17:22:07.937047 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:22:07.937020    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d489fb-30b2-42cc-bfb0-361da9712851" path="/var/lib/kubelet/pods/15d489fb-30b2-42cc-bfb0-361da9712851/volumes"
Jul 24 17:25:07.898372 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:25:07.898292    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:25:07.900602 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:25:07.900565    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:28:55.883786 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:55.883682    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"]
Jul 24 17:28:55.884322 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:55.883978    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw" podUID="9b5787e9-0060-46b1-ba70-4d706611cdb9" containerName="manager" containerID="cri-o://e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357" gracePeriod=10
Jul 24 17:28:58.441069 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:58.441044    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:28:58.615962 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:58.615863    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x85m\" (UniqueName: \"kubernetes.io/projected/9b5787e9-0060-46b1-ba70-4d706611cdb9-kube-api-access-8x85m\") pod \"9b5787e9-0060-46b1-ba70-4d706611cdb9\" (UID: \"9b5787e9-0060-46b1-ba70-4d706611cdb9\") "
Jul 24 17:28:58.616128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:58.615982    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5787e9-0060-46b1-ba70-4d706611cdb9-extensions-socket-volume\") pod \"9b5787e9-0060-46b1-ba70-4d706611cdb9\" (UID: \"9b5787e9-0060-46b1-ba70-4d706611cdb9\") "
Jul 24 17:28:58.616338 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:58.616317    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b5787e9-0060-46b1-ba70-4d706611cdb9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b5787e9-0060-46b1-ba70-4d706611cdb9" (UID: "9b5787e9-0060-46b1-ba70-4d706611cdb9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:28:58.618214 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:58.618186    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5787e9-0060-46b1-ba70-4d706611cdb9-kube-api-access-8x85m" (OuterVolumeSpecName: "kube-api-access-8x85m") pod "9b5787e9-0060-46b1-ba70-4d706611cdb9" (UID: "9b5787e9-0060-46b1-ba70-4d706611cdb9"). InnerVolumeSpecName "kube-api-access-8x85m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:28:58.717642 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:58.717603    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5787e9-0060-46b1-ba70-4d706611cdb9-extensions-socket-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:28:58.717642 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:58.717634    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x85m\" (UniqueName: \"kubernetes.io/projected/9b5787e9-0060-46b1-ba70-4d706611cdb9-kube-api-access-8x85m\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:28:59.275025 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.274995    2563 generic.go:356] "Generic (PLEG): container finished" podID="9b5787e9-0060-46b1-ba70-4d706611cdb9" containerID="e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357" exitCode=0
Jul 24 17:28:59.275191 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.275041    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"
Jul 24 17:28:59.275191 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.275081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw" event={"ID":"9b5787e9-0060-46b1-ba70-4d706611cdb9","Type":"ContainerDied","Data":"e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357"}
Jul 24 17:28:59.275191 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.275141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw" event={"ID":"9b5787e9-0060-46b1-ba70-4d706611cdb9","Type":"ContainerDied","Data":"9e864d88296dc6adecd0c4a623127f9339ea6eeab01d8f7587dd06f2646424e0"}
Jul 24 17:28:59.275191 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.275170    2563 scope.go:117] "RemoveContainer" containerID="e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357"
Jul 24 17:28:59.285642 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.285620    2563 scope.go:117] "RemoveContainer" containerID="e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357"
Jul 24 17:28:59.285916 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:28:59.285898    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357\": container with ID starting with e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357 not found: ID does not exist" containerID="e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357"
Jul 24 17:28:59.285973 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.285925    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357"} err="failed to get container status \"e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357\": rpc error: code = NotFound desc = could not find container \"e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357\": container with ID starting with e7cbfef597206e9fde1b4d7aaeb7e96bd3460c135c2f607fd1adf02a878bc357 not found: ID does not exist"
Jul 24 17:28:59.298937 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.298916    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"]
Jul 24 17:28:59.302482 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.302463    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-76vsw"]
Jul 24 17:28:59.937969 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:28:59.937942    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5787e9-0060-46b1-ba70-4d706611cdb9" path="/var/lib/kubelet/pods/9b5787e9-0060-46b1-ba70-4d706611cdb9/volumes"
Jul 24 17:29:56.994392 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:56.994355    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"]
Jul 24 17:29:56.994846 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:56.994758    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5787e9-0060-46b1-ba70-4d706611cdb9" containerName="manager"
Jul 24 17:29:56.994846 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:56.994768    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5787e9-0060-46b1-ba70-4d706611cdb9" containerName="manager"
Jul 24 17:29:56.994846 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:56.994787    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d489fb-30b2-42cc-bfb0-361da9712851" containerName="authorino"
Jul 24 17:29:56.994846 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:56.994809    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d489fb-30b2-42cc-bfb0-361da9712851" containerName="authorino"
Jul 24 17:29:56.994986 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:56.994901    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b5787e9-0060-46b1-ba70-4d706611cdb9" containerName="manager"
Jul 24 17:29:56.994986 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:56.994908    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d489fb-30b2-42cc-bfb0-361da9712851" containerName="authorino"
Jul 24 17:29:56.998107 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:56.998089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:29:57.000905 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.000883    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7l84j\""
Jul 24 17:29:57.010096 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.010074    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"]
Jul 24 17:29:57.110832 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.110770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv8p7\" (UniqueName: \"kubernetes.io/projected/3cbccdb0-1da6-4c77-9abb-cb52295c7b27-kube-api-access-gv8p7\") pod \"kuadrant-operator-controller-manager-86878c769f-gtfv2\" (UID: \"3cbccdb0-1da6-4c77-9abb-cb52295c7b27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:29:57.111009 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.110969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3cbccdb0-1da6-4c77-9abb-cb52295c7b27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gtfv2\" (UID: \"3cbccdb0-1da6-4c77-9abb-cb52295c7b27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:29:57.212204 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.212162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3cbccdb0-1da6-4c77-9abb-cb52295c7b27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gtfv2\" (UID: \"3cbccdb0-1da6-4c77-9abb-cb52295c7b27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:29:57.212387 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.212232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv8p7\" (UniqueName: \"kubernetes.io/projected/3cbccdb0-1da6-4c77-9abb-cb52295c7b27-kube-api-access-gv8p7\") pod \"kuadrant-operator-controller-manager-86878c769f-gtfv2\" (UID: \"3cbccdb0-1da6-4c77-9abb-cb52295c7b27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:29:57.212546 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.212525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3cbccdb0-1da6-4c77-9abb-cb52295c7b27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gtfv2\" (UID: \"3cbccdb0-1da6-4c77-9abb-cb52295c7b27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:29:57.220722 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.220698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv8p7\" (UniqueName: \"kubernetes.io/projected/3cbccdb0-1da6-4c77-9abb-cb52295c7b27-kube-api-access-gv8p7\") pod \"kuadrant-operator-controller-manager-86878c769f-gtfv2\" (UID: \"3cbccdb0-1da6-4c77-9abb-cb52295c7b27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:29:57.309010 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.308935    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:29:57.452119 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.452094    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"]
Jul 24 17:29:57.453524 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:29:57.453495    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cbccdb0_1da6_4c77_9abb_cb52295c7b27.slice/crio-6a3d6b1ea0a282fd994cc196666c434b9ea844c61bc3e0baaa2955c5e0aa009a WatchSource:0}: Error finding container 6a3d6b1ea0a282fd994cc196666c434b9ea844c61bc3e0baaa2955c5e0aa009a: Status 404 returned error can't find the container with id 6a3d6b1ea0a282fd994cc196666c434b9ea844c61bc3e0baaa2955c5e0aa009a
Jul 24 17:29:57.603129 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.603041    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2" event={"ID":"3cbccdb0-1da6-4c77-9abb-cb52295c7b27","Type":"ContainerStarted","Data":"3cec0190bc10c895a77fc824ac67a4a7ea073f6435117f4e67377c4ccbe9da46"}
Jul 24 17:29:57.603129 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.603099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2" event={"ID":"3cbccdb0-1da6-4c77-9abb-cb52295c7b27","Type":"ContainerStarted","Data":"6a3d6b1ea0a282fd994cc196666c434b9ea844c61bc3e0baaa2955c5e0aa009a"}
Jul 24 17:29:57.603376 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.603268    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:29:57.622854 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:29:57.622774    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2" podStartSLOduration=1.622758954 podStartE2EDuration="1.622758954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:29:57.62056946 +0000 UTC m=+1190.248447312" watchObservedRunningTime="2026-07-24 17:29:57.622758954 +0000 UTC m=+1190.250636805"
Jul 24 17:30:07.935163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:30:07.935129    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:30:07.940527 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:30:07.940501    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:30:08.611565 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:30:08.611532    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gtfv2"
Jul 24 17:35:07.971053 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:35:07.971017    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:35:07.977947 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:35:07.977927    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:37:28.002632 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.002597    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"]
Jul 24 17:37:28.006137 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.006121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"
Jul 24 17:37:28.008900 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.008783    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d6flx\""
Jul 24 17:37:28.013557 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.013537    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"]
Jul 24 17:37:28.118102 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.118063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112f454b-5b52-4bb9-b639-d36669c70313-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh\" (UID: \"112f454b-5b52-4bb9-b639-d36669c70313\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"
Jul 24 17:37:28.218722 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.218677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112f454b-5b52-4bb9-b639-d36669c70313-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh\" (UID: \"112f454b-5b52-4bb9-b639-d36669c70313\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"
Jul 24 17:37:28.219332 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.219313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112f454b-5b52-4bb9-b639-d36669c70313-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh\" (UID: \"112f454b-5b52-4bb9-b639-d36669c70313\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"
Jul 24 17:37:28.318343 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.318269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"
Jul 24 17:37:28.459726 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.459697    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"]
Jul 24 17:37:28.460755 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:37:28.460730    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112f454b_5b52_4bb9_b639_d36669c70313.slice/crio-184f71313b242909535b8dcddf288776af1b67c7a51c6e40d5b3ec3ff0a7f3a6 WatchSource:0}: Error finding container 184f71313b242909535b8dcddf288776af1b67c7a51c6e40d5b3ec3ff0a7f3a6: Status 404 returned error can't find the container with id 184f71313b242909535b8dcddf288776af1b67c7a51c6e40d5b3ec3ff0a7f3a6
Jul 24 17:37:28.463074 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:28.463055    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:37:29.212055 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:29.212016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh" event={"ID":"112f454b-5b52-4bb9-b639-d36669c70313","Type":"ContainerStarted","Data":"184f71313b242909535b8dcddf288776af1b67c7a51c6e40d5b3ec3ff0a7f3a6"}
Jul 24 17:37:31.225413 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:31.225365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh" event={"ID":"112f454b-5b52-4bb9-b639-d36669c70313","Type":"ContainerStarted","Data":"660a5afefd50f3dfe66235bb78c6306af0923384e211998e612b6df2ab95b2ef"}
Jul 24 17:37:31.243059 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:31.243012    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh" podStartSLOduration=1.884380546 podStartE2EDuration="4.242995449s" totalImagesPullingTime="2.358614903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:31.240955226 +0000 UTC m=+1643.868833079" watchObservedRunningTime="2026-07-24 17:37:31.242995449 +0000 UTC m=+1643.870873305"
Jul 24 17:37:32.232625 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:32.232589    2563 generic.go:356] "Generic (PLEG): container finished" podID="112f454b-5b52-4bb9-b639-d36669c70313" containerID="660a5afefd50f3dfe66235bb78c6306af0923384e211998e612b6df2ab95b2ef" exitCode=0
Jul 24 17:37:32.233036 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:32.232675    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh" event={"ID":"112f454b-5b52-4bb9-b639-d36669c70313","Type":"ContainerDied","Data":"660a5afefd50f3dfe66235bb78c6306af0923384e211998e612b6df2ab95b2ef"}
Jul 24 17:37:33.373785 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:33.373756    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"
Jul 24 17:37:33.465107 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:33.465072    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112f454b-5b52-4bb9-b639-d36669c70313-maas-api-service-ca\") pod \"112f454b-5b52-4bb9-b639-d36669c70313\" (UID: \"112f454b-5b52-4bb9-b639-d36669c70313\") "
Jul 24 17:37:33.465385 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:33.465364    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112f454b-5b52-4bb9-b639-d36669c70313-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "112f454b-5b52-4bb9-b639-d36669c70313" (UID: "112f454b-5b52-4bb9-b639-d36669c70313"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:37:33.566194 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:33.566119    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112f454b-5b52-4bb9-b639-d36669c70313-maas-api-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:37:34.250087 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:34.249997    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"
Jul 24 17:37:34.250087 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:34.250031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh" event={"ID":"112f454b-5b52-4bb9-b639-d36669c70313","Type":"ContainerDied","Data":"184f71313b242909535b8dcddf288776af1b67c7a51c6e40d5b3ec3ff0a7f3a6"}
Jul 24 17:37:34.250331 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:34.250106    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="184f71313b242909535b8dcddf288776af1b67c7a51c6e40d5b3ec3ff0a7f3a6"
Jul 24 17:37:43.068519 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:43.068479    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"]
Jul 24 17:37:43.073259 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:43.073231    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8630be2b-5bqjh"]
Jul 24 17:37:43.937413 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:37:43.937377    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="112f454b-5b52-4bb9-b639-d36669c70313" path="/var/lib/kubelet/pods/112f454b-5b52-4bb9-b639-d36669c70313/volumes"
Jul 24 17:38:11.809842 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:11.809807    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"]
Jul 24 17:38:11.810272 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:11.810200    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112f454b-5b52-4bb9-b639-d36669c70313" containerName="revoke-keys"
Jul 24 17:38:11.810272 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:11.810211    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="112f454b-5b52-4bb9-b639-d36669c70313" containerName="revoke-keys"
Jul 24 17:38:11.810349 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:11.810285    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="112f454b-5b52-4bb9-b639-d36669c70313" containerName="revoke-keys"
Jul 24 17:38:11.813163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:11.813137    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"
Jul 24 17:38:11.816057 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:11.816035    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d6flx\""
Jul 24 17:38:11.821763 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:11.821736    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"]
Jul 24 17:38:11.914651 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:11.914617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed85217d-9e3c-4460-bd40-fd8405fbcdc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42\" (UID: \"ed85217d-9e3c-4460-bd40-fd8405fbcdc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"
Jul 24 17:38:12.015691 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:12.015660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed85217d-9e3c-4460-bd40-fd8405fbcdc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42\" (UID: \"ed85217d-9e3c-4460-bd40-fd8405fbcdc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"
Jul 24 17:38:12.016272 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:12.016250    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed85217d-9e3c-4460-bd40-fd8405fbcdc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42\" (UID: \"ed85217d-9e3c-4460-bd40-fd8405fbcdc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"
Jul 24 17:38:12.124711 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:12.124636    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"
Jul 24 17:38:12.258994 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:12.258970    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"]
Jul 24 17:38:12.260669 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:38:12.260643    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded85217d_9e3c_4460_bd40_fd8405fbcdc8.slice/crio-234043ca1e6fa94adb2f02b3689536f58d601cbd4114fe22c7396542372a6405 WatchSource:0}: Error finding container 234043ca1e6fa94adb2f02b3689536f58d601cbd4114fe22c7396542372a6405: Status 404 returned error can't find the container with id 234043ca1e6fa94adb2f02b3689536f58d601cbd4114fe22c7396542372a6405
Jul 24 17:38:12.470346 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:12.470310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42" event={"ID":"ed85217d-9e3c-4460-bd40-fd8405fbcdc8","Type":"ContainerStarted","Data":"234043ca1e6fa94adb2f02b3689536f58d601cbd4114fe22c7396542372a6405"}
Jul 24 17:38:13.477561 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:13.477522    2563 generic.go:356] "Generic (PLEG): container finished" podID="ed85217d-9e3c-4460-bd40-fd8405fbcdc8" containerID="1923459392adffbe8deb6f40f6f5ceb29a7966ea2acd802fc89b1a7898084381" exitCode=0
Jul 24 17:38:13.478027 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:13.477614    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42" event={"ID":"ed85217d-9e3c-4460-bd40-fd8405fbcdc8","Type":"ContainerDied","Data":"1923459392adffbe8deb6f40f6f5ceb29a7966ea2acd802fc89b1a7898084381"}
Jul 24 17:38:14.620564 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:14.620541    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"
Jul 24 17:38:14.740950 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:14.740875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed85217d-9e3c-4460-bd40-fd8405fbcdc8-maas-api-service-ca\") pod \"ed85217d-9e3c-4460-bd40-fd8405fbcdc8\" (UID: \"ed85217d-9e3c-4460-bd40-fd8405fbcdc8\") "
Jul 24 17:38:14.741230 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:14.741207    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed85217d-9e3c-4460-bd40-fd8405fbcdc8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed85217d-9e3c-4460-bd40-fd8405fbcdc8" (UID: "ed85217d-9e3c-4460-bd40-fd8405fbcdc8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:38:14.841903 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:14.841872    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed85217d-9e3c-4460-bd40-fd8405fbcdc8-maas-api-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:38:15.489856 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:15.489822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42" event={"ID":"ed85217d-9e3c-4460-bd40-fd8405fbcdc8","Type":"ContainerDied","Data":"234043ca1e6fa94adb2f02b3689536f58d601cbd4114fe22c7396542372a6405"}
Jul 24 17:38:15.489856 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:15.489847    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"
Jul 24 17:38:15.490160 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:15.489876    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="234043ca1e6fa94adb2f02b3689536f58d601cbd4114fe22c7396542372a6405"
Jul 24 17:38:26.876761 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:26.876722    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"]
Jul 24 17:38:26.879100 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:26.879079    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f431f60c-tbc42"]
Jul 24 17:38:27.937523 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:27.937487    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed85217d-9e3c-4460-bd40-fd8405fbcdc8" path="/var/lib/kubelet/pods/ed85217d-9e3c-4460-bd40-fd8405fbcdc8/volumes"
Jul 24 17:38:30.749377 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.749294    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"]
Jul 24 17:38:30.749750 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.749700    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed85217d-9e3c-4460-bd40-fd8405fbcdc8" containerName="revoke-keys"
Jul 24 17:38:30.749750 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.749711    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed85217d-9e3c-4460-bd40-fd8405fbcdc8" containerName="revoke-keys"
Jul 24 17:38:30.749871 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.749806    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed85217d-9e3c-4460-bd40-fd8405fbcdc8" containerName="revoke-keys"
Jul 24 17:38:30.753136 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.753117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:30.756939 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.756919    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e9e1f4e1-dockercfg-zjsqk\""
Jul 24 17:38:30.757838 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.757814    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e9e1f4e1\""
Jul 24 17:38:30.764904 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.764882    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"]
Jul 24 17:38:30.774023 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.774003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8480a38b-0a53-439e-b131-e03b2a82a7c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj\" (UID: \"8480a38b-0a53-439e-b131-e03b2a82a7c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:30.774132 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.774092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85kpt\" (UniqueName: \"kubernetes.io/projected/8480a38b-0a53-439e-b131-e03b2a82a7c6-kube-api-access-85kpt\") pod \"payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj\" (UID: \"8480a38b-0a53-439e-b131-e03b2a82a7c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:30.875127 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.875093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kpt\" (UniqueName: \"kubernetes.io/projected/8480a38b-0a53-439e-b131-e03b2a82a7c6-kube-api-access-85kpt\") pod \"payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj\" (UID: \"8480a38b-0a53-439e-b131-e03b2a82a7c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:30.875287 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.875152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8480a38b-0a53-439e-b131-e03b2a82a7c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj\" (UID: \"8480a38b-0a53-439e-b131-e03b2a82a7c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:30.875919 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.875899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8480a38b-0a53-439e-b131-e03b2a82a7c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj\" (UID: \"8480a38b-0a53-439e-b131-e03b2a82a7c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:30.884478 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:30.884454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85kpt\" (UniqueName: \"kubernetes.io/projected/8480a38b-0a53-439e-b131-e03b2a82a7c6-kube-api-access-85kpt\") pod \"payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj\" (UID: \"8480a38b-0a53-439e-b131-e03b2a82a7c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:31.064347 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:31.064152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:31.199634 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:31.199602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"]
Jul 24 17:38:31.204333 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:38:31.204296    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8480a38b_0a53_439e_b131_e03b2a82a7c6.slice/crio-ce49e40bcfffd212f591e1b07a8530644796c9c068d259cf87970fc4d479270e WatchSource:0}: Error finding container ce49e40bcfffd212f591e1b07a8530644796c9c068d259cf87970fc4d479270e: Status 404 returned error can't find the container with id ce49e40bcfffd212f591e1b07a8530644796c9c068d259cf87970fc4d479270e
Jul 24 17:38:31.583244 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:31.583211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj" event={"ID":"8480a38b-0a53-439e-b131-e03b2a82a7c6","Type":"ContainerStarted","Data":"ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114"}
Jul 24 17:38:31.583411 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:31.583258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj" event={"ID":"8480a38b-0a53-439e-b131-e03b2a82a7c6","Type":"ContainerStarted","Data":"ce49e40bcfffd212f591e1b07a8530644796c9c068d259cf87970fc4d479270e"}
Jul 24 17:38:31.583411 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:31.583299    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:31.599882 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:31.599837    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj" podStartSLOduration=1.5998239189999999 podStartE2EDuration="1.599823919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:31.598398227 +0000 UTC m=+1704.226276081" watchObservedRunningTime="2026-07-24 17:38:31.599823919 +0000 UTC m=+1704.227701770"
Jul 24 17:38:42.592424 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:42.592392    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:38:55.620854 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:55.620819    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"]
Jul 24 17:38:55.624369 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:55.624353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"
Jul 24 17:38:55.627042 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:55.627013    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d6flx\""
Jul 24 17:38:55.631327 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:55.631258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"]
Jul 24 17:38:55.707975 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:55.707941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f09247-924b-455c-aa7a-52ea625cb10d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9\" (UID: \"96f09247-924b-455c-aa7a-52ea625cb10d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"
Jul 24 17:38:55.809012 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:55.808978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f09247-924b-455c-aa7a-52ea625cb10d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9\" (UID: \"96f09247-924b-455c-aa7a-52ea625cb10d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"
Jul 24 17:38:55.809559 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:55.809537    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f09247-924b-455c-aa7a-52ea625cb10d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9\" (UID: \"96f09247-924b-455c-aa7a-52ea625cb10d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"
Jul 24 17:38:55.936902 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:55.936871    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"
Jul 24 17:38:56.073895 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:56.073855    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"]
Jul 24 17:38:56.075126 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:38:56.075102    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f09247_924b_455c_aa7a_52ea625cb10d.slice/crio-64ecca72644682bd0765b12735b1bf9f8ea90de6d429d5fffeb72ba693e554c3 WatchSource:0}: Error finding container 64ecca72644682bd0765b12735b1bf9f8ea90de6d429d5fffeb72ba693e554c3: Status 404 returned error can't find the container with id 64ecca72644682bd0765b12735b1bf9f8ea90de6d429d5fffeb72ba693e554c3
Jul 24 17:38:56.729709 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:56.729677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9" event={"ID":"96f09247-924b-455c-aa7a-52ea625cb10d","Type":"ContainerStarted","Data":"f4fa349d6a1ed13ec51519ff0043a7401fbde43a02b8722eb824e0a36d2afff8"}
Jul 24 17:38:56.730121 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:56.729737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9" event={"ID":"96f09247-924b-455c-aa7a-52ea625cb10d","Type":"ContainerStarted","Data":"64ecca72644682bd0765b12735b1bf9f8ea90de6d429d5fffeb72ba693e554c3"}
Jul 24 17:38:56.748167 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:56.748120    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9" podStartSLOduration=1.748103873 podStartE2EDuration="1.748103873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:56.745001214 +0000 UTC m=+1729.372879068" watchObservedRunningTime="2026-07-24 17:38:56.748103873 +0000 UTC m=+1729.375981724"
Jul 24 17:38:57.736516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:57.736481    2563 generic.go:356] "Generic (PLEG): container finished" podID="96f09247-924b-455c-aa7a-52ea625cb10d" containerID="f4fa349d6a1ed13ec51519ff0043a7401fbde43a02b8722eb824e0a36d2afff8" exitCode=0
Jul 24 17:38:57.736965 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:57.736576    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9" event={"ID":"96f09247-924b-455c-aa7a-52ea625cb10d","Type":"ContainerDied","Data":"f4fa349d6a1ed13ec51519ff0043a7401fbde43a02b8722eb824e0a36d2afff8"}
Jul 24 17:38:58.884291 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:58.884260    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"
Jul 24 17:38:59.037746 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:59.037656    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f09247-924b-455c-aa7a-52ea625cb10d-maas-api-service-ca\") pod \"96f09247-924b-455c-aa7a-52ea625cb10d\" (UID: \"96f09247-924b-455c-aa7a-52ea625cb10d\") "
Jul 24 17:38:59.038017 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:59.037994    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f09247-924b-455c-aa7a-52ea625cb10d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "96f09247-924b-455c-aa7a-52ea625cb10d" (UID: "96f09247-924b-455c-aa7a-52ea625cb10d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:38:59.138545 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:59.138514    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f09247-924b-455c-aa7a-52ea625cb10d-maas-api-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:38:59.749370 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:59.749338    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"
Jul 24 17:38:59.749552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:59.749369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9" event={"ID":"96f09247-924b-455c-aa7a-52ea625cb10d","Type":"ContainerDied","Data":"64ecca72644682bd0765b12735b1bf9f8ea90de6d429d5fffeb72ba693e554c3"}
Jul 24 17:38:59.749552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:38:59.749448    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64ecca72644682bd0765b12735b1bf9f8ea90de6d429d5fffeb72ba693e554c3"
Jul 24 17:39:06.200226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.200183    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"]
Jul 24 17:39:06.201536 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.201505    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj" podUID="8480a38b-0a53-439e-b131-e03b2a82a7c6" containerName="payload-pre-processing" containerID="cri-o://ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114" gracePeriod=30
Jul 24 17:39:06.464450 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.464393    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:39:06.613574 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.613542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8480a38b-0a53-439e-b131-e03b2a82a7c6-plugins-config-volume\") pod \"8480a38b-0a53-439e-b131-e03b2a82a7c6\" (UID: \"8480a38b-0a53-439e-b131-e03b2a82a7c6\") "
Jul 24 17:39:06.613747 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.613601    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85kpt\" (UniqueName: \"kubernetes.io/projected/8480a38b-0a53-439e-b131-e03b2a82a7c6-kube-api-access-85kpt\") pod \"8480a38b-0a53-439e-b131-e03b2a82a7c6\" (UID: \"8480a38b-0a53-439e-b131-e03b2a82a7c6\") "
Jul 24 17:39:06.613928 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.613906    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8480a38b-0a53-439e-b131-e03b2a82a7c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8480a38b-0a53-439e-b131-e03b2a82a7c6" (UID: "8480a38b-0a53-439e-b131-e03b2a82a7c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:39:06.616009 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.615975    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8480a38b-0a53-439e-b131-e03b2a82a7c6-kube-api-access-85kpt" (OuterVolumeSpecName: "kube-api-access-85kpt") pod "8480a38b-0a53-439e-b131-e03b2a82a7c6" (UID: "8480a38b-0a53-439e-b131-e03b2a82a7c6"). InnerVolumeSpecName "kube-api-access-85kpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:39:06.715071 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.714986    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8480a38b-0a53-439e-b131-e03b2a82a7c6-plugins-config-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:39:06.715071 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.715023    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85kpt\" (UniqueName: \"kubernetes.io/projected/8480a38b-0a53-439e-b131-e03b2a82a7c6-kube-api-access-85kpt\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:39:06.790812 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.790765    2563 generic.go:356] "Generic (PLEG): container finished" podID="8480a38b-0a53-439e-b131-e03b2a82a7c6" containerID="ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114" exitCode=0
Jul 24 17:39:06.790983 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.790850    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"
Jul 24 17:39:06.790983 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.790855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj" event={"ID":"8480a38b-0a53-439e-b131-e03b2a82a7c6","Type":"ContainerDied","Data":"ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114"}
Jul 24 17:39:06.790983 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.790915    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj" event={"ID":"8480a38b-0a53-439e-b131-e03b2a82a7c6","Type":"ContainerDied","Data":"ce49e40bcfffd212f591e1b07a8530644796c9c068d259cf87970fc4d479270e"}
Jul 24 17:39:06.790983 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.790940    2563 scope.go:117] "RemoveContainer" containerID="ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114"
Jul 24 17:39:06.804239 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.803725    2563 scope.go:117] "RemoveContainer" containerID="ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114"
Jul 24 17:39:06.806101 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:39:06.805598    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114\": container with ID starting with ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114 not found: ID does not exist" containerID="ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114"
Jul 24 17:39:06.806101 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.805639    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114"} err="failed to get container status \"ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114\": rpc error: code = NotFound desc = could not find container \"ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114\": container with ID starting with ed4eee05301f9e7c645f6526c4c030659a7ba1c4c14392ec462112b1eb794114 not found: ID does not exist"
Jul 24 17:39:06.814506 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.814481    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"]
Jul 24 17:39:06.819314 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:06.819287    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj"]
Jul 24 17:39:07.937761 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:07.937726    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8480a38b-0a53-439e-b131-e03b2a82a7c6" path="/var/lib/kubelet/pods/8480a38b-0a53-439e-b131-e03b2a82a7c6/volumes"
Jul 24 17:39:10.684837 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:10.684777    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"]
Jul 24 17:39:10.689444 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:10.689419    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e9e1f4e1-z4jz9"]
Jul 24 17:39:11.936974 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:11.936940    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96f09247-924b-455c-aa7a-52ea625cb10d" path="/var/lib/kubelet/pods/96f09247-924b-455c-aa7a-52ea625cb10d/volumes"
Jul 24 17:39:15.730085 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.730049    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"]
Jul 24 17:39:15.730504 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.730491    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8480a38b-0a53-439e-b131-e03b2a82a7c6" containerName="payload-pre-processing"
Jul 24 17:39:15.730552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.730506    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8480a38b-0a53-439e-b131-e03b2a82a7c6" containerName="payload-pre-processing"
Jul 24 17:39:15.730552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.730513    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f09247-924b-455c-aa7a-52ea625cb10d" containerName="revoke-keys"
Jul 24 17:39:15.730552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.730518    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f09247-924b-455c-aa7a-52ea625cb10d" containerName="revoke-keys"
Jul 24 17:39:15.730646 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.730577    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8480a38b-0a53-439e-b131-e03b2a82a7c6" containerName="payload-pre-processing"
Jul 24 17:39:15.730646 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.730588    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f09247-924b-455c-aa7a-52ea625cb10d" containerName="revoke-keys"
Jul 24 17:39:15.733645 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.733624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:15.736573 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.736548    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-3efc9f0f\""
Jul 24 17:39:15.736710 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.736692    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-3efc9f0f-dockercfg-87jx8\""
Jul 24 17:39:15.747724 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.747696    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"]
Jul 24 17:39:15.789618 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.789577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ca3102-0c81-465e-8efb-c000509e420c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9\" (UID: \"15ca3102-0c81-465e-8efb-c000509e420c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:15.789826 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.789633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmhc2\" (UniqueName: \"kubernetes.io/projected/15ca3102-0c81-465e-8efb-c000509e420c-kube-api-access-hmhc2\") pod \"payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9\" (UID: \"15ca3102-0c81-465e-8efb-c000509e420c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:15.890382 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.890349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ca3102-0c81-465e-8efb-c000509e420c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9\" (UID: \"15ca3102-0c81-465e-8efb-c000509e420c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:15.890382 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.890388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmhc2\" (UniqueName: \"kubernetes.io/projected/15ca3102-0c81-465e-8efb-c000509e420c-kube-api-access-hmhc2\") pod \"payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9\" (UID: \"15ca3102-0c81-465e-8efb-c000509e420c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:15.891120 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.891094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ca3102-0c81-465e-8efb-c000509e420c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9\" (UID: \"15ca3102-0c81-465e-8efb-c000509e420c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:15.898895 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:15.898870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmhc2\" (UniqueName: \"kubernetes.io/projected/15ca3102-0c81-465e-8efb-c000509e420c-kube-api-access-hmhc2\") pod \"payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9\" (UID: \"15ca3102-0c81-465e-8efb-c000509e420c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:16.044473 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:16.044385    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:16.184507 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:16.184482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"]
Jul 24 17:39:16.187106 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:39:16.187073    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ca3102_0c81_465e_8efb_c000509e420c.slice/crio-d84d93cf24ed98492b346dded6eae2eabf1198c69df6e908a47e53b1a74c286b WatchSource:0}: Error finding container d84d93cf24ed98492b346dded6eae2eabf1198c69df6e908a47e53b1a74c286b: Status 404 returned error can't find the container with id d84d93cf24ed98492b346dded6eae2eabf1198c69df6e908a47e53b1a74c286b
Jul 24 17:39:16.849874 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:16.849840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9" event={"ID":"15ca3102-0c81-465e-8efb-c000509e420c","Type":"ContainerStarted","Data":"a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0"}
Jul 24 17:39:16.850295 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:16.849891    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9" event={"ID":"15ca3102-0c81-465e-8efb-c000509e420c","Type":"ContainerStarted","Data":"d84d93cf24ed98492b346dded6eae2eabf1198c69df6e908a47e53b1a74c286b"}
Jul 24 17:39:16.850295 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:16.849976    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:16.867224 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:16.867175    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9" podStartSLOduration=1.8671626510000001 podStartE2EDuration="1.867162651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:39:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:39:16.865562432 +0000 UTC m=+1749.493440284" watchObservedRunningTime="2026-07-24 17:39:16.867162651 +0000 UTC m=+1749.495040503"
Jul 24 17:39:27.858655 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:27.858625    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:39.937295 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:39.937269    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"]
Jul 24 17:39:39.941160 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:39.941137    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"
Jul 24 17:39:39.941844 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:39.941767    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"]
Jul 24 17:39:39.943977 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:39.943957    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d6flx\""
Jul 24 17:39:40.011529 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:40.011501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2f149c-667d-4af6-a7a9-7aa885c917b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6\" (UID: \"dc2f149c-667d-4af6-a7a9-7aa885c917b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"
Jul 24 17:39:40.113006 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:40.112971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2f149c-667d-4af6-a7a9-7aa885c917b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6\" (UID: \"dc2f149c-667d-4af6-a7a9-7aa885c917b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"
Jul 24 17:39:40.113576 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:40.113559    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2f149c-667d-4af6-a7a9-7aa885c917b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6\" (UID: \"dc2f149c-667d-4af6-a7a9-7aa885c917b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"
Jul 24 17:39:40.252749 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:40.252676    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"
Jul 24 17:39:40.388724 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:40.388696    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"]
Jul 24 17:39:40.390363 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:39:40.390339    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2f149c_667d_4af6_a7a9_7aa885c917b0.slice/crio-60917bb7f220ab72c55579dd8e9d7d965fcafa1f4b65a28ab288fad883fad285 WatchSource:0}: Error finding container 60917bb7f220ab72c55579dd8e9d7d965fcafa1f4b65a28ab288fad883fad285: Status 404 returned error can't find the container with id 60917bb7f220ab72c55579dd8e9d7d965fcafa1f4b65a28ab288fad883fad285
Jul 24 17:39:40.989130 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:40.989087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6" event={"ID":"dc2f149c-667d-4af6-a7a9-7aa885c917b0","Type":"ContainerStarted","Data":"94ebd2c7124b92b08563da27b8b67dd188bea36dbd8dd4dc2200e5dd6e4407f8"}
Jul 24 17:39:40.989515 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:40.989146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6" event={"ID":"dc2f149c-667d-4af6-a7a9-7aa885c917b0","Type":"ContainerStarted","Data":"60917bb7f220ab72c55579dd8e9d7d965fcafa1f4b65a28ab288fad883fad285"}
Jul 24 17:39:41.006913 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:41.006860    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6" podStartSLOduration=2.006846118 podStartE2EDuration="2.006846118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:39:41.004832176 +0000 UTC m=+1773.632710031" watchObservedRunningTime="2026-07-24 17:39:41.006846118 +0000 UTC m=+1773.634723970"
Jul 24 17:39:41.996235 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:41.996196    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc2f149c-667d-4af6-a7a9-7aa885c917b0" containerID="94ebd2c7124b92b08563da27b8b67dd188bea36dbd8dd4dc2200e5dd6e4407f8" exitCode=0
Jul 24 17:39:41.996620 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:41.996241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6" event={"ID":"dc2f149c-667d-4af6-a7a9-7aa885c917b0","Type":"ContainerDied","Data":"94ebd2c7124b92b08563da27b8b67dd188bea36dbd8dd4dc2200e5dd6e4407f8"}
Jul 24 17:39:43.148916 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:43.148889    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"
Jul 24 17:39:43.240381 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:43.240350    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2f149c-667d-4af6-a7a9-7aa885c917b0-maas-api-service-ca\") pod \"dc2f149c-667d-4af6-a7a9-7aa885c917b0\" (UID: \"dc2f149c-667d-4af6-a7a9-7aa885c917b0\") "
Jul 24 17:39:43.240763 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:43.240738    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc2f149c-667d-4af6-a7a9-7aa885c917b0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dc2f149c-667d-4af6-a7a9-7aa885c917b0" (UID: "dc2f149c-667d-4af6-a7a9-7aa885c917b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:39:43.342078 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:43.341993    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2f149c-667d-4af6-a7a9-7aa885c917b0-maas-api-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:39:44.009456 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:44.009425    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"
Jul 24 17:39:44.009456 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:44.009447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6" event={"ID":"dc2f149c-667d-4af6-a7a9-7aa885c917b0","Type":"ContainerDied","Data":"60917bb7f220ab72c55579dd8e9d7d965fcafa1f4b65a28ab288fad883fad285"}
Jul 24 17:39:44.009653 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:44.009497    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60917bb7f220ab72c55579dd8e9d7d965fcafa1f4b65a28ab288fad883fad285"
Jul 24 17:39:50.342624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:50.342593    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"]
Jul 24 17:39:50.343105 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:50.342871    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9" podUID="15ca3102-0c81-465e-8efb-c000509e420c" containerName="payload-pre-processing" containerID="cri-o://a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0" gracePeriod=30
Jul 24 17:39:50.616862 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:50.616822    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:50.709767 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:50.709728    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmhc2\" (UniqueName: \"kubernetes.io/projected/15ca3102-0c81-465e-8efb-c000509e420c-kube-api-access-hmhc2\") pod \"15ca3102-0c81-465e-8efb-c000509e420c\" (UID: \"15ca3102-0c81-465e-8efb-c000509e420c\") "
Jul 24 17:39:50.709921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:50.709842    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ca3102-0c81-465e-8efb-c000509e420c-plugins-config-volume\") pod \"15ca3102-0c81-465e-8efb-c000509e420c\" (UID: \"15ca3102-0c81-465e-8efb-c000509e420c\") "
Jul 24 17:39:50.710226 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:50.710194    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ca3102-0c81-465e-8efb-c000509e420c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15ca3102-0c81-465e-8efb-c000509e420c" (UID: "15ca3102-0c81-465e-8efb-c000509e420c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:39:50.712070 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:50.712038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ca3102-0c81-465e-8efb-c000509e420c-kube-api-access-hmhc2" (OuterVolumeSpecName: "kube-api-access-hmhc2") pod "15ca3102-0c81-465e-8efb-c000509e420c" (UID: "15ca3102-0c81-465e-8efb-c000509e420c"). InnerVolumeSpecName "kube-api-access-hmhc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:39:50.810846 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:50.810814    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ca3102-0c81-465e-8efb-c000509e420c-plugins-config-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:39:50.810846 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:50.810840    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmhc2\" (UniqueName: \"kubernetes.io/projected/15ca3102-0c81-465e-8efb-c000509e420c-kube-api-access-hmhc2\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:39:51.051867 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.051832    2563 generic.go:356] "Generic (PLEG): container finished" podID="15ca3102-0c81-465e-8efb-c000509e420c" containerID="a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0" exitCode=0
Jul 24 17:39:51.052058 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.051878    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"
Jul 24 17:39:51.052058 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.051893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9" event={"ID":"15ca3102-0c81-465e-8efb-c000509e420c","Type":"ContainerDied","Data":"a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0"}
Jul 24 17:39:51.052058 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.051945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9" event={"ID":"15ca3102-0c81-465e-8efb-c000509e420c","Type":"ContainerDied","Data":"d84d93cf24ed98492b346dded6eae2eabf1198c69df6e908a47e53b1a74c286b"}
Jul 24 17:39:51.052058 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.051973    2563 scope.go:117] "RemoveContainer" containerID="a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0"
Jul 24 17:39:51.061579 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.061563    2563 scope.go:117] "RemoveContainer" containerID="a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0"
Jul 24 17:39:51.061871 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:39:51.061855    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0\": container with ID starting with a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0 not found: ID does not exist" containerID="a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0"
Jul 24 17:39:51.061920 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.061879    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0"} err="failed to get container status \"a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0\": rpc error: code = NotFound desc = could not find container \"a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0\": container with ID starting with a55f45b3ea30dca85d319774b6c45bd325983947b32ec598ade2ce155a4134a0 not found: ID does not exist"
Jul 24 17:39:51.073194 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.073172    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"]
Jul 24 17:39:51.080205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.080187    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9"]
Jul 24 17:39:51.938205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:51.938166    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ca3102-0c81-465e-8efb-c000509e420c" path="/var/lib/kubelet/pods/15ca3102-0c81-465e-8efb-c000509e420c/volumes"
Jul 24 17:39:54.994028 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:54.993972    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"]
Jul 24 17:39:54.996332 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:54.996311    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3efc9f0f-76cc6"]
Jul 24 17:39:55.937071 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:39:55.937025    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc2f149c-667d-4af6-a7a9-7aa885c917b0" path="/var/lib/kubelet/pods/dc2f149c-667d-4af6-a7a9-7aa885c917b0/volumes"
Jul 24 17:40:08.009145 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:40:08.009118    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:40:08.020539 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:40:08.020512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:41:52.119889 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.119851    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"]
Jul 24 17:41:52.120476 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.120458    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ca3102-0c81-465e-8efb-c000509e420c" containerName="payload-pre-processing"
Jul 24 17:41:52.120535 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.120480    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ca3102-0c81-465e-8efb-c000509e420c" containerName="payload-pre-processing"
Jul 24 17:41:52.120535 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.120498    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2f149c-667d-4af6-a7a9-7aa885c917b0" containerName="revoke-keys"
Jul 24 17:41:52.120535 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.120509    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2f149c-667d-4af6-a7a9-7aa885c917b0" containerName="revoke-keys"
Jul 24 17:41:52.120647 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.120577    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2f149c-667d-4af6-a7a9-7aa885c917b0" containerName="revoke-keys"
Jul 24 17:41:52.120647 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.120587    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ca3102-0c81-465e-8efb-c000509e420c" containerName="payload-pre-processing"
Jul 24 17:41:52.123644 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.123626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"
Jul 24 17:41:52.126297 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.126278    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d6flx\""
Jul 24 17:41:52.132753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.132729    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"]
Jul 24 17:41:52.231632 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.231597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e3621b-3023-4fcc-b571-8cdeda228571-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd\" (UID: \"a3e3621b-3023-4fcc-b571-8cdeda228571\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"
Jul 24 17:41:52.333062 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.333022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e3621b-3023-4fcc-b571-8cdeda228571-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd\" (UID: \"a3e3621b-3023-4fcc-b571-8cdeda228571\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"
Jul 24 17:41:52.333664 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.333645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e3621b-3023-4fcc-b571-8cdeda228571-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd\" (UID: \"a3e3621b-3023-4fcc-b571-8cdeda228571\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"
Jul 24 17:41:52.436526 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.436493    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"
Jul 24 17:41:52.580051 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.580021    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"]
Jul 24 17:41:52.581305 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:41:52.581279    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e3621b_3023_4fcc_b571_8cdeda228571.slice/crio-10f6e7c21a17e984b5cadd926b9d962de25ab765f357983d8c7fc144bd715e97 WatchSource:0}: Error finding container 10f6e7c21a17e984b5cadd926b9d962de25ab765f357983d8c7fc144bd715e97: Status 404 returned error can't find the container with id 10f6e7c21a17e984b5cadd926b9d962de25ab765f357983d8c7fc144bd715e97
Jul 24 17:41:52.773391 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:52.773307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd" event={"ID":"a3e3621b-3023-4fcc-b571-8cdeda228571","Type":"ContainerStarted","Data":"10f6e7c21a17e984b5cadd926b9d962de25ab765f357983d8c7fc144bd715e97"}
Jul 24 17:41:53.780768 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:53.780734    2563 generic.go:356] "Generic (PLEG): container finished" podID="a3e3621b-3023-4fcc-b571-8cdeda228571" containerID="8f122fd5046e1144dca453382d62e05309ffc0f95cd0169e1deba72269007a79" exitCode=0
Jul 24 17:41:53.781182 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:53.780827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd" event={"ID":"a3e3621b-3023-4fcc-b571-8cdeda228571","Type":"ContainerDied","Data":"8f122fd5046e1144dca453382d62e05309ffc0f95cd0169e1deba72269007a79"}
Jul 24 17:41:54.931594 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:54.931568    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"
Jul 24 17:41:55.055139 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:55.055038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e3621b-3023-4fcc-b571-8cdeda228571-maas-api-service-ca\") pod \"a3e3621b-3023-4fcc-b571-8cdeda228571\" (UID: \"a3e3621b-3023-4fcc-b571-8cdeda228571\") "
Jul 24 17:41:55.055426 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:55.055399    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3e3621b-3023-4fcc-b571-8cdeda228571-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a3e3621b-3023-4fcc-b571-8cdeda228571" (UID: "a3e3621b-3023-4fcc-b571-8cdeda228571"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:55.156240 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:55.156205    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e3621b-3023-4fcc-b571-8cdeda228571-maas-api-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:41:55.794956 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:55.794923    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"
Jul 24 17:41:55.795135 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:55.794962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd" event={"ID":"a3e3621b-3023-4fcc-b571-8cdeda228571","Type":"ContainerDied","Data":"10f6e7c21a17e984b5cadd926b9d962de25ab765f357983d8c7fc144bd715e97"}
Jul 24 17:41:55.795135 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:41:55.795014    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10f6e7c21a17e984b5cadd926b9d962de25ab765f357983d8c7fc144bd715e97"
Jul 24 17:42:07.242456 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:07.242423    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"]
Jul 24 17:42:07.244661 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:07.244635    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cccec6a6-tw8qd"]
Jul 24 17:42:07.938948 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:07.938903    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3e3621b-3023-4fcc-b571-8cdeda228571" path="/var/lib/kubelet/pods/a3e3621b-3023-4fcc-b571-8cdeda228571/volumes"
Jul 24 17:42:36.371652 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.371619    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"]
Jul 24 17:42:36.372147 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.372032    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e3621b-3023-4fcc-b571-8cdeda228571" containerName="revoke-keys"
Jul 24 17:42:36.372147 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.372043    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e3621b-3023-4fcc-b571-8cdeda228571" containerName="revoke-keys"
Jul 24 17:42:36.372147 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.372119    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3e3621b-3023-4fcc-b571-8cdeda228571" containerName="revoke-keys"
Jul 24 17:42:36.375528 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.375509    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:42:36.378352 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.378331    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a5726951\""
Jul 24 17:42:36.378519 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.378507    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a5726951-dockercfg-5gtld\""
Jul 24 17:42:36.386188 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.386164    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"]
Jul 24 17:42:36.417169 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.417132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5cxs\" (UniqueName: \"kubernetes.io/projected/01b27979-d640-41db-8e4e-d2d739eb078f-kube-api-access-z5cxs\") pod \"payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8\" (UID: \"01b27979-d640-41db-8e4e-d2d739eb078f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:42:36.417334 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.417270    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01b27979-d640-41db-8e4e-d2d739eb078f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8\" (UID: \"01b27979-d640-41db-8e4e-d2d739eb078f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:42:36.518186 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.518153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01b27979-d640-41db-8e4e-d2d739eb078f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8\" (UID: \"01b27979-d640-41db-8e4e-d2d739eb078f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:42:36.518400 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.518203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5cxs\" (UniqueName: \"kubernetes.io/projected/01b27979-d640-41db-8e4e-d2d739eb078f-kube-api-access-z5cxs\") pod \"payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8\" (UID: \"01b27979-d640-41db-8e4e-d2d739eb078f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:42:36.519004 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.518980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01b27979-d640-41db-8e4e-d2d739eb078f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8\" (UID: \"01b27979-d640-41db-8e4e-d2d739eb078f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:42:36.528337 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.528315    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5cxs\" (UniqueName: \"kubernetes.io/projected/01b27979-d640-41db-8e4e-d2d739eb078f-kube-api-access-z5cxs\") pod \"payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8\" (UID: \"01b27979-d640-41db-8e4e-d2d739eb078f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:42:36.686593 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:36.686559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:42:37.051453 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:37.051423    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"]
Jul 24 17:42:37.052639 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:42:37.052615    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b27979_d640_41db_8e4e_d2d739eb078f.slice/crio-ccc8282f82c26d3ac578e57570b12fb5e4995d48f951bf60da3b0f88bea5c83c WatchSource:0}: Error finding container ccc8282f82c26d3ac578e57570b12fb5e4995d48f951bf60da3b0f88bea5c83c: Status 404 returned error can't find the container with id ccc8282f82c26d3ac578e57570b12fb5e4995d48f951bf60da3b0f88bea5c83c
Jul 24 17:42:38.051452 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:38.051415    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8" event={"ID":"01b27979-d640-41db-8e4e-d2d739eb078f","Type":"ContainerStarted","Data":"09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2"}
Jul 24 17:42:38.051862 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:38.051467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8" event={"ID":"01b27979-d640-41db-8e4e-d2d739eb078f","Type":"ContainerStarted","Data":"ccc8282f82c26d3ac578e57570b12fb5e4995d48f951bf60da3b0f88bea5c83c"}
Jul 24 17:42:38.051862 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:38.051548    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:42:38.068342 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:38.068298    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8" podStartSLOduration=2.0682832429999998 podStartE2EDuration="2.068283243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:38.06711346 +0000 UTC m=+1950.694991312" watchObservedRunningTime="2026-07-24 17:42:38.068283243 +0000 UTC m=+1950.696161095"
Jul 24 17:42:49.059770 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:42:49.059729    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:43:24.513013 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:24.512979    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"]
Jul 24 17:43:24.516293 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:24.516275    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"
Jul 24 17:43:24.519322 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:24.519295    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d6flx\""
Jul 24 17:43:24.523027 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:24.523004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"]
Jul 24 17:43:24.542440 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:24.542409    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50167504-c471-4804-9c5d-fb77a9bcb64a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a5726951-6xnjq\" (UID: \"50167504-c471-4804-9c5d-fb77a9bcb64a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"
Jul 24 17:43:24.643034 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:24.642997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50167504-c471-4804-9c5d-fb77a9bcb64a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a5726951-6xnjq\" (UID: \"50167504-c471-4804-9c5d-fb77a9bcb64a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"
Jul 24 17:43:24.643666 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:24.643645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50167504-c471-4804-9c5d-fb77a9bcb64a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a5726951-6xnjq\" (UID: \"50167504-c471-4804-9c5d-fb77a9bcb64a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"
Jul 24 17:43:24.829118 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:24.829032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"
Jul 24 17:43:24.966270 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:24.966180    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"]
Jul 24 17:43:24.969119 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:43:24.969085    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50167504_c471_4804_9c5d_fb77a9bcb64a.slice/crio-6d2c3b6946166bdf30931fea1b8f4629149a127c38ea6b61f665bc0a6536b4bf WatchSource:0}: Error finding container 6d2c3b6946166bdf30931fea1b8f4629149a127c38ea6b61f665bc0a6536b4bf: Status 404 returned error can't find the container with id 6d2c3b6946166bdf30931fea1b8f4629149a127c38ea6b61f665bc0a6536b4bf
Jul 24 17:43:25.329555 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:25.329521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq" event={"ID":"50167504-c471-4804-9c5d-fb77a9bcb64a","Type":"ContainerStarted","Data":"132554674e7b4cd5f386f2175b5a68464322ea055f2e2b5c83e69f0be918fed3"}
Jul 24 17:43:25.329703 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:25.329582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq" event={"ID":"50167504-c471-4804-9c5d-fb77a9bcb64a","Type":"ContainerStarted","Data":"6d2c3b6946166bdf30931fea1b8f4629149a127c38ea6b61f665bc0a6536b4bf"}
Jul 24 17:43:25.344048 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:25.344008    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq" podStartSLOduration=1.343994341 podStartE2EDuration="1.343994341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:43:25.343728618 +0000 UTC m=+1997.971606469" watchObservedRunningTime="2026-07-24 17:43:25.343994341 +0000 UTC m=+1997.971872193"
Jul 24 17:43:26.336877 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:26.336844    2563 generic.go:356] "Generic (PLEG): container finished" podID="50167504-c471-4804-9c5d-fb77a9bcb64a" containerID="132554674e7b4cd5f386f2175b5a68464322ea055f2e2b5c83e69f0be918fed3" exitCode=0
Jul 24 17:43:26.336877 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:26.336880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq" event={"ID":"50167504-c471-4804-9c5d-fb77a9bcb64a","Type":"ContainerDied","Data":"132554674e7b4cd5f386f2175b5a68464322ea055f2e2b5c83e69f0be918fed3"}
Jul 24 17:43:27.480374 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:27.480347    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"
Jul 24 17:43:27.563406 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:27.563371    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50167504-c471-4804-9c5d-fb77a9bcb64a-maas-api-service-ca\") pod \"50167504-c471-4804-9c5d-fb77a9bcb64a\" (UID: \"50167504-c471-4804-9c5d-fb77a9bcb64a\") "
Jul 24 17:43:27.563731 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:27.563708    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50167504-c471-4804-9c5d-fb77a9bcb64a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "50167504-c471-4804-9c5d-fb77a9bcb64a" (UID: "50167504-c471-4804-9c5d-fb77a9bcb64a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:43:27.664134 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:27.664102    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50167504-c471-4804-9c5d-fb77a9bcb64a-maas-api-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:43:28.349399 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:28.349323    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"
Jul 24 17:43:28.349545 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:28.349323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq" event={"ID":"50167504-c471-4804-9c5d-fb77a9bcb64a","Type":"ContainerDied","Data":"6d2c3b6946166bdf30931fea1b8f4629149a127c38ea6b61f665bc0a6536b4bf"}
Jul 24 17:43:28.349545 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:28.349442    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d2c3b6946166bdf30931fea1b8f4629149a127c38ea6b61f665bc0a6536b4bf"
Jul 24 17:43:40.019465 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.019429    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"]
Jul 24 17:43:40.019956 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.019640    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8" podUID="01b27979-d640-41db-8e4e-d2d739eb078f" containerName="payload-pre-processing" containerID="cri-o://09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2" gracePeriod=30
Jul 24 17:43:40.268177 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.268154    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:43:40.356064 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.355986    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01b27979-d640-41db-8e4e-d2d739eb078f-plugins-config-volume\") pod \"01b27979-d640-41db-8e4e-d2d739eb078f\" (UID: \"01b27979-d640-41db-8e4e-d2d739eb078f\") "
Jul 24 17:43:40.356064 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.356035    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5cxs\" (UniqueName: \"kubernetes.io/projected/01b27979-d640-41db-8e4e-d2d739eb078f-kube-api-access-z5cxs\") pod \"01b27979-d640-41db-8e4e-d2d739eb078f\" (UID: \"01b27979-d640-41db-8e4e-d2d739eb078f\") "
Jul 24 17:43:40.356408 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.356385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01b27979-d640-41db-8e4e-d2d739eb078f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01b27979-d640-41db-8e4e-d2d739eb078f" (UID: "01b27979-d640-41db-8e4e-d2d739eb078f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:43:40.358276 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.358248    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b27979-d640-41db-8e4e-d2d739eb078f-kube-api-access-z5cxs" (OuterVolumeSpecName: "kube-api-access-z5cxs") pod "01b27979-d640-41db-8e4e-d2d739eb078f" (UID: "01b27979-d640-41db-8e4e-d2d739eb078f"). InnerVolumeSpecName "kube-api-access-z5cxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:43:40.418762 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.418731    2563 generic.go:356] "Generic (PLEG): container finished" podID="01b27979-d640-41db-8e4e-d2d739eb078f" containerID="09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2" exitCode=0
Jul 24 17:43:40.418932 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.418773    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"
Jul 24 17:43:40.418932 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.418825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8" event={"ID":"01b27979-d640-41db-8e4e-d2d739eb078f","Type":"ContainerDied","Data":"09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2"}
Jul 24 17:43:40.418932 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.418902    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8" event={"ID":"01b27979-d640-41db-8e4e-d2d739eb078f","Type":"ContainerDied","Data":"ccc8282f82c26d3ac578e57570b12fb5e4995d48f951bf60da3b0f88bea5c83c"}
Jul 24 17:43:40.419055 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.418937    2563 scope.go:117] "RemoveContainer" containerID="09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2"
Jul 24 17:43:40.430062 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.430043    2563 scope.go:117] "RemoveContainer" containerID="09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2"
Jul 24 17:43:40.430324 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:43:40.430298    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2\": container with ID starting with 09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2 not found: ID does not exist" containerID="09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2"
Jul 24 17:43:40.430376 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.430335    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2"} err="failed to get container status \"09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2\": rpc error: code = NotFound desc = could not find container \"09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2\": container with ID starting with 09891b488957d5c5f9ccdf3cd773424452c12272147a51328bd062c0dc59ded2 not found: ID does not exist"
Jul 24 17:43:40.442520 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.442472    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"]
Jul 24 17:43:40.444753 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.444735    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8"]
Jul 24 17:43:40.457075 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.457059    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01b27979-d640-41db-8e4e-d2d739eb078f-plugins-config-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:43:40.457147 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:40.457077    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5cxs\" (UniqueName: \"kubernetes.io/projected/01b27979-d640-41db-8e4e-d2d739eb078f-kube-api-access-z5cxs\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:43:41.943987 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:41.943950    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01b27979-d640-41db-8e4e-d2d739eb078f" path="/var/lib/kubelet/pods/01b27979-d640-41db-8e4e-d2d739eb078f/volumes"
Jul 24 17:43:44.583268 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:44.583228    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"]
Jul 24 17:43:44.585861 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:44.585840    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5726951-6xnjq"]
Jul 24 17:43:45.936702 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:43:45.936671    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50167504-c471-4804-9c5d-fb77a9bcb64a" path="/var/lib/kubelet/pods/50167504-c471-4804-9c5d-fb77a9bcb64a/volumes"
Jul 24 17:44:08.148516 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:44:08.148478    2563 scope.go:117] "RemoveContainer" containerID="660a5afefd50f3dfe66235bb78c6306af0923384e211998e612b6df2ab95b2ef"
Jul 24 17:45:08.048772 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:08.048747    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:45:08.068720 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:08.068692    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:45:08.174919 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:08.174891    2563 scope.go:117] "RemoveContainer" containerID="f4fa349d6a1ed13ec51519ff0043a7401fbde43a02b8722eb824e0a36d2afff8"
Jul 24 17:45:08.183844 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:08.183823    2563 scope.go:117] "RemoveContainer" containerID="1923459392adffbe8deb6f40f6f5ceb29a7966ea2acd802fc89b1a7898084381"
Jul 24 17:45:42.384604 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.384564    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"]
Jul 24 17:45:42.385094 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.384988    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b27979-d640-41db-8e4e-d2d739eb078f" containerName="payload-pre-processing"
Jul 24 17:45:42.385094 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.384999    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b27979-d640-41db-8e4e-d2d739eb078f" containerName="payload-pre-processing"
Jul 24 17:45:42.385094 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.385021    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50167504-c471-4804-9c5d-fb77a9bcb64a" containerName="revoke-keys"
Jul 24 17:45:42.385094 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.385027    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="50167504-c471-4804-9c5d-fb77a9bcb64a" containerName="revoke-keys"
Jul 24 17:45:42.385094 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.385093    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b27979-d640-41db-8e4e-d2d739eb078f" containerName="payload-pre-processing"
Jul 24 17:45:42.385262 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.385104    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="50167504-c471-4804-9c5d-fb77a9bcb64a" containerName="revoke-keys"
Jul 24 17:45:42.388171 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.388153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:42.391064 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.391044    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-22bf5f-serving-cert\""
Jul 24 17:45:42.401652 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.401626    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"]
Jul 24 17:45:42.460150 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.460113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-maas-api-tls\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:42.460150 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.460154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:42.460340 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.460171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwlbd\" (UniqueName: \"kubernetes.io/projected/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-kube-api-access-xwlbd\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:42.561137 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.561107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-maas-api-tls\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:42.561290 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.561145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:42.561290 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.561164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwlbd\" (UniqueName: \"kubernetes.io/projected/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-kube-api-access-xwlbd\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:42.561290 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:45:42.561270    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-serving-cert: secret "maas-api-e2e-inf-b-22bf5f-serving-cert" not found
Jul 24 17:45:42.561407 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:45:42.561346    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-maas-api-tls podName:0fda987c-e5bf-4633-8ed4-a92869ef0a9d nodeName:}" failed. No retries permitted until 2026-07-24 17:45:43.061327231 +0000 UTC m=+2135.689205070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-maas-api-tls") pod "maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr" (UID: "0fda987c-e5bf-4633-8ed4-a92869ef0a9d") : secret "maas-api-e2e-inf-b-22bf5f-serving-cert" not found
Jul 24 17:45:42.561742 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.561714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:42.571240 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:42.571217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwlbd\" (UniqueName: \"kubernetes.io/projected/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-kube-api-access-xwlbd\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:43.033528 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.033490    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"]
Jul 24 17:45:43.037427 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.037408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:45:43.042117 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.042091    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-22bf5f-dockercfg-nztk6\""
Jul 24 17:45:43.043636 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.043613    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-22bf5f\""
Jul 24 17:45:43.053105 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.053079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"]
Jul 24 17:45:43.067135 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.067108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-maas-api-tls\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:43.069663 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.069636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-maas-api-tls\") pod \"maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:43.168059 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.168017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed6288a6-1a35-4a2b-b408-afe996974033-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c\" (UID: \"ed6288a6-1a35-4a2b-b408-afe996974033\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:45:43.168254 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.168180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm7wg\" (UniqueName: \"kubernetes.io/projected/ed6288a6-1a35-4a2b-b408-afe996974033-kube-api-access-gm7wg\") pod \"payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c\" (UID: \"ed6288a6-1a35-4a2b-b408-afe996974033\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:45:43.269547 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.269505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm7wg\" (UniqueName: \"kubernetes.io/projected/ed6288a6-1a35-4a2b-b408-afe996974033-kube-api-access-gm7wg\") pod \"payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c\" (UID: \"ed6288a6-1a35-4a2b-b408-afe996974033\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:45:43.269729 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.269577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed6288a6-1a35-4a2b-b408-afe996974033-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c\" (UID: \"ed6288a6-1a35-4a2b-b408-afe996974033\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:45:43.270310 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.270290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed6288a6-1a35-4a2b-b408-afe996974033-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c\" (UID: \"ed6288a6-1a35-4a2b-b408-afe996974033\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:45:43.278376 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.278352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm7wg\" (UniqueName: \"kubernetes.io/projected/ed6288a6-1a35-4a2b-b408-afe996974033-kube-api-access-gm7wg\") pod \"payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c\" (UID: \"ed6288a6-1a35-4a2b-b408-afe996974033\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:45:43.299955 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.299901    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:43.348864 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.348835    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:45:43.514936 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.514911    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"]
Jul 24 17:45:43.516195 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:45:43.516168    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6288a6_1a35_4a2b_b408_afe996974033.slice/crio-b0968c0ca397f268c7a5cdc2c3144083134a64097ee9f4b28e860b3ede8be16c WatchSource:0}: Error finding container b0968c0ca397f268c7a5cdc2c3144083134a64097ee9f4b28e860b3ede8be16c: Status 404 returned error can't find the container with id b0968c0ca397f268c7a5cdc2c3144083134a64097ee9f4b28e860b3ede8be16c
Jul 24 17:45:43.672063 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.672036    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"]
Jul 24 17:45:43.672591 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:45:43.672564    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fda987c_e5bf_4633_8ed4_a92869ef0a9d.slice/crio-c0b8fcaa012aef1abff37e0cd7575de9dd497d678d6485005d4fb3456831626d WatchSource:0}: Error finding container c0b8fcaa012aef1abff37e0cd7575de9dd497d678d6485005d4fb3456831626d: Status 404 returned error can't find the container with id c0b8fcaa012aef1abff37e0cd7575de9dd497d678d6485005d4fb3456831626d
Jul 24 17:45:43.674165 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:43.674136    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:45:44.154370 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:44.154331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c" event={"ID":"ed6288a6-1a35-4a2b-b408-afe996974033","Type":"ContainerStarted","Data":"44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b"}
Jul 24 17:45:44.154628 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:44.154406    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:45:44.154628 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:44.154435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c" event={"ID":"ed6288a6-1a35-4a2b-b408-afe996974033","Type":"ContainerStarted","Data":"b0968c0ca397f268c7a5cdc2c3144083134a64097ee9f4b28e860b3ede8be16c"}
Jul 24 17:45:44.155870 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:44.155846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr" event={"ID":"0fda987c-e5bf-4633-8ed4-a92869ef0a9d","Type":"ContainerStarted","Data":"c0b8fcaa012aef1abff37e0cd7575de9dd497d678d6485005d4fb3456831626d"}
Jul 24 17:45:44.172424 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:44.172382    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c" podStartSLOduration=1.172369371 podStartE2EDuration="1.172369371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:44.170108148 +0000 UTC m=+2136.797986000" watchObservedRunningTime="2026-07-24 17:45:44.172369371 +0000 UTC m=+2136.800247223"
Jul 24 17:45:45.164484 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:45.164442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr" event={"ID":"0fda987c-e5bf-4633-8ed4-a92869ef0a9d","Type":"ContainerStarted","Data":"4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268"}
Jul 24 17:45:45.164977 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:45.164602    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:45.184950 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:45.184904    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr" podStartSLOduration=2.661270899 podStartE2EDuration="3.184888083s" totalImagesPullingTime="523.617184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:45.182354601 +0000 UTC m=+2137.810232453" watchObservedRunningTime="2026-07-24 17:45:45.184888083 +0000 UTC m=+2137.812765936"
Jul 24 17:45:51.176010 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:51.175979    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:45:55.167186 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:45:55.167145    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:46:08.211215 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:46:08.211142    2563 scope.go:117] "RemoveContainer" containerID="94ebd2c7124b92b08563da27b8b67dd188bea36dbd8dd4dc2200e5dd6e4407f8"
Jul 24 17:47:17.558025 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:17.557991    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"]
Jul 24 17:47:17.561652 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:17.561633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"
Jul 24 17:47:17.564547 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:17.564527    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d6flx\""
Jul 24 17:47:17.570648 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:17.570622    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"]
Jul 24 17:47:17.607939 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:17.607888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7bae4e-95b3-4371-80d7-9089be2bc801-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw\" (UID: \"cc7bae4e-95b3-4371-80d7-9089be2bc801\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"
Jul 24 17:47:17.708848 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:17.708804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7bae4e-95b3-4371-80d7-9089be2bc801-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw\" (UID: \"cc7bae4e-95b3-4371-80d7-9089be2bc801\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"
Jul 24 17:47:17.709405 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:17.709385    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7bae4e-95b3-4371-80d7-9089be2bc801-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw\" (UID: \"cc7bae4e-95b3-4371-80d7-9089be2bc801\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"
Jul 24 17:47:17.874043 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:17.873961    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"
Jul 24 17:47:18.021965 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:18.021941    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"]
Jul 24 17:47:18.023531 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:47:18.023501    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7bae4e_95b3_4371_80d7_9089be2bc801.slice/crio-84b25be9d211f3edb24b43c771f35b3200994d84a577f0bf2256ea8ddee09883 WatchSource:0}: Error finding container 84b25be9d211f3edb24b43c771f35b3200994d84a577f0bf2256ea8ddee09883: Status 404 returned error can't find the container with id 84b25be9d211f3edb24b43c771f35b3200994d84a577f0bf2256ea8ddee09883
Jul 24 17:47:18.704252 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:18.704219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw" event={"ID":"cc7bae4e-95b3-4371-80d7-9089be2bc801","Type":"ContainerStarted","Data":"ce614f3a37f9e9f36e23838c1a91cddf3f56f2d88ed24d618353cd35a4f85f4a"}
Jul 24 17:47:18.704687 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:18.704279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw" event={"ID":"cc7bae4e-95b3-4371-80d7-9089be2bc801","Type":"ContainerStarted","Data":"84b25be9d211f3edb24b43c771f35b3200994d84a577f0bf2256ea8ddee09883"}
Jul 24 17:47:18.720264 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:18.720215    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw" podStartSLOduration=1.720197487 podStartE2EDuration="1.720197487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:47:18.71994044 +0000 UTC m=+2231.347818286" watchObservedRunningTime="2026-07-24 17:47:18.720197487 +0000 UTC m=+2231.348075340"
Jul 24 17:47:19.711396 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:19.711358    2563 generic.go:356] "Generic (PLEG): container finished" podID="cc7bae4e-95b3-4371-80d7-9089be2bc801" containerID="ce614f3a37f9e9f36e23838c1a91cddf3f56f2d88ed24d618353cd35a4f85f4a" exitCode=0
Jul 24 17:47:19.711815 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:19.711444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw" event={"ID":"cc7bae4e-95b3-4371-80d7-9089be2bc801","Type":"ContainerDied","Data":"ce614f3a37f9e9f36e23838c1a91cddf3f56f2d88ed24d618353cd35a4f85f4a"}
Jul 24 17:47:20.861372 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:20.861345    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"
Jul 24 17:47:20.937087 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:20.937057    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7bae4e-95b3-4371-80d7-9089be2bc801-maas-api-service-ca\") pod \"cc7bae4e-95b3-4371-80d7-9089be2bc801\" (UID: \"cc7bae4e-95b3-4371-80d7-9089be2bc801\") "
Jul 24 17:47:20.937406 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:20.937381    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7bae4e-95b3-4371-80d7-9089be2bc801-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc7bae4e-95b3-4371-80d7-9089be2bc801" (UID: "cc7bae4e-95b3-4371-80d7-9089be2bc801"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:47:21.038677 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:21.038601    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7bae4e-95b3-4371-80d7-9089be2bc801-maas-api-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:47:21.725010 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:21.724983    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"
Jul 24 17:47:21.725188 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:21.725023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw" event={"ID":"cc7bae4e-95b3-4371-80d7-9089be2bc801","Type":"ContainerDied","Data":"84b25be9d211f3edb24b43c771f35b3200994d84a577f0bf2256ea8ddee09883"}
Jul 24 17:47:21.725188 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:21.725073    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84b25be9d211f3edb24b43c771f35b3200994d84a577f0bf2256ea8ddee09883"
Jul 24 17:47:32.626890 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:32.626760    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"]
Jul 24 17:47:32.629233 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:32.629210    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387e6e-b9xcw"]
Jul 24 17:47:33.938838 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:33.938775    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7bae4e-95b3-4371-80d7-9089be2bc801" path="/var/lib/kubelet/pods/cc7bae4e-95b3-4371-80d7-9089be2bc801/volumes"
Jul 24 17:47:50.041363 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.041322    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"]
Jul 24 17:47:50.041921 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.041548    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr" podUID="0fda987c-e5bf-4633-8ed4-a92869ef0a9d" containerName="maas-api" containerID="cri-o://4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268" gracePeriod=30
Jul 24 17:47:50.218156 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.218120    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"]
Jul 24 17:47:50.218397 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.218368    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c" podUID="ed6288a6-1a35-4a2b-b408-afe996974033" containerName="payload-pre-processing" containerID="cri-o://44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b" gracePeriod=30
Jul 24 17:47:50.346206 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.346179    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:47:50.407298 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.407264    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-openshift-service-ca\") pod \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") "
Jul 24 17:47:50.407447 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.407369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwlbd\" (UniqueName: \"kubernetes.io/projected/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-kube-api-access-xwlbd\") pod \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") "
Jul 24 17:47:50.407447 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.407396    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-maas-api-tls\") pod \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\" (UID: \"0fda987c-e5bf-4633-8ed4-a92869ef0a9d\") "
Jul 24 17:47:50.408279 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.408250    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0fda987c-e5bf-4633-8ed4-a92869ef0a9d" (UID: "0fda987c-e5bf-4633-8ed4-a92869ef0a9d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:47:50.411163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.411134    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0fda987c-e5bf-4633-8ed4-a92869ef0a9d" (UID: "0fda987c-e5bf-4633-8ed4-a92869ef0a9d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:47:50.411258 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.411236    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-kube-api-access-xwlbd" (OuterVolumeSpecName: "kube-api-access-xwlbd") pod "0fda987c-e5bf-4633-8ed4-a92869ef0a9d" (UID: "0fda987c-e5bf-4633-8ed4-a92869ef0a9d"). InnerVolumeSpecName "kube-api-access-xwlbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:47:50.476473 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.476447    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:47:50.508228 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.508193    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed6288a6-1a35-4a2b-b408-afe996974033-plugins-config-volume\") pod \"ed6288a6-1a35-4a2b-b408-afe996974033\" (UID: \"ed6288a6-1a35-4a2b-b408-afe996974033\") "
Jul 24 17:47:50.508425 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.508266    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm7wg\" (UniqueName: \"kubernetes.io/projected/ed6288a6-1a35-4a2b-b408-afe996974033-kube-api-access-gm7wg\") pod \"ed6288a6-1a35-4a2b-b408-afe996974033\" (UID: \"ed6288a6-1a35-4a2b-b408-afe996974033\") "
Jul 24 17:47:50.508518 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.508503    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-openshift-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.508586 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.508522    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwlbd\" (UniqueName: \"kubernetes.io/projected/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-kube-api-access-xwlbd\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.508586 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.508538    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fda987c-e5bf-4633-8ed4-a92869ef0a9d-maas-api-tls\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.508704 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.508627    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed6288a6-1a35-4a2b-b408-afe996974033-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed6288a6-1a35-4a2b-b408-afe996974033" (UID: "ed6288a6-1a35-4a2b-b408-afe996974033"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:47:50.510539 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.510503    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed6288a6-1a35-4a2b-b408-afe996974033-kube-api-access-gm7wg" (OuterVolumeSpecName: "kube-api-access-gm7wg") pod "ed6288a6-1a35-4a2b-b408-afe996974033" (UID: "ed6288a6-1a35-4a2b-b408-afe996974033"). InnerVolumeSpecName "kube-api-access-gm7wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:47:50.609884 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.609775    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed6288a6-1a35-4a2b-b408-afe996974033-plugins-config-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.609884 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.609833    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm7wg\" (UniqueName: \"kubernetes.io/projected/ed6288a6-1a35-4a2b-b408-afe996974033-kube-api-access-gm7wg\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.893443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.893359    2563 generic.go:356] "Generic (PLEG): container finished" podID="ed6288a6-1a35-4a2b-b408-afe996974033" containerID="44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b" exitCode=0
Jul 24 17:47:50.893443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.893405    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"
Jul 24 17:47:50.893688 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.893458    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c" event={"ID":"ed6288a6-1a35-4a2b-b408-afe996974033","Type":"ContainerDied","Data":"44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b"}
Jul 24 17:47:50.893688 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.893517    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c" event={"ID":"ed6288a6-1a35-4a2b-b408-afe996974033","Type":"ContainerDied","Data":"b0968c0ca397f268c7a5cdc2c3144083134a64097ee9f4b28e860b3ede8be16c"}
Jul 24 17:47:50.893688 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.893550    2563 scope.go:117] "RemoveContainer" containerID="44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b"
Jul 24 17:47:50.894964 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.894943    2563 generic.go:356] "Generic (PLEG): container finished" podID="0fda987c-e5bf-4633-8ed4-a92869ef0a9d" containerID="4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268" exitCode=0
Jul 24 17:47:50.895092 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.894973    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"
Jul 24 17:47:50.895092 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.894987    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr" event={"ID":"0fda987c-e5bf-4633-8ed4-a92869ef0a9d","Type":"ContainerDied","Data":"4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268"}
Jul 24 17:47:50.895092 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.895029    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr" event={"ID":"0fda987c-e5bf-4633-8ed4-a92869ef0a9d","Type":"ContainerDied","Data":"c0b8fcaa012aef1abff37e0cd7575de9dd497d678d6485005d4fb3456831626d"}
Jul 24 17:47:50.904885 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.904693    2563 scope.go:117] "RemoveContainer" containerID="44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b"
Jul 24 17:47:50.905009 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:47:50.904990    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b\": container with ID starting with 44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b not found: ID does not exist" containerID="44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b"
Jul 24 17:47:50.905073 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.905017    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b"} err="failed to get container status \"44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b\": rpc error: code = NotFound desc = could not find container \"44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b\": container with ID starting with 44afb16ace8eee860dc358dc2883d96243a1e44c914ca6bf98d15c5e3bb5459b not found: ID does not exist"
Jul 24 17:47:50.905073 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.905035    2563 scope.go:117] "RemoveContainer" containerID="4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268"
Jul 24 17:47:50.914459 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.914443    2563 scope.go:117] "RemoveContainer" containerID="4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268"
Jul 24 17:47:50.914828 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:47:50.914783    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268\": container with ID starting with 4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268 not found: ID does not exist" containerID="4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268"
Jul 24 17:47:50.914954 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.914836    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268"} err="failed to get container status \"4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268\": rpc error: code = NotFound desc = could not find container \"4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268\": container with ID starting with 4cbee29dabbbc7eaa886e5ab8e6b048a9e463dee461678251749187193892268 not found: ID does not exist"
Jul 24 17:47:50.918818 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.918781    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"]
Jul 24 17:47:50.921444 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.921426    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c"]
Jul 24 17:47:50.932866 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.932844    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"]
Jul 24 17:47:50.937602 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:50.937578    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-22bf5f-d55b877d6-gfrwr"]
Jul 24 17:47:51.937013 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:51.936980    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fda987c-e5bf-4633-8ed4-a92869ef0a9d" path="/var/lib/kubelet/pods/0fda987c-e5bf-4633-8ed4-a92869ef0a9d/volumes"
Jul 24 17:47:51.937404 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:47:51.937324    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed6288a6-1a35-4a2b-b408-afe996974033" path="/var/lib/kubelet/pods/ed6288a6-1a35-4a2b-b408-afe996974033/volumes"
Jul 24 17:48:08.244193 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:08.244162    2563 scope.go:117] "RemoveContainer" containerID="8f122fd5046e1144dca453382d62e05309ffc0f95cd0169e1deba72269007a79"
Jul 24 17:48:13.160288 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160253    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"]
Jul 24 17:48:13.160754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160674    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed6288a6-1a35-4a2b-b408-afe996974033" containerName="payload-pre-processing"
Jul 24 17:48:13.160754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160686    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed6288a6-1a35-4a2b-b408-afe996974033" containerName="payload-pre-processing"
Jul 24 17:48:13.160754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160722    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7bae4e-95b3-4371-80d7-9089be2bc801" containerName="revoke-keys"
Jul 24 17:48:13.160754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160731    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7bae4e-95b3-4371-80d7-9089be2bc801" containerName="revoke-keys"
Jul 24 17:48:13.160754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160741    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fda987c-e5bf-4633-8ed4-a92869ef0a9d" containerName="maas-api"
Jul 24 17:48:13.160754 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160747    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fda987c-e5bf-4633-8ed4-a92869ef0a9d" containerName="maas-api"
Jul 24 17:48:13.161123 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160842    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7bae4e-95b3-4371-80d7-9089be2bc801" containerName="revoke-keys"
Jul 24 17:48:13.161123 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160851    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed6288a6-1a35-4a2b-b408-afe996974033" containerName="payload-pre-processing"
Jul 24 17:48:13.161123 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.160861    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fda987c-e5bf-4633-8ed4-a92869ef0a9d" containerName="maas-api"
Jul 24 17:48:13.163999 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.163980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.166942 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.166920    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0e9e3f-serving-cert\""
Jul 24 17:48:13.187406 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.187375    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"]
Jul 24 17:48:13.318692 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.318649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3d8c-aa2f-47ed-a02e-0af891530850-openshift-service-ca\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.318875 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.318716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr92l\" (UniqueName: \"kubernetes.io/projected/b6cc3d8c-aa2f-47ed-a02e-0af891530850-kube-api-access-rr92l\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.318875 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.318767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6cc3d8c-aa2f-47ed-a02e-0af891530850-maas-api-tls\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.419590 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.419515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr92l\" (UniqueName: \"kubernetes.io/projected/b6cc3d8c-aa2f-47ed-a02e-0af891530850-kube-api-access-rr92l\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.419590 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.419558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6cc3d8c-aa2f-47ed-a02e-0af891530850-maas-api-tls\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.419764 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.419647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3d8c-aa2f-47ed-a02e-0af891530850-openshift-service-ca\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.420068 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:48:13.420027    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-serving-cert: secret "maas-api-e2e-api-b-0e9e3f-serving-cert" not found
Jul 24 17:48:13.420291 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:48:13.420124    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6cc3d8c-aa2f-47ed-a02e-0af891530850-maas-api-tls podName:b6cc3d8c-aa2f-47ed-a02e-0af891530850 nodeName:}" failed. No retries permitted until 2026-07-24 17:48:13.920103717 +0000 UTC m=+2286.547981557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b6cc3d8c-aa2f-47ed-a02e-0af891530850-maas-api-tls") pod "maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6" (UID: "b6cc3d8c-aa2f-47ed-a02e-0af891530850") : secret "maas-api-e2e-api-b-0e9e3f-serving-cert" not found
Jul 24 17:48:13.420450 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.420430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3d8c-aa2f-47ed-a02e-0af891530850-openshift-service-ca\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.429573 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.429549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr92l\" (UniqueName: \"kubernetes.io/projected/b6cc3d8c-aa2f-47ed-a02e-0af891530850-kube-api-access-rr92l\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.924396 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.924359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6cc3d8c-aa2f-47ed-a02e-0af891530850-maas-api-tls\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:13.926876 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:13.926856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6cc3d8c-aa2f-47ed-a02e-0af891530850-maas-api-tls\") pod \"maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:14.077413 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:14.077379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:14.212417 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:14.212395    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"]
Jul 24 17:48:14.214697 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:48:14.214657    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cc3d8c_aa2f_47ed_a02e_0af891530850.slice/crio-b6d3a9b44087c08316f609fc4d70dbe4b019bf295e7c459f0471b881f7ec3aab WatchSource:0}: Error finding container b6d3a9b44087c08316f609fc4d70dbe4b019bf295e7c459f0471b881f7ec3aab: Status 404 returned error can't find the container with id b6d3a9b44087c08316f609fc4d70dbe4b019bf295e7c459f0471b881f7ec3aab
Jul 24 17:48:15.046540 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:15.046502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6" event={"ID":"b6cc3d8c-aa2f-47ed-a02e-0af891530850","Type":"ContainerStarted","Data":"2582a513cd79ef044d41cbcad9604d1ea955a500b31507c2b0af0b714410cb18"}
Jul 24 17:48:15.046748 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:15.046568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6" event={"ID":"b6cc3d8c-aa2f-47ed-a02e-0af891530850","Type":"ContainerStarted","Data":"b6d3a9b44087c08316f609fc4d70dbe4b019bf295e7c459f0471b881f7ec3aab"}
Jul 24 17:48:15.046748 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:15.046594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:48:15.065072 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:15.065026    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6" podStartSLOduration=1.692830866 podStartE2EDuration="2.065011362s" totalImagesPullingTime="372.180496ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:15.062357193 +0000 UTC m=+2287.690235058" watchObservedRunningTime="2026-07-24 17:48:15.065011362 +0000 UTC m=+2287.692889213"
Jul 24 17:48:21.057724 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:48:21.057687    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:49:08.179957 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.179860    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"]
Jul 24 17:49:08.180555 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.180093    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6" podUID="b6cc3d8c-aa2f-47ed-a02e-0af891530850" containerName="maas-api" containerID="cri-o://2582a513cd79ef044d41cbcad9604d1ea955a500b31507c2b0af0b714410cb18" gracePeriod=30
Jul 24 17:49:08.352309 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.352270    2563 generic.go:356] "Generic (PLEG): container finished" podID="b6cc3d8c-aa2f-47ed-a02e-0af891530850" containerID="2582a513cd79ef044d41cbcad9604d1ea955a500b31507c2b0af0b714410cb18" exitCode=0
Jul 24 17:49:08.352467 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.352342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6" event={"ID":"b6cc3d8c-aa2f-47ed-a02e-0af891530850","Type":"ContainerDied","Data":"2582a513cd79ef044d41cbcad9604d1ea955a500b31507c2b0af0b714410cb18"}
Jul 24 17:49:08.440552 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.440492    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:49:08.610838 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.610807    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3d8c-aa2f-47ed-a02e-0af891530850-openshift-service-ca\") pod \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") "
Jul 24 17:49:08.611019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.610845    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr92l\" (UniqueName: \"kubernetes.io/projected/b6cc3d8c-aa2f-47ed-a02e-0af891530850-kube-api-access-rr92l\") pod \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") "
Jul 24 17:49:08.611019 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.610938    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6cc3d8c-aa2f-47ed-a02e-0af891530850-maas-api-tls\") pod \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\" (UID: \"b6cc3d8c-aa2f-47ed-a02e-0af891530850\") "
Jul 24 17:49:08.611138 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.611121    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6cc3d8c-aa2f-47ed-a02e-0af891530850-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b6cc3d8c-aa2f-47ed-a02e-0af891530850" (UID: "b6cc3d8c-aa2f-47ed-a02e-0af891530850"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:49:08.611219 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.611202    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6cc3d8c-aa2f-47ed-a02e-0af891530850-openshift-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:49:08.613170 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.613145    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6cc3d8c-aa2f-47ed-a02e-0af891530850-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b6cc3d8c-aa2f-47ed-a02e-0af891530850" (UID: "b6cc3d8c-aa2f-47ed-a02e-0af891530850"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:49:08.613170 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.613162    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6cc3d8c-aa2f-47ed-a02e-0af891530850-kube-api-access-rr92l" (OuterVolumeSpecName: "kube-api-access-rr92l") pod "b6cc3d8c-aa2f-47ed-a02e-0af891530850" (UID: "b6cc3d8c-aa2f-47ed-a02e-0af891530850"). InnerVolumeSpecName "kube-api-access-rr92l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:49:08.712403 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.712333    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6cc3d8c-aa2f-47ed-a02e-0af891530850-maas-api-tls\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:49:08.712403 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:08.712360    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr92l\" (UniqueName: \"kubernetes.io/projected/b6cc3d8c-aa2f-47ed-a02e-0af891530850-kube-api-access-rr92l\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:49:09.360244 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:09.360217    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"
Jul 24 17:49:09.360650 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:09.360255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6" event={"ID":"b6cc3d8c-aa2f-47ed-a02e-0af891530850","Type":"ContainerDied","Data":"b6d3a9b44087c08316f609fc4d70dbe4b019bf295e7c459f0471b881f7ec3aab"}
Jul 24 17:49:09.360650 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:09.360315    2563 scope.go:117] "RemoveContainer" containerID="2582a513cd79ef044d41cbcad9604d1ea955a500b31507c2b0af0b714410cb18"
Jul 24 17:49:09.389588 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:09.389546    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"]
Jul 24 17:49:09.392327 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:09.392289    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0e9e3f-6bf7c9bbb4-47kk6"]
Jul 24 17:49:09.937132 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:09.937101    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6cc3d8c-aa2f-47ed-a02e-0af891530850" path="/var/lib/kubelet/pods/b6cc3d8c-aa2f-47ed-a02e-0af891530850/volumes"
Jul 24 17:49:31.603455 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.603415    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"]
Jul 24 17:49:31.604101 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.604083    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6cc3d8c-aa2f-47ed-a02e-0af891530850" containerName="maas-api"
Jul 24 17:49:31.604164 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.604105    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6cc3d8c-aa2f-47ed-a02e-0af891530850" containerName="maas-api"
Jul 24 17:49:31.604223 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.604212    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6cc3d8c-aa2f-47ed-a02e-0af891530850" containerName="maas-api"
Jul 24 17:49:31.607732 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.607709    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:31.610708 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.610686    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-5c7cfc-serving-cert\""
Jul 24 17:49:31.620457 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.620420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"]
Jul 24 17:49:31.730083 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.730044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjvt8\" (UniqueName: \"kubernetes.io/projected/22a1c173-6172-4270-9a5d-846408be1f1d-kube-api-access-hjvt8\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:31.730277 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.730094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22a1c173-6172-4270-9a5d-846408be1f1d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:31.730277 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.730163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22a1c173-6172-4270-9a5d-846408be1f1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:31.831232 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.831195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjvt8\" (UniqueName: \"kubernetes.io/projected/22a1c173-6172-4270-9a5d-846408be1f1d-kube-api-access-hjvt8\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:31.831397 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.831245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22a1c173-6172-4270-9a5d-846408be1f1d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:31.831397 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.831272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22a1c173-6172-4270-9a5d-846408be1f1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:31.831397 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:49:31.831380    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-serving-cert: secret "maas-api-e2e-shared-b-5c7cfc-serving-cert" not found
Jul 24 17:49:31.831512 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:49:31.831447    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22a1c173-6172-4270-9a5d-846408be1f1d-maas-api-tls podName:22a1c173-6172-4270-9a5d-846408be1f1d nodeName:}" failed. No retries permitted until 2026-07-24 17:49:32.331430478 +0000 UTC m=+2364.959308309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22a1c173-6172-4270-9a5d-846408be1f1d-maas-api-tls") pod "maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl" (UID: "22a1c173-6172-4270-9a5d-846408be1f1d") : secret "maas-api-e2e-shared-b-5c7cfc-serving-cert" not found
Jul 24 17:49:31.832009 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.831988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22a1c173-6172-4270-9a5d-846408be1f1d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:31.847727 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:31.847702    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjvt8\" (UniqueName: \"kubernetes.io/projected/22a1c173-6172-4270-9a5d-846408be1f1d-kube-api-access-hjvt8\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:32.336443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:32.336406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22a1c173-6172-4270-9a5d-846408be1f1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:32.339153 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:32.339126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22a1c173-6172-4270-9a5d-846408be1f1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:32.520605 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:32.520568    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:32.689826 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:32.689774    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"]
Jul 24 17:49:32.690706 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:49:32.690682    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a1c173_6172_4270_9a5d_846408be1f1d.slice/crio-67dcf1e1e1e372ffb4f9f96926681570e38f1434ae796685dd0a7bcc9add5a92 WatchSource:0}: Error finding container 67dcf1e1e1e372ffb4f9f96926681570e38f1434ae796685dd0a7bcc9add5a92: Status 404 returned error can't find the container with id 67dcf1e1e1e372ffb4f9f96926681570e38f1434ae796685dd0a7bcc9add5a92
Jul 24 17:49:33.501692 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:33.501651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl" event={"ID":"22a1c173-6172-4270-9a5d-846408be1f1d","Type":"ContainerStarted","Data":"ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124"}
Jul 24 17:49:33.501992 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:33.501967    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl" event={"ID":"22a1c173-6172-4270-9a5d-846408be1f1d","Type":"ContainerStarted","Data":"67dcf1e1e1e372ffb4f9f96926681570e38f1434ae796685dd0a7bcc9add5a92"}
Jul 24 17:49:33.502151 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:33.502123    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:49:33.541145 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:33.541087    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl" podStartSLOduration=2.212142734 podStartE2EDuration="2.541072955s" totalImagesPullingTime="328.930221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:33.537657207 +0000 UTC m=+2366.165535059" watchObservedRunningTime="2026-07-24 17:49:33.541072955 +0000 UTC m=+2366.168950806"
Jul 24 17:49:39.513100 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:49:39.513068    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 17:50:08.086664 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:50:08.086637    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:50:08.112847 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:50:08.112821    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:50:08.284105 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:50:08.284069    2563 scope.go:117] "RemoveContainer" containerID="132554674e7b4cd5f386f2175b5a68464322ea055f2e2b5c83e69f0be918fed3"
Jul 24 17:54:08.337005 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:54:08.336974    2563 scope.go:117] "RemoveContainer" containerID="ce614f3a37f9e9f36e23838c1a91cddf3f56f2d88ed24d618353cd35a4f85f4a"
Jul 24 17:55:08.122443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:55:08.122369    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:55:08.150821 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:55:08.150784    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 17:56:04.529810 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.529755    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7696-139957309498800"]
Jul 24 17:56:04.533373 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.533353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309498800"
Jul 24 17:56:04.535958 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.535937    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mtwsv\""
Jul 24 17:56:04.540756 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.540728    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957309498800"]
Jul 24 17:56:04.596190 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.596157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rdqj\" (UniqueName: \"kubernetes.io/projected/8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f-kube-api-access-9rdqj\") pod \"test-curl-7696-139957309498800\" (UID: \"8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f\") " pod="opendatahub/test-curl-7696-139957309498800"
Jul 24 17:56:04.697548 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.697505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rdqj\" (UniqueName: \"kubernetes.io/projected/8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f-kube-api-access-9rdqj\") pod \"test-curl-7696-139957309498800\" (UID: \"8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f\") " pod="opendatahub/test-curl-7696-139957309498800"
Jul 24 17:56:04.706886 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.706851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rdqj\" (UniqueName: \"kubernetes.io/projected/8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f-kube-api-access-9rdqj\") pod \"test-curl-7696-139957309498800\" (UID: \"8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f\") " pod="opendatahub/test-curl-7696-139957309498800"
Jul 24 17:56:04.844344 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.844257    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309498800"
Jul 24 17:56:04.983050 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.983017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957309498800"]
Jul 24 17:56:04.983829 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:56:04.983768    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a56bdd4_9d66_4e9f_b2c0_3bc00ca4e05f.slice/crio-a39fc9db9f6b1f5d526acb20513141692013ad19901caa993e0c4b13040bc9c6 WatchSource:0}: Error finding container a39fc9db9f6b1f5d526acb20513141692013ad19901caa993e0c4b13040bc9c6: Status 404 returned error can't find the container with id a39fc9db9f6b1f5d526acb20513141692013ad19901caa993e0c4b13040bc9c6
Jul 24 17:56:04.985161 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:04.985144    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:56:05.773001 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:05.772970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957309498800" event={"ID":"8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f","Type":"ContainerStarted","Data":"cf059d35f0852c16d578d58628bb129d321ae3268a7535b1e6783dd4eebccaad"}
Jul 24 17:56:05.773379 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:05.773014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957309498800" event={"ID":"8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f","Type":"ContainerStarted","Data":"a39fc9db9f6b1f5d526acb20513141692013ad19901caa993e0c4b13040bc9c6"}
Jul 24 17:56:05.791344 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:05.791302    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7696-139957309498800" podStartSLOduration=1.088839727 podStartE2EDuration="1.791286255s" totalImagesPullingTime="702.446528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:56:05.788372106 +0000 UTC m=+2758.416249959" watchObservedRunningTime="2026-07-24 17:56:05.791286255 +0000 UTC m=+2758.419164106"
Jul 24 17:56:05.911023 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:05.910997    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7696-139957309498800_8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f/test-curl-7696-139957309498800/0.log"
Jul 24 17:56:06.780982 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:06.780948    2563 generic.go:356] "Generic (PLEG): container finished" podID="8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f" containerID="cf059d35f0852c16d578d58628bb129d321ae3268a7535b1e6783dd4eebccaad" exitCode=0
Jul 24 17:56:06.780982 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:06.780984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957309498800" event={"ID":"8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f","Type":"ContainerDied","Data":"cf059d35f0852c16d578d58628bb129d321ae3268a7535b1e6783dd4eebccaad"}
Jul 24 17:56:07.933649 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:07.933618    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309498800"
Jul 24 17:56:07.981271 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:07.981232    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7696-139957309498800"]
Jul 24 17:56:07.985163 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:07.985140    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7696-139957309498800"]
Jul 24 17:56:08.025376 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.025347    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rdqj\" (UniqueName: \"kubernetes.io/projected/8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f-kube-api-access-9rdqj\") pod \"8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f\" (UID: \"8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f\") "
Jul 24 17:56:08.027638 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.027603    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f-kube-api-access-9rdqj" (OuterVolumeSpecName: "kube-api-access-9rdqj") pod "8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f" (UID: "8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f"). InnerVolumeSpecName "kube-api-access-9rdqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:08.104982 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.104901    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7696-139957309500080"]
Jul 24 17:56:08.105330 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.105316    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f" containerName="test-curl-7696-139957309498800"
Jul 24 17:56:08.105376 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.105331    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f" containerName="test-curl-7696-139957309498800"
Jul 24 17:56:08.105418 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.105408    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f" containerName="test-curl-7696-139957309498800"
Jul 24 17:56:08.109128 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.109105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309500080"
Jul 24 17:56:08.117245 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.117214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957309500080"]
Jul 24 17:56:08.126711 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.126686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpdf5\" (UniqueName: \"kubernetes.io/projected/ac72010c-d3f2-459b-bdf9-f81ec43c9501-kube-api-access-jpdf5\") pod \"test-curl-7696-139957309500080\" (UID: \"ac72010c-d3f2-459b-bdf9-f81ec43c9501\") " pod="opendatahub/test-curl-7696-139957309500080"
Jul 24 17:56:08.126855 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.126772    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rdqj\" (UniqueName: \"kubernetes.io/projected/8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f-kube-api-access-9rdqj\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:56:08.227320 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.227287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpdf5\" (UniqueName: \"kubernetes.io/projected/ac72010c-d3f2-459b-bdf9-f81ec43c9501-kube-api-access-jpdf5\") pod \"test-curl-7696-139957309500080\" (UID: \"ac72010c-d3f2-459b-bdf9-f81ec43c9501\") " pod="opendatahub/test-curl-7696-139957309500080"
Jul 24 17:56:08.237769 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.237731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpdf5\" (UniqueName: \"kubernetes.io/projected/ac72010c-d3f2-459b-bdf9-f81ec43c9501-kube-api-access-jpdf5\") pod \"test-curl-7696-139957309500080\" (UID: \"ac72010c-d3f2-459b-bdf9-f81ec43c9501\") " pod="opendatahub/test-curl-7696-139957309500080"
Jul 24 17:56:08.419104 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.419073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309500080"
Jul 24 17:56:08.580438 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.580410    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957309500080"]
Jul 24 17:56:08.582434 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:56:08.582414    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac72010c_d3f2_459b_bdf9_f81ec43c9501.slice/crio-c48693db3b8dcabbff95f106980266073836d3aecb099d2d72b03ca66db45056 WatchSource:0}: Error finding container c48693db3b8dcabbff95f106980266073836d3aecb099d2d72b03ca66db45056: Status 404 returned error can't find the container with id c48693db3b8dcabbff95f106980266073836d3aecb099d2d72b03ca66db45056
Jul 24 17:56:08.793292 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.793185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957309500080" event={"ID":"ac72010c-d3f2-459b-bdf9-f81ec43c9501","Type":"ContainerStarted","Data":"c48693db3b8dcabbff95f106980266073836d3aecb099d2d72b03ca66db45056"}
Jul 24 17:56:08.794469 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.794442    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a39fc9db9f6b1f5d526acb20513141692013ad19901caa993e0c4b13040bc9c6"
Jul 24 17:56:08.794616 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:08.794480    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309498800"
Jul 24 17:56:08.810747 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:56:08.810709    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7696-139957309498800\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f" pod="opendatahub/test-curl-7696-139957309498800"
Jul 24 17:56:09.801592 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:09.801559    2563 generic.go:356] "Generic (PLEG): container finished" podID="ac72010c-d3f2-459b-bdf9-f81ec43c9501" containerID="d26a8af29145ff03732ea4f56562f2ddce6c92e6e65ca14131a60210abb8cc11" exitCode=0
Jul 24 17:56:09.802023 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:09.801632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957309500080" event={"ID":"ac72010c-d3f2-459b-bdf9-f81ec43c9501","Type":"ContainerDied","Data":"d26a8af29145ff03732ea4f56562f2ddce6c92e6e65ca14131a60210abb8cc11"}
Jul 24 17:56:09.804491 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:56:09.804464    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7696-139957309498800\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f" pod="opendatahub/test-curl-7696-139957309498800"
Jul 24 17:56:09.937392 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:09.937353    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f" path="/var/lib/kubelet/pods/8a56bdd4-9d66-4e9f-b2c0-3bc00ca4e05f/volumes"
Jul 24 17:56:10.942250 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:10.942226    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309500080"
Jul 24 17:56:10.949722 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:10.949702    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpdf5\" (UniqueName: \"kubernetes.io/projected/ac72010c-d3f2-459b-bdf9-f81ec43c9501-kube-api-access-jpdf5\") pod \"ac72010c-d3f2-459b-bdf9-f81ec43c9501\" (UID: \"ac72010c-d3f2-459b-bdf9-f81ec43c9501\") "
Jul 24 17:56:10.951812 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:10.951764    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac72010c-d3f2-459b-bdf9-f81ec43c9501-kube-api-access-jpdf5" (OuterVolumeSpecName: "kube-api-access-jpdf5") pod "ac72010c-d3f2-459b-bdf9-f81ec43c9501" (UID: "ac72010c-d3f2-459b-bdf9-f81ec43c9501"). InnerVolumeSpecName "kube-api-access-jpdf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:10.962948 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:10.962931    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7696-139957309500080_ac72010c-d3f2-459b-bdf9-f81ec43c9501/test-curl-7696-139957309500080/0.log"
Jul 24 17:56:10.988557 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:10.988524    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7696-139957309500080"]
Jul 24 17:56:10.992310 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:10.992292    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7696-139957309500080"]
Jul 24 17:56:11.051176 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.051148    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpdf5\" (UniqueName: \"kubernetes.io/projected/ac72010c-d3f2-459b-bdf9-f81ec43c9501-kube-api-access-jpdf5\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:56:11.154417 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.154339    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:11.154736 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.154724    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac72010c-d3f2-459b-bdf9-f81ec43c9501" containerName="test-curl-7696-139957309500080"
Jul 24 17:56:11.154784 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.154738    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac72010c-d3f2-459b-bdf9-f81ec43c9501" containerName="test-curl-7696-139957309500080"
Jul 24 17:56:11.154862 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.154850    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac72010c-d3f2-459b-bdf9-f81ec43c9501" containerName="test-curl-7696-139957309500080"
Jul 24 17:56:11.158017 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.157999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:11.165578 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.165124    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:11.253220 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.253181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b8b8\" (UniqueName: \"kubernetes.io/projected/ef478c33-00ca-4b52-8f08-594898cc92b1-kube-api-access-8b8b8\") pod \"test-curl-7696-139957315971088\" (UID: \"ef478c33-00ca-4b52-8f08-594898cc92b1\") " pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:11.354699 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.354667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b8b8\" (UniqueName: \"kubernetes.io/projected/ef478c33-00ca-4b52-8f08-594898cc92b1-kube-api-access-8b8b8\") pod \"test-curl-7696-139957315971088\" (UID: \"ef478c33-00ca-4b52-8f08-594898cc92b1\") " pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:11.366337 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.366308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b8b8\" (UniqueName: \"kubernetes.io/projected/ef478c33-00ca-4b52-8f08-594898cc92b1-kube-api-access-8b8b8\") pod \"test-curl-7696-139957315971088\" (UID: \"ef478c33-00ca-4b52-8f08-594898cc92b1\") " pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:11.469100 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.469065    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:11.609285 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.609250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:11.609988 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:56:11.609944    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef478c33_00ca_4b52_8f08_594898cc92b1.slice/crio-b9b9bab768950fc1936bf5a666dede3759fa8f3f5d84a453f210d40ecf929339 WatchSource:0}: Error finding container b9b9bab768950fc1936bf5a666dede3759fa8f3f5d84a453f210d40ecf929339: Status 404 returned error can't find the container with id b9b9bab768950fc1936bf5a666dede3759fa8f3f5d84a453f210d40ecf929339
Jul 24 17:56:11.813691 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.813605    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309500080"
Jul 24 17:56:11.813905 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.813613    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c48693db3b8dcabbff95f106980266073836d3aecb099d2d72b03ca66db45056"
Jul 24 17:56:11.815119 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.815089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957315971088" event={"ID":"ef478c33-00ca-4b52-8f08-594898cc92b1","Type":"ContainerStarted","Data":"b9b9bab768950fc1936bf5a666dede3759fa8f3f5d84a453f210d40ecf929339"}
Jul 24 17:56:11.824766 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:56:11.824738    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7696-139957309500080\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="ac72010c-d3f2-459b-bdf9-f81ec43c9501" pod="opendatahub/test-curl-7696-139957309500080"
Jul 24 17:56:11.938695 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:11.938667    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac72010c-d3f2-459b-bdf9-f81ec43c9501" path="/var/lib/kubelet/pods/ac72010c-d3f2-459b-bdf9-f81ec43c9501/volumes"
Jul 24 17:56:12.822530 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:12.822496    2563 generic.go:356] "Generic (PLEG): container finished" podID="ef478c33-00ca-4b52-8f08-594898cc92b1" containerID="8b3c7d1c236a78d8be855d626377bd1bff832b1eea630af982c89109bca4ea13" exitCode=0
Jul 24 17:56:12.822993 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:12.822585    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957315971088" event={"ID":"ef478c33-00ca-4b52-8f08-594898cc92b1","Type":"ContainerDied","Data":"8b3c7d1c236a78d8be855d626377bd1bff832b1eea630af982c89109bca4ea13"}
Jul 24 17:56:13.972151 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:13.972124    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:13.994992 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:13.994964    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7696-139957315971088_ef478c33-00ca-4b52-8f08-594898cc92b1/test-curl-7696-139957315971088/0.log"
Jul 24 17:56:14.020145 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.020115    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:14.024512 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.024489    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:14.077480 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.077456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b8b8\" (UniqueName: \"kubernetes.io/projected/ef478c33-00ca-4b52-8f08-594898cc92b1-kube-api-access-8b8b8\") pod \"ef478c33-00ca-4b52-8f08-594898cc92b1\" (UID: \"ef478c33-00ca-4b52-8f08-594898cc92b1\") "
Jul 24 17:56:14.079695 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.079628    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef478c33-00ca-4b52-8f08-594898cc92b1-kube-api-access-8b8b8" (OuterVolumeSpecName: "kube-api-access-8b8b8") pod "ef478c33-00ca-4b52-8f08-594898cc92b1" (UID: "ef478c33-00ca-4b52-8f08-594898cc92b1"). InnerVolumeSpecName "kube-api-access-8b8b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:14.147048 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.147019    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:14.147445 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.147431    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef478c33-00ca-4b52-8f08-594898cc92b1" containerName="test-curl-7696-139957315971088"
Jul 24 17:56:14.147495 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.147447    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef478c33-00ca-4b52-8f08-594898cc92b1" containerName="test-curl-7696-139957315971088"
Jul 24 17:56:14.147531 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.147519    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef478c33-00ca-4b52-8f08-594898cc92b1" containerName="test-curl-7696-139957315971088"
Jul 24 17:56:14.150391 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.150375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:14.155001 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.154981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:14.178107 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.178086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwpml\" (UniqueName: \"kubernetes.io/projected/33d69c22-89c3-4bfd-b0a6-78b8c26241ad-kube-api-access-jwpml\") pod \"test-curl-7696-139957315971088\" (UID: \"33d69c22-89c3-4bfd-b0a6-78b8c26241ad\") " pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:14.178204 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.178164    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b8b8\" (UniqueName: \"kubernetes.io/projected/ef478c33-00ca-4b52-8f08-594898cc92b1-kube-api-access-8b8b8\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:56:14.278865 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.278831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwpml\" (UniqueName: \"kubernetes.io/projected/33d69c22-89c3-4bfd-b0a6-78b8c26241ad-kube-api-access-jwpml\") pod \"test-curl-7696-139957315971088\" (UID: \"33d69c22-89c3-4bfd-b0a6-78b8c26241ad\") " pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:14.288689 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.288656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwpml\" (UniqueName: \"kubernetes.io/projected/33d69c22-89c3-4bfd-b0a6-78b8c26241ad-kube-api-access-jwpml\") pod \"test-curl-7696-139957315971088\" (UID: \"33d69c22-89c3-4bfd-b0a6-78b8c26241ad\") " pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:14.461283 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.461248    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:14.598878 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.598849    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:14.600641 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:56:14.600615    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33d69c22_89c3_4bfd_b0a6_78b8c26241ad.slice/crio-76b369c4061a5ca7a47a439340ca33bdf692f1aae9178351ab19521baf49cb35 WatchSource:0}: Error finding container 76b369c4061a5ca7a47a439340ca33bdf692f1aae9178351ab19521baf49cb35: Status 404 returned error can't find the container with id 76b369c4061a5ca7a47a439340ca33bdf692f1aae9178351ab19521baf49cb35
Jul 24 17:56:14.836890 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.836769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957315971088" event={"ID":"33d69c22-89c3-4bfd-b0a6-78b8c26241ad","Type":"ContainerStarted","Data":"76b369c4061a5ca7a47a439340ca33bdf692f1aae9178351ab19521baf49cb35"}
Jul 24 17:56:14.838058 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.838028    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9b9bab768950fc1936bf5a666dede3759fa8f3f5d84a453f210d40ecf929339"
Jul 24 17:56:14.838058 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.838036    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:14.849984 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:14.849957    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7696-139957315971088" oldPodUID="ef478c33-00ca-4b52-8f08-594898cc92b1" podUID="33d69c22-89c3-4bfd-b0a6-78b8c26241ad"
Jul 24 17:56:15.845672 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:15.845634    2563 generic.go:356] "Generic (PLEG): container finished" podID="33d69c22-89c3-4bfd-b0a6-78b8c26241ad" containerID="b33fd2d0e09a1e74de3b69c9d10d98f3e4430e1331a876b493369f31abeceea1" exitCode=0
Jul 24 17:56:15.846113 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:15.845727    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957315971088" event={"ID":"33d69c22-89c3-4bfd-b0a6-78b8c26241ad","Type":"ContainerDied","Data":"b33fd2d0e09a1e74de3b69c9d10d98f3e4430e1331a876b493369f31abeceea1"}
Jul 24 17:56:15.937979 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:15.937949    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef478c33-00ca-4b52-8f08-594898cc92b1" path="/var/lib/kubelet/pods/ef478c33-00ca-4b52-8f08-594898cc92b1/volumes"
Jul 24 17:56:16.994454 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:16.994428    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:17.017224 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.017194    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7696-139957315971088_33d69c22-89c3-4bfd-b0a6-78b8c26241ad/test-curl-7696-139957315971088/0.log"
Jul 24 17:56:17.040484 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.040457    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:17.044618 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.044594    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7696-139957315971088"]
Jul 24 17:56:17.103385 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.103316    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwpml\" (UniqueName: \"kubernetes.io/projected/33d69c22-89c3-4bfd-b0a6-78b8c26241ad-kube-api-access-jwpml\") pod \"33d69c22-89c3-4bfd-b0a6-78b8c26241ad\" (UID: \"33d69c22-89c3-4bfd-b0a6-78b8c26241ad\") "
Jul 24 17:56:17.105579 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.105547    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33d69c22-89c3-4bfd-b0a6-78b8c26241ad-kube-api-access-jwpml" (OuterVolumeSpecName: "kube-api-access-jwpml") pod "33d69c22-89c3-4bfd-b0a6-78b8c26241ad" (UID: "33d69c22-89c3-4bfd-b0a6-78b8c26241ad"). InnerVolumeSpecName "kube-api-access-jwpml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:17.171536 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.171504    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:17.172009 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.171989    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33d69c22-89c3-4bfd-b0a6-78b8c26241ad" containerName="test-curl-7696-139957315971088"
Jul 24 17:56:17.172111 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.172010    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="33d69c22-89c3-4bfd-b0a6-78b8c26241ad" containerName="test-curl-7696-139957315971088"
Jul 24 17:56:17.172168 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.172118    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="33d69c22-89c3-4bfd-b0a6-78b8c26241ad" containerName="test-curl-7696-139957315971088"
Jul 24 17:56:17.175049 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.175031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:17.180939 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.180915    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:17.204549 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.204522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrjwj\" (UniqueName: \"kubernetes.io/projected/75abba40-5446-49c5-8626-350e48c92ba7-kube-api-access-zrjwj\") pod \"test-curl-7696-139957309437392\" (UID: \"75abba40-5446-49c5-8626-350e48c92ba7\") " pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:17.204670 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.204639    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwpml\" (UniqueName: \"kubernetes.io/projected/33d69c22-89c3-4bfd-b0a6-78b8c26241ad-kube-api-access-jwpml\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:56:17.305121 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.305094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrjwj\" (UniqueName: \"kubernetes.io/projected/75abba40-5446-49c5-8626-350e48c92ba7-kube-api-access-zrjwj\") pod \"test-curl-7696-139957309437392\" (UID: \"75abba40-5446-49c5-8626-350e48c92ba7\") " pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:17.315410 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.315388    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrjwj\" (UniqueName: \"kubernetes.io/projected/75abba40-5446-49c5-8626-350e48c92ba7-kube-api-access-zrjwj\") pod \"test-curl-7696-139957309437392\" (UID: \"75abba40-5446-49c5-8626-350e48c92ba7\") " pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:17.486635 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.486608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:17.647713 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.647686    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:17.648654 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:56:17.648629    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75abba40_5446_49c5_8626_350e48c92ba7.slice/crio-8b157156748df41e629c4254133faa1626549e9259d29accf1f9d2feb6e63b5c WatchSource:0}: Error finding container 8b157156748df41e629c4254133faa1626549e9259d29accf1f9d2feb6e63b5c: Status 404 returned error can't find the container with id 8b157156748df41e629c4254133faa1626549e9259d29accf1f9d2feb6e63b5c
Jul 24 17:56:17.858968 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.858885    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:17.858968 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.858918    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76b369c4061a5ca7a47a439340ca33bdf692f1aae9178351ab19521baf49cb35"
Jul 24 17:56:17.860189 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.860162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957309437392" event={"ID":"75abba40-5446-49c5-8626-350e48c92ba7","Type":"ContainerStarted","Data":"8b157156748df41e629c4254133faa1626549e9259d29accf1f9d2feb6e63b5c"}
Jul 24 17:56:17.869934 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:56:17.869907    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7696-139957315971088\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="33d69c22-89c3-4bfd-b0a6-78b8c26241ad" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:17.936433 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:56:17.936404    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7696-139957315971088\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="33d69c22-89c3-4bfd-b0a6-78b8c26241ad" pod="opendatahub/test-curl-7696-139957315971088"
Jul 24 17:56:17.937996 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:17.937976    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33d69c22-89c3-4bfd-b0a6-78b8c26241ad" path="/var/lib/kubelet/pods/33d69c22-89c3-4bfd-b0a6-78b8c26241ad/volumes"
Jul 24 17:56:18.867731 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:18.867699    2563 generic.go:356] "Generic (PLEG): container finished" podID="75abba40-5446-49c5-8626-350e48c92ba7" containerID="bcb6e12ce7c7d5026e33f003aa503e54aed23867bdcd543ec7c80ccddd7e05e3" exitCode=0
Jul 24 17:56:18.868156 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:18.867810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957309437392" event={"ID":"75abba40-5446-49c5-8626-350e48c92ba7","Type":"ContainerDied","Data":"bcb6e12ce7c7d5026e33f003aa503e54aed23867bdcd543ec7c80ccddd7e05e3"}
Jul 24 17:56:20.015819 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.015774    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:20.038924 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.038901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7696-139957309437392_75abba40-5446-49c5-8626-350e48c92ba7/test-curl-7696-139957309437392/0.log"
Jul 24 17:56:20.067583 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.067554    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:20.073184 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.073163    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:20.129926 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.129853    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrjwj\" (UniqueName: \"kubernetes.io/projected/75abba40-5446-49c5-8626-350e48c92ba7-kube-api-access-zrjwj\") pod \"75abba40-5446-49c5-8626-350e48c92ba7\" (UID: \"75abba40-5446-49c5-8626-350e48c92ba7\") "
Jul 24 17:56:20.132062 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.132031    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75abba40-5446-49c5-8626-350e48c92ba7-kube-api-access-zrjwj" (OuterVolumeSpecName: "kube-api-access-zrjwj") pod "75abba40-5446-49c5-8626-350e48c92ba7" (UID: "75abba40-5446-49c5-8626-350e48c92ba7"). InnerVolumeSpecName "kube-api-access-zrjwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:20.209063 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.209022    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:20.209492 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.209474    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75abba40-5446-49c5-8626-350e48c92ba7" containerName="test-curl-7696-139957309437392"
Jul 24 17:56:20.209572 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.209496    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="75abba40-5446-49c5-8626-350e48c92ba7" containerName="test-curl-7696-139957309437392"
Jul 24 17:56:20.209637 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.209619    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="75abba40-5446-49c5-8626-350e48c92ba7" containerName="test-curl-7696-139957309437392"
Jul 24 17:56:20.212688 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.212668    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:20.223463 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.223439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:20.231131 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.231108    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrjwj\" (UniqueName: \"kubernetes.io/projected/75abba40-5446-49c5-8626-350e48c92ba7-kube-api-access-zrjwj\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:56:20.331725 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.331697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bf56\" (UniqueName: \"kubernetes.io/projected/3ceef1d0-7c5d-4886-9a4b-454e6fd00de9-kube-api-access-7bf56\") pod \"test-curl-7696-139957309437392\" (UID: \"3ceef1d0-7c5d-4886-9a4b-454e6fd00de9\") " pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:20.432877 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.432843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bf56\" (UniqueName: \"kubernetes.io/projected/3ceef1d0-7c5d-4886-9a4b-454e6fd00de9-kube-api-access-7bf56\") pod \"test-curl-7696-139957309437392\" (UID: \"3ceef1d0-7c5d-4886-9a4b-454e6fd00de9\") " pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:20.441657 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.441630    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bf56\" (UniqueName: \"kubernetes.io/projected/3ceef1d0-7c5d-4886-9a4b-454e6fd00de9-kube-api-access-7bf56\") pod \"test-curl-7696-139957309437392\" (UID: \"3ceef1d0-7c5d-4886-9a4b-454e6fd00de9\") " pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:20.522489 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.522452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:20.661775 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.661738    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:20.662922 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:56:20.662899    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ceef1d0_7c5d_4886_9a4b_454e6fd00de9.slice/crio-48b0dea63632d28296609924a35ca5ed010858e58c2328a9de8d620d33894f26 WatchSource:0}: Error finding container 48b0dea63632d28296609924a35ca5ed010858e58c2328a9de8d620d33894f26: Status 404 returned error can't find the container with id 48b0dea63632d28296609924a35ca5ed010858e58c2328a9de8d620d33894f26
Jul 24 17:56:20.880624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.880586    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:20.880624 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.880615    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b157156748df41e629c4254133faa1626549e9259d29accf1f9d2feb6e63b5c"
Jul 24 17:56:20.881879 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.881856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957309437392" event={"ID":"3ceef1d0-7c5d-4886-9a4b-454e6fd00de9","Type":"ContainerStarted","Data":"48b0dea63632d28296609924a35ca5ed010858e58c2328a9de8d620d33894f26"}
Jul 24 17:56:20.892931 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:20.892907    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7696-139957309437392" oldPodUID="75abba40-5446-49c5-8626-350e48c92ba7" podUID="3ceef1d0-7c5d-4886-9a4b-454e6fd00de9"
Jul 24 17:56:21.889779 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:21.889739    2563 generic.go:356] "Generic (PLEG): container finished" podID="3ceef1d0-7c5d-4886-9a4b-454e6fd00de9" containerID="7941488392bc3448a57502e2f9877bc018bee43bef072edf745afbc9c7e46a0f" exitCode=0
Jul 24 17:56:21.890200 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:21.889820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-139957309437392" event={"ID":"3ceef1d0-7c5d-4886-9a4b-454e6fd00de9","Type":"ContainerDied","Data":"7941488392bc3448a57502e2f9877bc018bee43bef072edf745afbc9c7e46a0f"}
Jul 24 17:56:21.937287 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:21.937259    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75abba40-5446-49c5-8626-350e48c92ba7" path="/var/lib/kubelet/pods/75abba40-5446-49c5-8626-350e48c92ba7/volumes"
Jul 24 17:56:23.043033 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.043007    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:23.062633 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.062611    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7696-139957309437392_3ceef1d0-7c5d-4886-9a4b-454e6fd00de9/test-curl-7696-139957309437392/0.log"
Jul 24 17:56:23.088319 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.088284    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:23.092844 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.092820    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7696-139957309437392"]
Jul 24 17:56:23.155731 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.155710    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bf56\" (UniqueName: \"kubernetes.io/projected/3ceef1d0-7c5d-4886-9a4b-454e6fd00de9-kube-api-access-7bf56\") pod \"3ceef1d0-7c5d-4886-9a4b-454e6fd00de9\" (UID: \"3ceef1d0-7c5d-4886-9a4b-454e6fd00de9\") "
Jul 24 17:56:23.157895 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.157871    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ceef1d0-7c5d-4886-9a4b-454e6fd00de9-kube-api-access-7bf56" (OuterVolumeSpecName: "kube-api-access-7bf56") pod "3ceef1d0-7c5d-4886-9a4b-454e6fd00de9" (UID: "3ceef1d0-7c5d-4886-9a4b-454e6fd00de9"). InnerVolumeSpecName "kube-api-access-7bf56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:23.256735 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.256704    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bf56\" (UniqueName: \"kubernetes.io/projected/3ceef1d0-7c5d-4886-9a4b-454e6fd00de9-kube-api-access-7bf56\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:56:23.904446 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.904418    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48b0dea63632d28296609924a35ca5ed010858e58c2328a9de8d620d33894f26"
Jul 24 17:56:23.904622 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.904477    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:23.917950 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:56:23.917919    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7696-139957309437392\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="3ceef1d0-7c5d-4886-9a4b-454e6fd00de9" pod="opendatahub/test-curl-7696-139957309437392"
Jul 24 17:56:23.938416 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:23.938387    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ceef1d0-7c5d-4886-9a4b-454e6fd00de9" path="/var/lib/kubelet/pods/3ceef1d0-7c5d-4886-9a4b-454e6fd00de9/volumes"
Jul 24 17:56:30.155563 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.155487    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"]
Jul 24 17:56:30.156016 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.155999    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ceef1d0-7c5d-4886-9a4b-454e6fd00de9" containerName="test-curl-7696-139957309437392"
Jul 24 17:56:30.156058 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.156018    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ceef1d0-7c5d-4886-9a4b-454e6fd00de9" containerName="test-curl-7696-139957309437392"
Jul 24 17:56:30.156108 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.156099    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ceef1d0-7c5d-4886-9a4b-454e6fd00de9" containerName="test-curl-7696-139957309437392"
Jul 24 17:56:30.160201 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.160168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.164372 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.164348    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-8a6414-serving-cert\""
Jul 24 17:56:30.187385 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.187358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"]
Jul 24 17:56:30.226702 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.226669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cf810c9-4838-4947-b1e1-23df56d645f4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.226861 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.226710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf810c9-4838-4947-b1e1-23df56d645f4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.226861 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.226788    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlnx6\" (UniqueName: \"kubernetes.io/projected/7cf810c9-4838-4947-b1e1-23df56d645f4-kube-api-access-vlnx6\") pod \"maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.327473 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.327436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cf810c9-4838-4947-b1e1-23df56d645f4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.327473 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.327472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf810c9-4838-4947-b1e1-23df56d645f4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.327710 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.327500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlnx6\" (UniqueName: \"kubernetes.io/projected/7cf810c9-4838-4947-b1e1-23df56d645f4-kube-api-access-vlnx6\") pod \"maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.328190 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.328165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf810c9-4838-4947-b1e1-23df56d645f4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.330027 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.330008    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cf810c9-4838-4947-b1e1-23df56d645f4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.338281 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.338251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlnx6\" (UniqueName: \"kubernetes.io/projected/7cf810c9-4838-4947-b1e1-23df56d645f4-kube-api-access-vlnx6\") pod \"maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.474168 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.474085    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:30.623553 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.623527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"]
Jul 24 17:56:30.624781 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:56:30.624753    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf810c9_4838_4947_b1e1_23df56d645f4.slice/crio-f58e31933f921572e2e9a15cb4c90282f9e5b2095389cb389710dfc81c1f8f3f WatchSource:0}: Error finding container f58e31933f921572e2e9a15cb4c90282f9e5b2095389cb389710dfc81c1f8f3f: Status 404 returned error can't find the container with id f58e31933f921572e2e9a15cb4c90282f9e5b2095389cb389710dfc81c1f8f3f
Jul 24 17:56:30.916875 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.916841    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"]
Jul 24 17:56:30.920556 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.920539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:30.924045 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.924018    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-8a6414-dockercfg-fbjp9\""
Jul 24 17:56:30.924367 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.924331    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-8a6414\""
Jul 24 17:56:30.935422 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.935396    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"]
Jul 24 17:56:30.949361 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:30.949330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm" event={"ID":"7cf810c9-4838-4947-b1e1-23df56d645f4","Type":"ContainerStarted","Data":"f58e31933f921572e2e9a15cb4c90282f9e5b2095389cb389710dfc81c1f8f3f"}
Jul 24 17:56:31.032838 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.032809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5lc\" (UniqueName: \"kubernetes.io/projected/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-kube-api-access-ft5lc\") pod \"payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw\" (UID: \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:31.032932 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.032903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw\" (UID: \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:31.133851 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.133808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw\" (UID: \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:31.134014 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.133888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5lc\" (UniqueName: \"kubernetes.io/projected/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-kube-api-access-ft5lc\") pod \"payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw\" (UID: \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:31.134476 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.134457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw\" (UID: \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:31.142644 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.142624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5lc\" (UniqueName: \"kubernetes.io/projected/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-kube-api-access-ft5lc\") pod \"payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw\" (UID: \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:31.232633 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.232560    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:31.381787 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.381713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"]
Jul 24 17:56:31.382900 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:56:31.382865    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2470194_c1d9_4b34_86d4_beeeb8f69ab3.slice/crio-aff1594aa774880d13763160ba1311947ff56edb71e2b6403a1b4fdc5fbb52a8 WatchSource:0}: Error finding container aff1594aa774880d13763160ba1311947ff56edb71e2b6403a1b4fdc5fbb52a8: Status 404 returned error can't find the container with id aff1594aa774880d13763160ba1311947ff56edb71e2b6403a1b4fdc5fbb52a8
Jul 24 17:56:31.957050 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.957010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw" event={"ID":"b2470194-c1d9-4b34-86d4-beeeb8f69ab3","Type":"ContainerStarted","Data":"9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251"}
Jul 24 17:56:31.957237 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.957085    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:31.957237 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.957113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw" event={"ID":"b2470194-c1d9-4b34-86d4-beeeb8f69ab3","Type":"ContainerStarted","Data":"aff1594aa774880d13763160ba1311947ff56edb71e2b6403a1b4fdc5fbb52a8"}
Jul 24 17:56:31.958551 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.958529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm" event={"ID":"7cf810c9-4838-4947-b1e1-23df56d645f4","Type":"ContainerStarted","Data":"422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7"}
Jul 24 17:56:31.958654 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.958576    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:31.975333 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.975295    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw" podStartSLOduration=1.9752816100000001 podStartE2EDuration="1.97528161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:56:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:56:31.974492277 +0000 UTC m=+2784.602370153" watchObservedRunningTime="2026-07-24 17:56:31.97528161 +0000 UTC m=+2784.603159461"
Jul 24 17:56:31.993786 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:31.993743    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm" podStartSLOduration=1.589379873 podStartE2EDuration="1.993728955s" totalImagesPullingTime="404.349082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:56:31.991149117 +0000 UTC m=+2784.619026968" watchObservedRunningTime="2026-07-24 17:56:31.993728955 +0000 UTC m=+2784.621606808"
Jul 24 17:56:37.970365 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:37.970336    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:56:42.966881 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:42.966849    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:56:49.943683 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:49.943650    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"]
Jul 24 17:56:49.947606 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:49.947584    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:56:49.952884 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:49.952859    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-bd0742\""
Jul 24 17:56:49.952983 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:49.952908    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-bd0742-dockercfg-qprq8\""
Jul 24 17:56:49.961976 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:49.961949    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"]
Jul 24 17:56:50.015076 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:50.015037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz8zd\" (UniqueName: \"kubernetes.io/projected/337b6558-d2c3-4fbd-8989-40de15174a0c-kube-api-access-bz8zd\") pod \"payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk\" (UID: \"337b6558-d2c3-4fbd-8989-40de15174a0c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:56:50.015076 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:50.015073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/337b6558-d2c3-4fbd-8989-40de15174a0c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk\" (UID: \"337b6558-d2c3-4fbd-8989-40de15174a0c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:56:50.115464 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:50.115429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz8zd\" (UniqueName: \"kubernetes.io/projected/337b6558-d2c3-4fbd-8989-40de15174a0c-kube-api-access-bz8zd\") pod \"payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk\" (UID: \"337b6558-d2c3-4fbd-8989-40de15174a0c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:56:50.115639 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:50.115478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/337b6558-d2c3-4fbd-8989-40de15174a0c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk\" (UID: \"337b6558-d2c3-4fbd-8989-40de15174a0c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:56:50.116189 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:50.116171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/337b6558-d2c3-4fbd-8989-40de15174a0c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk\" (UID: \"337b6558-d2c3-4fbd-8989-40de15174a0c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:56:50.128707 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:50.128678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz8zd\" (UniqueName: \"kubernetes.io/projected/337b6558-d2c3-4fbd-8989-40de15174a0c-kube-api-access-bz8zd\") pod \"payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk\" (UID: \"337b6558-d2c3-4fbd-8989-40de15174a0c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:56:50.259012 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:50.258927    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:56:50.408018 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:50.407978    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"]
Jul 24 17:56:50.408446 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:56:50.408422    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337b6558_d2c3_4fbd_8989_40de15174a0c.slice/crio-daa6be4b12a79d022912ca34fbb4215c35f5c60614435ec221cac8f427151665 WatchSource:0}: Error finding container daa6be4b12a79d022912ca34fbb4215c35f5c60614435ec221cac8f427151665: Status 404 returned error can't find the container with id daa6be4b12a79d022912ca34fbb4215c35f5c60614435ec221cac8f427151665
Jul 24 17:56:51.082628 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:51.082592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk" event={"ID":"337b6558-d2c3-4fbd-8989-40de15174a0c","Type":"ContainerStarted","Data":"6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0"}
Jul 24 17:56:51.083008 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:51.082653    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:56:51.083008 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:51.082673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk" event={"ID":"337b6558-d2c3-4fbd-8989-40de15174a0c","Type":"ContainerStarted","Data":"daa6be4b12a79d022912ca34fbb4215c35f5c60614435ec221cac8f427151665"}
Jul 24 17:56:51.105007 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:56:51.104948    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk" podStartSLOduration=2.104928678 podStartE2EDuration="2.104928678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:56:51.102686645 +0000 UTC m=+2803.730564498" watchObservedRunningTime="2026-07-24 17:56:51.104928678 +0000 UTC m=+2803.732806532"
Jul 24 17:57:02.090856 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:02.090824    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 17:57:10.680204 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:10.680157    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-44t9h_dfbfdcdc-ff69-44e5-afea-1aac1f907044/payload-processing/0.log"
Jul 24 17:57:10.800355 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:10.800324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk_337b6558-d2c3-4fbd-8989-40de15174a0c/payload-processing/0.log"
Jul 24 17:57:18.163097 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.163065    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"]
Jul 24 17:57:18.166508 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.166488    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.170630 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.170608    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-8a6414\"/\"ipp-route-8a6414-kserve-self-signed-certs\""
Jul 24 17:57:18.170746 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.170630    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-8a6414\"/\"kube-root-ca.crt\""
Jul 24 17:57:18.170746 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.170615    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-8a6414\"/\"openshift-service-ca.crt\""
Jul 24 17:57:18.170746 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.170616    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-8a6414\"/\"default-dockercfg-tg6ws\""
Jul 24 17:57:18.178331 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.178298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"]
Jul 24 17:57:18.267348 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.267314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz4vt\" (UniqueName: \"kubernetes.io/projected/bd583885-7769-4c24-bf43-8d4361832242-kube-api-access-zz4vt\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.267524 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.267369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-home\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.267524 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.267389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-model-cache\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.267524 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.267410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-dshm\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.267524 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.267430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-tmp-dir\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.267708 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.267567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd583885-7769-4c24-bf43-8d4361832242-tls-certs\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.368857 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.368820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz4vt\" (UniqueName: \"kubernetes.io/projected/bd583885-7769-4c24-bf43-8d4361832242-kube-api-access-zz4vt\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.369038 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.368882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-home\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.369038 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.368901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-model-cache\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.369038 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.368931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-dshm\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.369038 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.368962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-tmp-dir\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.369038 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.369035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd583885-7769-4c24-bf43-8d4361832242-tls-certs\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.369373 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.369333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-model-cache\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.369501 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.369413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-home\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.369501 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.369435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-tmp-dir\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.371368 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.371345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-dshm\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.371652 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.371624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd583885-7769-4c24-bf43-8d4361832242-tls-certs\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.378804 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.378763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz4vt\" (UniqueName: \"kubernetes.io/projected/bd583885-7769-4c24-bf43-8d4361832242-kube-api-access-zz4vt\") pod \"ipp-route-8a6414-kserve-5ff9cd89d7-rht9q\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") " pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.482196 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.482126    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:18.633130 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:18.633100    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"]
Jul 24 17:57:18.633989 ip-10-0-130-142 kubenswrapper[2563]: W0724 17:57:18.633963    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd583885_7769_4c24_bf43_8d4361832242.slice/crio-a0129a2755ca7be4b0c0fd96f16c7044002cf10dc03be1e91dca68f163e2d4f5 WatchSource:0}: Error finding container a0129a2755ca7be4b0c0fd96f16c7044002cf10dc03be1e91dca68f163e2d4f5: Status 404 returned error can't find the container with id a0129a2755ca7be4b0c0fd96f16c7044002cf10dc03be1e91dca68f163e2d4f5
Jul 24 17:57:19.255277 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:19.255245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q" event={"ID":"bd583885-7769-4c24-bf43-8d4361832242","Type":"ContainerStarted","Data":"651cb143234c4506bb1a0a1cf13d90aeb5183ec7f9f231828e1113f5676f3290"}
Jul 24 17:57:19.255670 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:19.255292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q" event={"ID":"bd583885-7769-4c24-bf43-8d4361832242","Type":"ContainerStarted","Data":"a0129a2755ca7be4b0c0fd96f16c7044002cf10dc03be1e91dca68f163e2d4f5"}
Jul 24 17:57:19.277406 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:19.277352    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q" podStartSLOduration=1.277338402 podStartE2EDuration="1.277338402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:57:19.273932968 +0000 UTC m=+2831.901810823" watchObservedRunningTime="2026-07-24 17:57:19.277338402 +0000 UTC m=+2831.905216254"
Jul 24 17:57:28.482952 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:28.482917    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:28.482952 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:28.482963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:28.495541 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:28.495515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:57:29.327443 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:57:29.327411    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:58:02.734301 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:58:02.734183    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw_b2470194-c1d9-4b34-86d4-beeeb8f69ab3/payload-processing/0.log"
Jul 24 17:58:02.858178 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:58:02.858149    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-44t9h_dfbfdcdc-ff69-44e5-afea-1aac1f907044/payload-processing/0.log"
Jul 24 17:58:03.001939 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:58:03.001851    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk_337b6558-d2c3-4fbd-8989-40de15174a0c/payload-processing/0.log"
Jul 24 17:59:02.817406 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:02.817364    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"]
Jul 24 17:59:02.817975 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:02.817588    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm" podUID="7cf810c9-4838-4947-b1e1-23df56d645f4" containerName="maas-api" containerID="cri-o://422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7" gracePeriod=30
Jul 24 17:59:02.885471 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:02.885432    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"]
Jul 24 17:59:02.885824 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:02.885768    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw" podUID="b2470194-c1d9-4b34-86d4-beeeb8f69ab3" containerName="payload-processing" containerID="cri-o://9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251" gracePeriod=30
Jul 24 17:59:02.965553 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:02.965509    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw" podUID="b2470194-c1d9-4b34-86d4-beeeb8f69ab3" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.86:9004: connect: connection refused"
Jul 24 17:59:02.965717 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:02.965525    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm" podUID="7cf810c9-4838-4947-b1e1-23df56d645f4" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.85:8443/health\": dial tcp 10.132.0.85:8443: connect: connection refused"
Jul 24 17:59:03.153892 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.153860    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:59:03.188118 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.188088    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:59:03.233644 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.233611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf810c9-4838-4947-b1e1-23df56d645f4-openshift-service-ca\") pod \"7cf810c9-4838-4947-b1e1-23df56d645f4\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") "
Jul 24 17:59:03.233843 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.233738    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlnx6\" (UniqueName: \"kubernetes.io/projected/7cf810c9-4838-4947-b1e1-23df56d645f4-kube-api-access-vlnx6\") pod \"7cf810c9-4838-4947-b1e1-23df56d645f4\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") "
Jul 24 17:59:03.233843 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.233819    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cf810c9-4838-4947-b1e1-23df56d645f4-maas-api-tls\") pod \"7cf810c9-4838-4947-b1e1-23df56d645f4\" (UID: \"7cf810c9-4838-4947-b1e1-23df56d645f4\") "
Jul 24 17:59:03.234170 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.234142    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cf810c9-4838-4947-b1e1-23df56d645f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7cf810c9-4838-4947-b1e1-23df56d645f4" (UID: "7cf810c9-4838-4947-b1e1-23df56d645f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:59:03.236089 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.236063    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cf810c9-4838-4947-b1e1-23df56d645f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7cf810c9-4838-4947-b1e1-23df56d645f4" (UID: "7cf810c9-4838-4947-b1e1-23df56d645f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:59:03.236320 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.236293    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cf810c9-4838-4947-b1e1-23df56d645f4-kube-api-access-vlnx6" (OuterVolumeSpecName: "kube-api-access-vlnx6") pod "7cf810c9-4838-4947-b1e1-23df56d645f4" (UID: "7cf810c9-4838-4947-b1e1-23df56d645f4"). InnerVolumeSpecName "kube-api-access-vlnx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:59:03.335121 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.335088    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-plugins-config-volume\") pod \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\" (UID: \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\") "
Jul 24 17:59:03.335310 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.335160    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft5lc\" (UniqueName: \"kubernetes.io/projected/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-kube-api-access-ft5lc\") pod \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\" (UID: \"b2470194-c1d9-4b34-86d4-beeeb8f69ab3\") "
Jul 24 17:59:03.335362 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.335343    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlnx6\" (UniqueName: \"kubernetes.io/projected/7cf810c9-4838-4947-b1e1-23df56d645f4-kube-api-access-vlnx6\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:03.335362 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.335354    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cf810c9-4838-4947-b1e1-23df56d645f4-maas-api-tls\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:03.335435 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.335363    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf810c9-4838-4947-b1e1-23df56d645f4-openshift-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:03.335489 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.335464    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2470194-c1d9-4b34-86d4-beeeb8f69ab3" (UID: "b2470194-c1d9-4b34-86d4-beeeb8f69ab3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:59:03.337404 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.337377    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-kube-api-access-ft5lc" (OuterVolumeSpecName: "kube-api-access-ft5lc") pod "b2470194-c1d9-4b34-86d4-beeeb8f69ab3" (UID: "b2470194-c1d9-4b34-86d4-beeeb8f69ab3"). InnerVolumeSpecName "kube-api-access-ft5lc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:59:03.436591 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.436551    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-plugins-config-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:03.436591 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.436584    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft5lc\" (UniqueName: \"kubernetes.io/projected/b2470194-c1d9-4b34-86d4-beeeb8f69ab3-kube-api-access-ft5lc\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:03.896690 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.896652    2563 generic.go:356] "Generic (PLEG): container finished" podID="b2470194-c1d9-4b34-86d4-beeeb8f69ab3" containerID="9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251" exitCode=0
Jul 24 17:59:03.897207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.896702    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"
Jul 24 17:59:03.897207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.896742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw" event={"ID":"b2470194-c1d9-4b34-86d4-beeeb8f69ab3","Type":"ContainerDied","Data":"9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251"}
Jul 24 17:59:03.897207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.896826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw" event={"ID":"b2470194-c1d9-4b34-86d4-beeeb8f69ab3","Type":"ContainerDied","Data":"aff1594aa774880d13763160ba1311947ff56edb71e2b6403a1b4fdc5fbb52a8"}
Jul 24 17:59:03.897207 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.896861    2563 scope.go:117] "RemoveContainer" containerID="9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251"
Jul 24 17:59:03.898250 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.898228    2563 generic.go:356] "Generic (PLEG): container finished" podID="7cf810c9-4838-4947-b1e1-23df56d645f4" containerID="422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7" exitCode=0
Jul 24 17:59:03.898327 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.898273    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm" event={"ID":"7cf810c9-4838-4947-b1e1-23df56d645f4","Type":"ContainerDied","Data":"422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7"}
Jul 24 17:59:03.898327 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.898285    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"
Jul 24 17:59:03.898327 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.898309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm" event={"ID":"7cf810c9-4838-4947-b1e1-23df56d645f4","Type":"ContainerDied","Data":"f58e31933f921572e2e9a15cb4c90282f9e5b2095389cb389710dfc81c1f8f3f"}
Jul 24 17:59:03.908806 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.908754    2563 scope.go:117] "RemoveContainer" containerID="9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251"
Jul 24 17:59:03.909167 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:59:03.909138    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251\": container with ID starting with 9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251 not found: ID does not exist" containerID="9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251"
Jul 24 17:59:03.909240 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.909181    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251"} err="failed to get container status \"9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251\": rpc error: code = NotFound desc = could not find container \"9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251\": container with ID starting with 9f29f40b2803c668edcad4b589f3d65320ec046d266e7b2cfa471c1439916251 not found: ID does not exist"
Jul 24 17:59:03.909240 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.909207    2563 scope.go:117] "RemoveContainer" containerID="422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7"
Jul 24 17:59:03.918695 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.918675    2563 scope.go:117] "RemoveContainer" containerID="422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7"
Jul 24 17:59:03.919057 ip-10-0-130-142 kubenswrapper[2563]: E0724 17:59:03.919029    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7\": container with ID starting with 422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7 not found: ID does not exist" containerID="422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7"
Jul 24 17:59:03.919123 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.919057    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7"} err="failed to get container status \"422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7\": rpc error: code = NotFound desc = could not find container \"422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7\": container with ID starting with 422733326bd16ce08e55a47f3f7aebea229d2acbd24f7fa3a68b4cf64d212be7 not found: ID does not exist"
Jul 24 17:59:03.924205 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.924180    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"]
Jul 24 17:59:03.940281 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.940255    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw"]
Jul 24 17:59:03.954480 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.954455    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"]
Jul 24 17:59:03.956902 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:03.956877    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8a6414-b4d59c9c4-59tsm"]
Jul 24 17:59:05.937630 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:05.937595    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cf810c9-4838-4947-b1e1-23df56d645f4" path="/var/lib/kubelet/pods/7cf810c9-4838-4947-b1e1-23df56d645f4/volumes"
Jul 24 17:59:05.938150 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:05.938133    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2470194-c1d9-4b34-86d4-beeeb8f69ab3" path="/var/lib/kubelet/pods/b2470194-c1d9-4b34-86d4-beeeb8f69ab3/volumes"
Jul 24 17:59:12.797946 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:12.797910    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"]
Jul 24 17:59:27.817822 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:27.817765    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q" podUID="bd583885-7769-4c24-bf43-8d4361832242" containerName="main" containerID="cri-o://651cb143234c4506bb1a0a1cf13d90aeb5183ec7f9f231828e1113f5676f3290" gracePeriod=45
Jul 24 17:59:28.053103 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.053072    2563 generic.go:356] "Generic (PLEG): container finished" podID="bd583885-7769-4c24-bf43-8d4361832242" containerID="651cb143234c4506bb1a0a1cf13d90aeb5183ec7f9f231828e1113f5676f3290" exitCode=0
Jul 24 17:59:28.053277 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.053144    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q" event={"ID":"bd583885-7769-4c24-bf43-8d4361832242","Type":"ContainerDied","Data":"651cb143234c4506bb1a0a1cf13d90aeb5183ec7f9f231828e1113f5676f3290"}
Jul 24 17:59:28.086718 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.086693    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:59:28.169901 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.169872    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd583885-7769-4c24-bf43-8d4361832242-tls-certs\") pod \"bd583885-7769-4c24-bf43-8d4361832242\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") "
Jul 24 17:59:28.170073 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.169924    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-model-cache\") pod \"bd583885-7769-4c24-bf43-8d4361832242\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") "
Jul 24 17:59:28.170073 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.169946    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz4vt\" (UniqueName: \"kubernetes.io/projected/bd583885-7769-4c24-bf43-8d4361832242-kube-api-access-zz4vt\") pod \"bd583885-7769-4c24-bf43-8d4361832242\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") "
Jul 24 17:59:28.170073 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.169984    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-tmp-dir\") pod \"bd583885-7769-4c24-bf43-8d4361832242\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") "
Jul 24 17:59:28.170073 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.170058    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-dshm\") pod \"bd583885-7769-4c24-bf43-8d4361832242\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") "
Jul 24 17:59:28.170278 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.170082    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-home\") pod \"bd583885-7769-4c24-bf43-8d4361832242\" (UID: \"bd583885-7769-4c24-bf43-8d4361832242\") "
Jul 24 17:59:28.170278 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.170221    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd583885-7769-4c24-bf43-8d4361832242" (UID: "bd583885-7769-4c24-bf43-8d4361832242"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:59:28.170434 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.170409    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd583885-7769-4c24-bf43-8d4361832242" (UID: "bd583885-7769-4c24-bf43-8d4361832242"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:59:28.170434 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.170420    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-home" (OuterVolumeSpecName: "home") pod "bd583885-7769-4c24-bf43-8d4361832242" (UID: "bd583885-7769-4c24-bf43-8d4361832242"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:59:28.170570 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.170489    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-model-cache\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:28.172409 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.172383    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-dshm" (OuterVolumeSpecName: "dshm") pod "bd583885-7769-4c24-bf43-8d4361832242" (UID: "bd583885-7769-4c24-bf43-8d4361832242"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:59:28.172666 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.172633    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd583885-7769-4c24-bf43-8d4361832242-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd583885-7769-4c24-bf43-8d4361832242" (UID: "bd583885-7769-4c24-bf43-8d4361832242"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:59:28.172666 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.172648    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd583885-7769-4c24-bf43-8d4361832242-kube-api-access-zz4vt" (OuterVolumeSpecName: "kube-api-access-zz4vt") pod "bd583885-7769-4c24-bf43-8d4361832242" (UID: "bd583885-7769-4c24-bf43-8d4361832242"). InnerVolumeSpecName "kube-api-access-zz4vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:59:28.271676 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.271638    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-dshm\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:28.271676 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.271670    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-home\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:28.271676 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.271679    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd583885-7769-4c24-bf43-8d4361832242-tls-certs\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:28.271951 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.271690    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz4vt\" (UniqueName: \"kubernetes.io/projected/bd583885-7769-4c24-bf43-8d4361832242-kube-api-access-zz4vt\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:28.271951 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:28.271699    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd583885-7769-4c24-bf43-8d4361832242-tmp-dir\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 17:59:29.060014 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:29.059923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q" event={"ID":"bd583885-7769-4c24-bf43-8d4361832242","Type":"ContainerDied","Data":"a0129a2755ca7be4b0c0fd96f16c7044002cf10dc03be1e91dca68f163e2d4f5"}
Jul 24 17:59:29.060014 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:29.059987    2563 scope.go:117] "RemoveContainer" containerID="651cb143234c4506bb1a0a1cf13d90aeb5183ec7f9f231828e1113f5676f3290"
Jul 24 17:59:29.060535 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:29.060016    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"
Jul 24 17:59:29.084536 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:29.084505    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"]
Jul 24 17:59:29.088559 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:29.088536    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-8a6414/ipp-route-8a6414-kserve-5ff9cd89d7-rht9q"]
Jul 24 17:59:29.937424 ip-10-0-130-142 kubenswrapper[2563]: I0724 17:59:29.937388    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd583885-7769-4c24-bf43-8d4361832242" path="/var/lib/kubelet/pods/bd583885-7769-4c24-bf43-8d4361832242/volumes"
Jul 24 18:00:07.470451 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:07.470417    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"]
Jul 24 18:00:07.471071 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:07.470618    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk" podUID="337b6558-d2c3-4fbd-8989-40de15174a0c" containerName="payload-processing" containerID="cri-o://6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0" gracePeriod=30
Jul 24 18:00:07.737591 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:07.737557    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 18:00:07.824851 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:07.824824    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/337b6558-d2c3-4fbd-8989-40de15174a0c-plugins-config-volume\") pod \"337b6558-d2c3-4fbd-8989-40de15174a0c\" (UID: \"337b6558-d2c3-4fbd-8989-40de15174a0c\") "
Jul 24 18:00:07.825020 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:07.824883    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz8zd\" (UniqueName: \"kubernetes.io/projected/337b6558-d2c3-4fbd-8989-40de15174a0c-kube-api-access-bz8zd\") pod \"337b6558-d2c3-4fbd-8989-40de15174a0c\" (UID: \"337b6558-d2c3-4fbd-8989-40de15174a0c\") "
Jul 24 18:00:07.825253 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:07.825229    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337b6558-d2c3-4fbd-8989-40de15174a0c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "337b6558-d2c3-4fbd-8989-40de15174a0c" (UID: "337b6558-d2c3-4fbd-8989-40de15174a0c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:00:07.827000 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:07.826979    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337b6558-d2c3-4fbd-8989-40de15174a0c-kube-api-access-bz8zd" (OuterVolumeSpecName: "kube-api-access-bz8zd") pod "337b6558-d2c3-4fbd-8989-40de15174a0c" (UID: "337b6558-d2c3-4fbd-8989-40de15174a0c"). InnerVolumeSpecName "kube-api-access-bz8zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:00:07.926437 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:07.926395    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/337b6558-d2c3-4fbd-8989-40de15174a0c-plugins-config-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 18:00:07.926437 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:07.926426    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz8zd\" (UniqueName: \"kubernetes.io/projected/337b6558-d2c3-4fbd-8989-40de15174a0c-kube-api-access-bz8zd\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 18:00:08.161648 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.161616    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 18:00:08.191022 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.190994    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 18:00:08.307612 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.307580    2563 generic.go:356] "Generic (PLEG): container finished" podID="337b6558-d2c3-4fbd-8989-40de15174a0c" containerID="6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0" exitCode=0
Jul 24 18:00:08.307825 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.307651    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"
Jul 24 18:00:08.307825 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.307647    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk" event={"ID":"337b6558-d2c3-4fbd-8989-40de15174a0c","Type":"ContainerDied","Data":"6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0"}
Jul 24 18:00:08.307825 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.307763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk" event={"ID":"337b6558-d2c3-4fbd-8989-40de15174a0c","Type":"ContainerDied","Data":"daa6be4b12a79d022912ca34fbb4215c35f5c60614435ec221cac8f427151665"}
Jul 24 18:00:08.307825 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.307812    2563 scope.go:117] "RemoveContainer" containerID="6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0"
Jul 24 18:00:08.317429 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.317410    2563 scope.go:117] "RemoveContainer" containerID="6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0"
Jul 24 18:00:08.317690 ip-10-0-130-142 kubenswrapper[2563]: E0724 18:00:08.317671    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0\": container with ID starting with 6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0 not found: ID does not exist" containerID="6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0"
Jul 24 18:00:08.317766 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.317700    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0"} err="failed to get container status \"6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0\": rpc error: code = NotFound desc = could not find container \"6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0\": container with ID starting with 6bdc58a48b58ca8a933adfac92b916505fe9ff2d333fa206ab73fee90f0656b0 not found: ID does not exist"
Jul 24 18:00:08.327365 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.327344    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"]
Jul 24 18:00:08.336844 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:08.336817    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk"]
Jul 24 18:00:09.937737 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:09.937693    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="337b6558-d2c3-4fbd-8989-40de15174a0c" path="/var/lib/kubelet/pods/337b6558-d2c3-4fbd-8989-40de15174a0c/volumes"
Jul 24 18:00:51.996361 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:51.996326    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"]
Jul 24 18:00:51.996957 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:51.996627    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl" podUID="22a1c173-6172-4270-9a5d-846408be1f1d" containerName="maas-api" containerID="cri-o://ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124" gracePeriod=30
Jul 24 18:00:52.252297 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.252235    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 18:00:52.428059 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.428021    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22a1c173-6172-4270-9a5d-846408be1f1d-maas-api-tls\") pod \"22a1c173-6172-4270-9a5d-846408be1f1d\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") "
Jul 24 18:00:52.428228 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.428113    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjvt8\" (UniqueName: \"kubernetes.io/projected/22a1c173-6172-4270-9a5d-846408be1f1d-kube-api-access-hjvt8\") pod \"22a1c173-6172-4270-9a5d-846408be1f1d\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") "
Jul 24 18:00:52.428228 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.428139    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22a1c173-6172-4270-9a5d-846408be1f1d-openshift-service-ca\") pod \"22a1c173-6172-4270-9a5d-846408be1f1d\" (UID: \"22a1c173-6172-4270-9a5d-846408be1f1d\") "
Jul 24 18:00:52.428524 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.428497    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22a1c173-6172-4270-9a5d-846408be1f1d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22a1c173-6172-4270-9a5d-846408be1f1d" (UID: "22a1c173-6172-4270-9a5d-846408be1f1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:00:52.430233 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.430208    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22a1c173-6172-4270-9a5d-846408be1f1d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22a1c173-6172-4270-9a5d-846408be1f1d" (UID: "22a1c173-6172-4270-9a5d-846408be1f1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:00:52.430343 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.430268    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22a1c173-6172-4270-9a5d-846408be1f1d-kube-api-access-hjvt8" (OuterVolumeSpecName: "kube-api-access-hjvt8") pod "22a1c173-6172-4270-9a5d-846408be1f1d" (UID: "22a1c173-6172-4270-9a5d-846408be1f1d"). InnerVolumeSpecName "kube-api-access-hjvt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:00:52.529270 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.529198    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22a1c173-6172-4270-9a5d-846408be1f1d-maas-api-tls\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 18:00:52.529270 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.529225    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjvt8\" (UniqueName: \"kubernetes.io/projected/22a1c173-6172-4270-9a5d-846408be1f1d-kube-api-access-hjvt8\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 18:00:52.529270 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.529235    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22a1c173-6172-4270-9a5d-846408be1f1d-openshift-service-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\""
Jul 24 18:00:52.575309 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.575274    2563 generic.go:356] "Generic (PLEG): container finished" podID="22a1c173-6172-4270-9a5d-846408be1f1d" containerID="ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124" exitCode=0
Jul 24 18:00:52.575457 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.575318    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"
Jul 24 18:00:52.575457 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.575356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl" event={"ID":"22a1c173-6172-4270-9a5d-846408be1f1d","Type":"ContainerDied","Data":"ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124"}
Jul 24 18:00:52.575457 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.575410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl" event={"ID":"22a1c173-6172-4270-9a5d-846408be1f1d","Type":"ContainerDied","Data":"67dcf1e1e1e372ffb4f9f96926681570e38f1434ae796685dd0a7bcc9add5a92"}
Jul 24 18:00:52.575457 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.575437    2563 scope.go:117] "RemoveContainer" containerID="ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124"
Jul 24 18:00:52.585405 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.585387    2563 scope.go:117] "RemoveContainer" containerID="ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124"
Jul 24 18:00:52.585662 ip-10-0-130-142 kubenswrapper[2563]: E0724 18:00:52.585639    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124\": container with ID starting with ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124 not found: ID does not exist" containerID="ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124"
Jul 24 18:00:52.585767 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.585667    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124"} err="failed to get container status \"ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124\": rpc error: code = NotFound desc = could not find container \"ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124\": container with ID starting with ce712824dba08f033d21669b7314853324cee72c2f1a9e5351870c38b60f3124 not found: ID does not exist"
Jul 24 18:00:52.596483 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.596463    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"]
Jul 24 18:00:52.600923 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:52.600903    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5c7cfc-67cd65b9c8-g4gpl"]
Jul 24 18:00:53.937151 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:00:53.937118    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22a1c173-6172-4270-9a5d-846408be1f1d" path="/var/lib/kubelet/pods/22a1c173-6172-4270-9a5d-846408be1f1d/volumes"
Jul 24 18:01:04.254668 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:04.254585    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68d8dcb677-ndrsf_5dc0b41b-995a-44c2-ad43-511bcaf585a5/authorino/0.log"
Jul 24 18:01:09.585639 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:09.585614    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mfz7b_06de65a4-a5cc-4367-a21a-859b4ccfcbf8/manager/0.log"
Jul 24 18:01:09.713333 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:09.713303    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pkwn9_4ec83345-2f15-463b-8e78-0184a8b849f1/manager/0.log"
Jul 24 18:01:09.973452 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:09.973425    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c2hgq_91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c/server/0.log"
Jul 24 18:01:10.097554 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:10.097528    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p2wjf_f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057/manager/0.log"
Jul 24 18:01:10.212379 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:10.212349    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bcd74455c-7gqm9_eb2de119-8ecf-4de0-b642-7e8f241231c9/copy-manifests/0.log"
Jul 24 18:01:10.230743 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:10.230679    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bcd74455c-7gqm9_eb2de119-8ecf-4de0-b642-7e8f241231c9/manager/0.log"
Jul 24 18:01:10.806895 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:10.806860    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6f46495b76-m2lrd_915b6c04-a671-400e-9fca-2812cdc9fb6e/maas-api/0.log"
Jul 24 18:01:11.272482 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:11.272444    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-rwwjc_90d4a2d3-f033-4ba3-8a89-8b94d717c52b/postgres/0.log"
Jul 24 18:01:12.052590 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.052563    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh_84d1038b-2c7e-4f03-9a5f-b6a8e309a945/util/0.log"
Jul 24 18:01:12.059642 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.059617    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh_84d1038b-2c7e-4f03-9a5f-b6a8e309a945/pull/0.log"
Jul 24 18:01:12.066076 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.066055    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh_84d1038b-2c7e-4f03-9a5f-b6a8e309a945/extract/0.log"
Jul 24 18:01:12.181511 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.181481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh_8376950c-5e5a-425d-ba3e-574e65b08242/util/0.log"
Jul 24 18:01:12.188301 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.188279    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh_8376950c-5e5a-425d-ba3e-574e65b08242/pull/0.log"
Jul 24 18:01:12.194656 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.194636    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh_8376950c-5e5a-425d-ba3e-574e65b08242/extract/0.log"
Jul 24 18:01:12.304140 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.304077    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px_a5f2a8fe-7e0b-44d1-91a0-427b309c00ea/util/0.log"
Jul 24 18:01:12.310762 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.310735    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px_a5f2a8fe-7e0b-44d1-91a0-427b309c00ea/pull/0.log"
Jul 24 18:01:12.317112 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.317091    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px_a5f2a8fe-7e0b-44d1-91a0-427b309c00ea/extract/0.log"
Jul 24 18:01:12.426430 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.426401    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8_325a1546-70bb-4c0c-b9d7-c57d828efb86/extract/0.log"
Jul 24 18:01:12.432638 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.432615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8_325a1546-70bb-4c0c-b9d7-c57d828efb86/util/0.log"
Jul 24 18:01:12.439538 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.439522    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8_325a1546-70bb-4c0c-b9d7-c57d828efb86/pull/0.log"
Jul 24 18:01:12.565545 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.565466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68d8dcb677-ndrsf_5dc0b41b-995a-44c2-ad43-511bcaf585a5/authorino/0.log"
Jul 24 18:01:12.681914 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.681891    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g7b7q_ccf99a8a-a00a-4426-a4fd-300151aa70b5/manager/0.log"
Jul 24 18:01:12.792324 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:12.792291    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6fn4s_d00bea80-48c1-4b45-9e7f-549024f29c20/manager/0.log"
Jul 24 18:01:13.025104 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:13.025070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9tsks_78058d46-35e9-4ea3-9fb7-2e1324f6ed83/registry-server/0.log"
Jul 24 18:01:13.149935 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:13.149907    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gtfv2_3cbccdb0-1da6-4c77-9abb-cb52295c7b27/manager/0.log"
Jul 24 18:01:13.384456 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:13.384353    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ptkmw_d6ce209f-8cb8-44f9-84c4-072df632e04b/manager/0.log"
Jul 24 18:01:14.067750 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:14.067707    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84b496c558-jrfl7_f8e30207-dd22-42c4-b3af-ad8980d33d8d/kube-auth-proxy/0.log"
Jul 24 18:01:14.426812 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:14.426765    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-44t9h_dfbfdcdc-ff69-44e5-afea-1aac1f907044/payload-processing/0.log"
Jul 24 18:01:14.543307 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:14.543269    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fdb95cfb7-czwhl_9d06e44e-82c7-434e-b132-c55253507247/router/0.log"
Jul 24 18:01:15.001612 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:15.001578    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jqsnk_8db66891-f242-42f0-9acc-613bf68c321b/main/0.log"
Jul 24 18:01:15.116735 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:15.116700    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dsmbb_dace38e1-8367-4ac8-8f18-dfb5ff8f3674/main/0.log"
Jul 24 18:01:24.070233 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:24.070195    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rcw58_9a539260-c108-464f-a64c-4d43ab4b71f6/global-pull-secret-syncer/0.log"
Jul 24 18:01:24.232738 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:24.232709    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f9t7x_2296e0ea-43c7-4caa-a363-d2362de86050/konnectivity-agent/0.log"
Jul 24 18:01:24.253523 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:24.253492    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-142.ec2.internal_b391d4f348573e91689bb0c2ff5339e9/haproxy/0.log"
Jul 24 18:01:28.682671 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.682645    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh_84d1038b-2c7e-4f03-9a5f-b6a8e309a945/extract/0.log"
Jul 24 18:01:28.700925 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.700894    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh_84d1038b-2c7e-4f03-9a5f-b6a8e309a945/util/0.log"
Jul 24 18:01:28.718653 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.718616    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rkmsh_84d1038b-2c7e-4f03-9a5f-b6a8e309a945/pull/0.log"
Jul 24 18:01:28.744245 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.744214    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh_8376950c-5e5a-425d-ba3e-574e65b08242/extract/0.log"
Jul 24 18:01:28.760361 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.760339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh_8376950c-5e5a-425d-ba3e-574e65b08242/util/0.log"
Jul 24 18:01:28.782203 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.782177    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9vqh_8376950c-5e5a-425d-ba3e-574e65b08242/pull/0.log"
Jul 24 18:01:28.801356 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.801332    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px_a5f2a8fe-7e0b-44d1-91a0-427b309c00ea/extract/0.log"
Jul 24 18:01:28.818095 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.818074    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px_a5f2a8fe-7e0b-44d1-91a0-427b309c00ea/util/0.log"
Jul 24 18:01:28.835554 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.835494    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dr6px_a5f2a8fe-7e0b-44d1-91a0-427b309c00ea/pull/0.log"
Jul 24 18:01:28.858418 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.858390    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8_325a1546-70bb-4c0c-b9d7-c57d828efb86/extract/0.log"
Jul 24 18:01:28.877703 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.877677    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8_325a1546-70bb-4c0c-b9d7-c57d828efb86/util/0.log"
Jul 24 18:01:28.898374 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:28.898350    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1595c8_325a1546-70bb-4c0c-b9d7-c57d828efb86/pull/0.log"
Jul 24 18:01:29.597460 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:29.597424    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68d8dcb677-ndrsf_5dc0b41b-995a-44c2-ad43-511bcaf585a5/authorino/0.log"
Jul 24 18:01:29.634994 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:29.634962    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g7b7q_ccf99a8a-a00a-4426-a4fd-300151aa70b5/manager/0.log"
Jul 24 18:01:29.687528 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:29.687503    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6fn4s_d00bea80-48c1-4b45-9e7f-549024f29c20/manager/0.log"
Jul 24 18:01:29.780540 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:29.780510    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9tsks_78058d46-35e9-4ea3-9fb7-2e1324f6ed83/registry-server/0.log"
Jul 24 18:01:30.021856 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:30.021819    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gtfv2_3cbccdb0-1da6-4c77-9abb-cb52295c7b27/manager/0.log"
Jul 24 18:01:30.182400 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:30.182345    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ptkmw_d6ce209f-8cb8-44f9-84c4-072df632e04b/manager/0.log"
Jul 24 18:01:32.128425 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:32.128389    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-wjlkv_bd972454-db03-460f-930e-70f7d8982857/cluster-monitoring-operator/0.log"
Jul 24 18:01:32.466373 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:32.466345    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-grqvf_160d5532-f69e-46c9-a4d7-42fc10ac5709/node-exporter/0.log"
Jul 24 18:01:32.484846 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:32.484813    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-grqvf_160d5532-f69e-46c9-a4d7-42fc10ac5709/kube-rbac-proxy/0.log"
Jul 24 18:01:32.503323 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:32.503301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-grqvf_160d5532-f69e-46c9-a4d7-42fc10ac5709/init-textfile/0.log"
Jul 24 18:01:34.024737 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.024706    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"]
Jul 24 18:01:34.025168 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025122    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cf810c9-4838-4947-b1e1-23df56d645f4" containerName="maas-api"
Jul 24 18:01:34.025168 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025134    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cf810c9-4838-4947-b1e1-23df56d645f4" containerName="maas-api"
Jul 24 18:01:34.025168 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025142    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2470194-c1d9-4b34-86d4-beeeb8f69ab3" containerName="payload-processing"
Jul 24 18:01:34.025168 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025148    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2470194-c1d9-4b34-86d4-beeeb8f69ab3" containerName="payload-processing"
Jul 24 18:01:34.025168 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025156    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337b6558-d2c3-4fbd-8989-40de15174a0c" containerName="payload-processing"
Jul 24 18:01:34.025168 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025163    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="337b6558-d2c3-4fbd-8989-40de15174a0c" containerName="payload-processing"
Jul 24 18:01:34.025401 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025173    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd583885-7769-4c24-bf43-8d4361832242" containerName="main"
Jul 24 18:01:34.025401 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025178    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd583885-7769-4c24-bf43-8d4361832242" containerName="main"
Jul 24 18:01:34.025401 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025191    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22a1c173-6172-4270-9a5d-846408be1f1d" containerName="maas-api"
Jul 24 18:01:34.025401 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025195    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22a1c173-6172-4270-9a5d-846408be1f1d" containerName="maas-api"
Jul 24 18:01:34.025401 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025253    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd583885-7769-4c24-bf43-8d4361832242" containerName="main"
Jul 24 18:01:34.025401 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025263    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="22a1c173-6172-4270-9a5d-846408be1f1d" containerName="maas-api"
Jul 24 18:01:34.025401 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025268    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cf810c9-4838-4947-b1e1-23df56d645f4" containerName="maas-api"
Jul 24 18:01:34.025401 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025276    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="337b6558-d2c3-4fbd-8989-40de15174a0c" containerName="payload-processing"
Jul 24 18:01:34.025401 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.025283    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2470194-c1d9-4b34-86d4-beeeb8f69ab3" containerName="payload-processing"
Jul 24 18:01:34.028569 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.028551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.031465 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.031440    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g7vgp\"/\"kube-root-ca.crt\""
Jul 24 18:01:34.032869 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.032846    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g7vgp\"/\"openshift-service-ca.crt\""
Jul 24 18:01:34.032869 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.032867    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g7vgp\"/\"default-dockercfg-ml5bw\""
Jul 24 18:01:34.039319 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.039297    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"]
Jul 24 18:01:34.190762 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.190727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-proc\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.190944 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.190777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qgm\" (UniqueName: \"kubernetes.io/projected/e53ea0bd-7665-417e-887e-f25d2a77a10a-kube-api-access-m9qgm\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.190944 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.190836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-lib-modules\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.190944 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.190871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-podres\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.190944 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.190921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-sys\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.234204 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.234181    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-xqxkv_3f934e78-0a38-43f9-9e4b-145cba4c780b/networking-console-plugin/0.log"
Jul 24 18:01:34.292216 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.292141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-proc\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.292216 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.292190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qgm\" (UniqueName: \"kubernetes.io/projected/e53ea0bd-7665-417e-887e-f25d2a77a10a-kube-api-access-m9qgm\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.292216 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.292210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-lib-modules\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.292415 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.292242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-podres\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.292415 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.292261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-sys\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.292415 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.292260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-proc\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.292415 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.292324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-sys\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.292415 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.292400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-lib-modules\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.292415 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.292404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e53ea0bd-7665-417e-887e-f25d2a77a10a-podres\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.302837 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.302782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qgm\" (UniqueName: \"kubernetes.io/projected/e53ea0bd-7665-417e-887e-f25d2a77a10a-kube-api-access-m9qgm\") pod \"perf-node-gather-daemonset-pnbxs\" (UID: \"e53ea0bd-7665-417e-887e-f25d2a77a10a\") " pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.338902 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.338879    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.501097 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.501066    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"]
Jul 24 18:01:34.501575 ip-10-0-130-142 kubenswrapper[2563]: W0724 18:01:34.501553    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode53ea0bd_7665_417e_887e_f25d2a77a10a.slice/crio-b0167352772f8c3c8aa7f0c530c3cfa10288e49f48cc4e130de8c7345fd9aaa3 WatchSource:0}: Error finding container b0167352772f8c3c8aa7f0c530c3cfa10288e49f48cc4e130de8c7345fd9aaa3: Status 404 returned error can't find the container with id b0167352772f8c3c8aa7f0c530c3cfa10288e49f48cc4e130de8c7345fd9aaa3
Jul 24 18:01:34.824295 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.824208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs" event={"ID":"e53ea0bd-7665-417e-887e-f25d2a77a10a","Type":"ContainerStarted","Data":"83a514b5c4b18414a3d697091aae42cb97049daf21615f5bc666af02b42913d2"}
Jul 24 18:01:34.824295 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.824265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs" event={"ID":"e53ea0bd-7665-417e-887e-f25d2a77a10a","Type":"ContainerStarted","Data":"b0167352772f8c3c8aa7f0c530c3cfa10288e49f48cc4e130de8c7345fd9aaa3"}
Jul 24 18:01:34.824488 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.824350    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:34.842125 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.842081    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs" podStartSLOduration=0.842066926 podStartE2EDuration="842.066926ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:01:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:01:34.840863578 +0000 UTC m=+3087.468741432" watchObservedRunningTime="2026-07-24 18:01:34.842066926 +0000 UTC m=+3087.469944778"
Jul 24 18:01:34.868942 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.868915    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/2.log"
Jul 24 18:01:34.876657 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:34.876639    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-qz8rp_aefcb407-941b-458d-a730-9dcd9cfa4546/console-operator/3.log"
Jul 24 18:01:35.359265 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:35.359237    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b6f9c667d-gf62b_567ea201-9137-4347-8b86-196c2e5037b2/console/0.log"
Jul 24 18:01:35.999204 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:35.999176    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-b9v5d_91a715da-e2ce-46ea-9b92-0a0b5290ea02/volume-data-source-validator/0.log"
Jul 24 18:01:37.108227 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:37.108190    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8hqc_c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d/dns/0.log"
Jul 24 18:01:37.126873 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:37.126849    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8hqc_c750b4c6-f5a6-46d3-8a2a-4c939ec55f0d/kube-rbac-proxy/0.log"
Jul 24 18:01:37.291765 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:37.291738    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-prz4f_a3a5d168-84a4-42e0-926f-939504b0eae7/dns-node-resolver/0.log"
Jul 24 18:01:37.881461 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:37.881438    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-66cd7ff8c9-hpmkh_51c72219-7a58-4b32-b3d1-53027ee5211d/registry/0.log"
Jul 24 18:01:37.951971 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:37.951947    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vl76g_1e840b99-c2f4-4033-a7d9-bcbb7b1bfdd3/node-ca/0.log"
Jul 24 18:01:39.058164 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:39.058127    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84b496c558-jrfl7_f8e30207-dd22-42c4-b3af-ad8980d33d8d/kube-auth-proxy/0.log"
Jul 24 18:01:39.176023 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:39.175988    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-44t9h_dfbfdcdc-ff69-44e5-afea-1aac1f907044/payload-processing/0.log"
Jul 24 18:01:39.197798 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:39.197775    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fdb95cfb7-czwhl_9d06e44e-82c7-434e-b132-c55253507247/router/0.log"
Jul 24 18:01:40.048494 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:40.048460    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g6grh_b04a360e-6ddc-4772-b74c-23b4e0e4f6ef/serve-healthcheck-canary/0.log"
Jul 24 18:01:40.557082 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:40.557037    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-h424t_4117eff4-ef14-4caa-836b-1c377499a2c7/insights-operator/0.log"
Jul 24 18:01:40.558405 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:40.558383    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-h424t_4117eff4-ef14-4caa-836b-1c377499a2c7/insights-operator/1.log"
Jul 24 18:01:40.695923 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:40.695892    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h45c9_2add8b07-4e2d-4187-9711-3a47099a6036/kube-rbac-proxy/0.log"
Jul 24 18:01:40.716626 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:40.716588    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h45c9_2add8b07-4e2d-4187-9711-3a47099a6036/exporter/0.log"
Jul 24 18:01:40.736359 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:40.736333    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h45c9_2add8b07-4e2d-4187-9711-3a47099a6036/extractor/0.log"
Jul 24 18:01:40.840695 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:40.840628    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g7vgp/perf-node-gather-daemonset-pnbxs"
Jul 24 18:01:43.140650 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:43.140564    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mfz7b_06de65a4-a5cc-4367-a21a-859b4ccfcbf8/manager/0.log"
Jul 24 18:01:43.499673 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:43.499640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pkwn9_4ec83345-2f15-463b-8e78-0184a8b849f1/manager/0.log"
Jul 24 18:01:43.660614 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:43.660577    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c2hgq_91b343fe-a0f0-4bc9-b6e1-d3a11d60bf1c/server/0.log"
Jul 24 18:01:43.776477 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:43.776393    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p2wjf_f6be5ae1-e4c0-4ad4-a7fc-2f130bab8057/manager/0.log"
Jul 24 18:01:43.909394 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:43.909361    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bcd74455c-7gqm9_eb2de119-8ecf-4de0-b642-7e8f241231c9/manager/0.log"
Jul 24 18:01:43.934016 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:43.933988    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bcd74455c-7gqm9_eb2de119-8ecf-4de0-b642-7e8f241231c9/copy-manifests/0.log"
Jul 24 18:01:45.109662 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:45.109623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84b496c558-jrfl7_f8e30207-dd22-42c4-b3af-ad8980d33d8d/kube-auth-proxy/0.log"
Jul 24 18:01:45.209606 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:45.209570    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-44t9h_dfbfdcdc-ff69-44e5-afea-1aac1f907044/payload-processing/0.log"
Jul 24 18:01:45.228337 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:45.228305    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fdb95cfb7-czwhl_9d06e44e-82c7-434e-b132-c55253507247/router/0.log"
Jul 24 18:01:45.309744 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:45.309703    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d6skq_0c8d4f72-3b2d-43ef-9eb2-f0cda72b30c3/openshift-lws-operator/0.log"
Jul 24 18:01:46.691152 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:46.691123    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84b496c558-jrfl7_f8e30207-dd22-42c4-b3af-ad8980d33d8d/kube-auth-proxy/0.log"
Jul 24 18:01:46.789205 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:46.789163    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-44t9h_dfbfdcdc-ff69-44e5-afea-1aac1f907044/payload-processing/0.log"
Jul 24 18:01:46.811700 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:46.811675    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fdb95cfb7-czwhl_9d06e44e-82c7-434e-b132-c55253507247/router/0.log"
Jul 24 18:01:50.561584 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:50.561553    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-zct84_96201cf2-414e-4660-b819-d8598262234b/kube-storage-version-migrator-operator/1.log"
Jul 24 18:01:50.563265 ip-10-0-130-142 kubenswrapper[2563]: I0724 18:01:50.563242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-zct84_96201cf2-414e-4660-b819-d8598262234b/kube-storage-version-migrator-operator/0.log"